2024-08-18T23:52:06.987 INFO:root:teuthology version: 1.2.0 2024-08-18T23:52:07.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T23:52:07.095 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/backtrace} email: ceph-qa@ceph.com first_in_suite: false job_id: '7860032' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1664 sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 sleep_before_teardown: 0 subset: 36/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJsu3yGvzIfjuCNxtxoetjewyyglc+7DArQ7ysD12rEONIJ3mJU8F3rcZy5Ub3QWjKF5ULvbGAK+yOIq0wxRpI= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDgka3reqIMcMNf81KQRwide0EW4V0X9mNpZpai7UD/2W9YlnmCnvRAWAetuTfqM7LxGvTEFZQKfrzDXjrnbucA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_backtrace teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-18T23:52:07.095 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa; will attempt to use it 2024-08-18T23:52:07.096 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks 2024-08-18T23:52:07.096 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-18T23:52:07.098 INFO:teuthology.task.internal:Checking packages... 2024-08-18T23:52:07.121 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'de09dd018de4baddfa6ca4d43bc8fb784cf75833' 2024-08-18T23:52:07.121 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-18T23:52:07.121 INFO:teuthology.packaging:ref: None 2024-08-18T23:52:07.121 INFO:teuthology.packaging:tag: None 2024-08-18T23:52:07.121 INFO:teuthology.packaging:branch: squid 2024-08-18T23:52:07.122 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T23:52:07.122 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-18T23:52:07.318 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1386.g78215f5a 2024-08-18T23:52:07.320 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-18T23:52:07.327 INFO:teuthology.task.internal:no buildpackages task found 2024-08-18T23:52:07.327 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-18T23:52:07.337 INFO:teuthology.task.internal:Saving configuration 2024-08-18T23:52:07.353 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-18T23:52:07.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-18T23:52:07.384 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 23:46:33.788959', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJsu3yGvzIfjuCNxtxoetjewyyglc+7DArQ7ysD12rEONIJ3mJU8F3rcZy5Ub3QWjKF5ULvbGAK+yOIq0wxRpI='} 2024-08-18T23:52:07.408 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-18 23:46:33.786980', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDgka3reqIMcMNf81KQRwide0EW4V0X9mNpZpai7UD/2W9YlnmCnvRAWAetuTfqM7LxGvTEFZQKfrzDXjrnbucA='} 2024-08-18T23:52:07.408 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-18T23:52:07.414 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-18T23:52:07.414 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-18T23:52:07.414 INFO:teuthology.run_tasks:Running task console_log... 2024-08-18T23:52:07.512 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1871947be0>, signals=[15]) 2024-08-18T23:52:07.512 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-18T23:52:07.518 INFO:teuthology.task.internal:Opening connections... 2024-08-18T23:52:07.519 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:52:07.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T23:52:07.595 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:52:07.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T23:52:07.671 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-18T23:52:07.678 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-08-18T23:52:07.696 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-08-18T23:52:07.696 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-08-18T23:52:07.754 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T23:52:07.755 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T23:52:07.755 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T23:52:07.755 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-08-18T23:52:07.790 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-08-18T23:52:07.809 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-08-18T23:52:07.809 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-08-18T23:52:07.867 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="CentOS Stream" 2024-08-18T23:52:07.867 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="9" 2024-08-18T23:52:07.867 INFO:teuthology.orchestra.run.smithi190.stdout:ID="centos" 2024-08-18T23:52:07.867 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="rhel fedora" 2024-08-18T23:52:07.867 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="9" 2024-08-18T23:52:07.867 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el9" 2024-08-18T23:52:07.867 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-18T23:52:07.868 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2024-08-18T23:52:07.868 INFO:teuthology.orchestra.run.smithi190.stdout:LOGO="fedora-logo-icon" 2024-08-18T23:52:07.868 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-18T23:52:07.868 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://centos.org/" 2024-08-18T23:52:07.868 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-18T23:52:07.868 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-18T23:52:07.868 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-18T23:52:07.868 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-08-18T23:52:07.890 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-18T23:52:07.899 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-18T23:52:07.905 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-18T23:52:07.905 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-08-18T23:52:07.908 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-08-18T23:52:07.923 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-18T23:52:07.930 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-18T23:52:07.930 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-08-18T23:52:07.965 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-08-18T23:52:08.060 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-18T23:52:08.114 INFO:teuthology.run_tasks:Running task kernel... 2024-08-18T23:52:08.132 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-18T23:52:08.132 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-18T23:52:08.132 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T23:52:08.133 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-18T23:52:08.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:52:08.149 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-08-18T23:52:08.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:52:08.150 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-08-18T23:52:08.206 INFO:teuthology.orchestra.run.smithi190.stdout:5.14.0-480.el9.x86_64 2024-08-18T23:52:08.206 INFO:teuthology.task.kernel:Running kernel on smithi190: 5.14.0-480.el9.x86_64 2024-08-18T23:52:08.206 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum install -y kernel 2024-08-18T23:52:08.209 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-480.el9.x86_64 2024-08-18T23:52:08.209 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-480.el9.x86_64 2024-08-18T23:52:08.209 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-08-18T23:52:11.901 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-08-18T23:52:11.911 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-08-18T23:52:13.637 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-08-18T23:52:14.994 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-08-18T23:52:17.780 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.6 MB 00:00 2024-08-18T23:52:19.222 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 18 kB 00:00 2024-08-18T23:52:20.101 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-18T23:52:20.552 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.6 MB 00:01 2024-08-18T23:52:22.111 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 18 kB 00:00 2024-08-18T23:52:23.015 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-08-18T23:52:25.557 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-18T23:52:27.538 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-18T23:52:27.538 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-18T23:52:27.614 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-08-18T23:52:27.615 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2024-08-18T23:52:27.615 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2024-08-18T23:52:27.735 DEBUG:teuthology.orchestra.run.smithi190:> echo no | sudo yum reinstall kernel || true 2024-08-18T23:52:28.292 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:03 ago on Sun 18 Aug 2024 11:52:25 PM UTC. 2024-08-18T23:52:28.442 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-08-18T23:52:28.446 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout:Reinstalling: 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 1.5 M 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 0 2024-08-18T23:52:28.447 INFO:teuthology.orchestra.run.smithi190.stderr:Operation aborted. 2024-08-18T23:52:28.471 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-18T23:52:28.512 INFO:teuthology.orchestra.run.smithi190.stdout:Is this ok [y/N]: 2024-08-18T23:52:28.513 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum reinstall -y kernel || true 2024-08-18T23:52:29.029 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:04 ago on Sun 18 Aug 2024 11:52:25 PM UTC. 2024-08-18T23:52:29.153 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout: Package Architecture Version Repository Size 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout:Reinstalling: 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout:================================================================================ 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:52:29.154 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 1.5 M 2024-08-18T23:52:29.155 INFO:teuthology.orchestra.run.smithi190.stdout:Installed size: 0 2024-08-18T23:52:29.155 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2024-08-18T23:52:30.250 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-5.14.0-480.el9.x86_64.rpm 1.5 MB/s | 1.5 MB 00:00 2024-08-18T23:52:30.250 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2024-08-18T23:52:30.250 INFO:teuthology.orchestra.run.smithi190.stdout:Total 1.4 MB/s | 1.5 MB 00:01 2024-08-18T23:52:30.283 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2024-08-18T23:52:30.377 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-18T23:52:30.377 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-18T23:52:30.453 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-08-18T23:52:30.453 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-08-18T23:52:30.454 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-08-18T23:52:30.557 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2024-08-18T23:52:30.557 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2024-08-18T23:52:30.564 DEBUG:teuthology.orchestra.run.smithi103:> echo no | sudo yum reinstall kernel || true 2024-08-18T23:52:30.582 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2024-08-18T23:52:30.582 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2024-08-18T23:52:30.734 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2024-08-18T23:52:30.835 INFO:teuthology.orchestra.run.smithi190.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T23:52:30.835 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:52:31.085 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:03 ago on Sun 18 Aug 2024 11:52:28 PM UTC. 2024-08-18T23:52:31.216 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-08-18T23:52:31.228 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-18T23:52:31.228 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-08-18T23:52:31.228 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-18T23:52:31.228 INFO:teuthology.orchestra.run.smithi103.stdout:Reinstalling: 2024-08-18T23:52:31.228 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T23:52:31.229 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:52:31.229 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-08-18T23:52:31.229 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-18T23:52:31.229 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:52:31.229 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 1.5 M 2024-08-18T23:52:31.229 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 0 2024-08-18T23:52:31.229 INFO:teuthology.orchestra.run.smithi103.stderr:Operation aborted. 2024-08-18T23:52:31.281 INFO:teuthology.orchestra.run.smithi103.stdout:Is this ok [y/N]: 2024-08-18T23:52:31.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum reinstall -y kernel || true 2024-08-18T23:52:31.581 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:52:31.581 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T23:52:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:Last metadata expiration check: 0:00:03 ago on Sun 18 Aug 2024 11:52:28 PM UTC. 2024-08-18T23:52:31.923 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout:Reinstalling: 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-18T23:52:31.924 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:52:31.925 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 1.5 M 2024-08-18T23:52:31.925 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 0 2024-08-18T23:52:31.925 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-08-18T23:52:32.320 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:52:32.320 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:52:32.320 INFO:teuthology.orchestra.run.smithi190.stdout:Reinstalled: 2024-08-18T23:52:32.320 INFO:teuthology.orchestra.run.smithi190.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-18T23:52:32.320 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:52:32.320 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2024-08-18T23:52:32.495 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2024-08-18T23:52:32.551 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-18T23:52:32.551 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-18T23:52:32.551 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-18T23:52:32.552 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-08-18T23:52:32.552 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-18T23:52:32.584 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2024-08-18T23:52:32.607 DEBUG:teuthology.parallel:result is None 2024-08-18T23:52:32.965 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-480.el9.x86_64.rpm 1.5 MB/s | 1.5 MB 00:00 2024-08-18T23:52:32.966 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-08-18T23:52:32.966 INFO:teuthology.orchestra.run.smithi103.stdout:Total 1.5 MB/s | 1.5 MB 00:01 2024-08-18T23:52:33.004 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-08-18T23:52:33.258 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-08-18T23:52:33.258 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-08-18T23:52:33.283 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-08-18T23:52:33.283 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-08-18T23:52:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-08-18T23:52:33.525 INFO:teuthology.orchestra.run.smithi103.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T23:52:33.526 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:52:34.250 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:52:34.251 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-18T23:52:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-18T23:52:35.034 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:52:35.034 INFO:teuthology.orchestra.run.smithi103.stdout:Reinstalled: 2024-08-18T23:52:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-18T23:52:35.035 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:52:35.035 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-08-18T23:52:35.212 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-08-18T23:52:35.268 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-18T23:52:35.268 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-18T23:52:35.268 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-18T23:52:35.269 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-08-18T23:52:35.269 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-18T23:52:35.304 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-08-18T23:52:35.327 DEBUG:teuthology.parallel:result is None 2024-08-18T23:52:35.327 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-18T23:52:35.334 INFO:teuthology.task.internal:Creating test directory... 2024-08-18T23:52:35.334 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T23:52:35.370 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-18T23:52:35.388 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-18T23:52:35.395 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-18T23:52:35.403 INFO:teuthology.task.internal:Creating archive directory... 2024-08-18T23:52:35.403 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T23:52:35.426 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-18T23:52:35.530 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-18T23:52:35.537 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-18T23:52:35.537 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T23:52:35.540 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-18T23:52:35.564 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:52:35.574 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:52:35.574 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:52:35.585 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-18T23:52:35.587 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-18T23:52:35.594 INFO:teuthology.task.internal:Configuring sudo... 2024-08-18T23:52:35.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T23:52:35.618 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-18T23:52:35.655 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-18T23:52:35.664 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-18T23:52:35.664 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T23:52:35.683 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-18T23:52:35.711 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:52:35.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:52:35.829 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:52:35.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:52:35.950 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:52:35.951 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T23:52:36.015 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:52:36.058 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-18T23:52:36.108 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:52:36.193 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-18T23:52:36.238 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:52:36.238 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-18T23:52:36.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-08-18T23:52:36.308 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-08-18T23:52:36.399 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:52:36.421 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:52:36.835 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-18T23:52:36.843 INFO:teuthology.task.internal:Starting timer... 2024-08-18T23:52:36.843 INFO:teuthology.run_tasks:Running task pcp... 2024-08-18T23:52:36.853 INFO:teuthology.run_tasks:Running task selinux... 2024-08-18T23:52:36.861 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-08-18T23:52:36.861 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-08-18T23:52:36.913 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-08-18T23:52:36.915 DEBUG:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2024-08-18T23:52:36.990 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: 2024-08-18T23:52:36.992 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-18T23:52:36.992 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-08-18T23:52:37.015 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-08-18T23:52:37.015 DEBUG:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2024-08-18T23:52:37.037 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2024-08-18T23:52:37.037 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': 'permissive'} 2024-08-18T23:52:37.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:52:37.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:52:37.081 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:52:37.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:52:37.205 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-18T23:52:37.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-08-18T23:52:37.240 DEBUG:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2024-08-18T23:52:37.271 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-18T23:52:37.280 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-18T23:52:37.292 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-18T23:52:37.293 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-18T23:54:20.743 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-08-18T23:54:20.744 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-08-18T23:54:20.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T23:54:20.822 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-08-18T23:54:20.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-08-18T23:54:20.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-08-18T23:54:20.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-18T23:54:20.997 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-08-18T23:54:21.075 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-08-18T23:54:21.075 INFO:teuthology.run_tasks:Running task clock... 2024-08-18T23:54:21.086 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-18T23:54:21.087 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T23:54:21.087 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T23:54:21.089 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-18T23:54:21.090 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T23:54:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-18T23:54:21.131 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-18T23:54:21.145 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-18T23:54:21.156 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-08-18T23:54:21.160 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-18T23:54:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-08-18T23:54:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-18T23:54:21.185 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2024-08-18T23:54:21.195 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-18T23:54:21.196 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2024-08-18T23:54:21.209 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-18T23:54:21.223 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-18T23:54:21.250 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-08-18T23:54:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T23:54:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-08-18T23:54:21.253 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:54:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:54:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:54:21.254 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:54:21.280 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: ntpq: command not found 2024-08-18T23:54:21.283 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T23:54:21.284 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2024-08-18T23:54:21.284 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:54:21.284 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:54:21.284 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:54:21.284 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:54:21.285 INFO:teuthology.run_tasks:Running task install... 2024-08-18T23:54:21.293 DEBUG:teuthology.task.install:project ceph 2024-08-18T23:54:21.293 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}} 2024-08-18T23:54:21.293 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-18T23:54:21.293 INFO:teuthology.task.install:Using flavor: default 2024-08-18T23:54:21.302 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-18T23:54:21.302 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-18T23:54:21.303 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-18T23:54:21.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T23:54:21.305 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-18T23:54:21.305 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T23:54:21.444 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-18T23:54:21.444 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-18T23:54:21.453 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/ 2024-08-18T23:54:21.453 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1382.gde09dd01 2024-08-18T23:54:21.673 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-18T23:54:21.673 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:54:21.673 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-18T23:54:21.677 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-18T23:54:21.677 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:54:21.677 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-18T23:54:21.699 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-18T23:54:21.700 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-18T23:54:21.703 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-18T23:54:21.704 DEBUG:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/de09dd018de4baddfa6ca4d43bc8fb784cf75833/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-18T23:54:21.766 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-18T23:54:21.769 DEBUG:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-18T23:54:21.841 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-18T23:54:21.844 DEBUG:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-18T23:54:21.906 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-08-18T23:54:21.908 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-08-18T23:54:21.909 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2024-08-18T23:54:21.911 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum clean all 2024-08-18T23:54:22.131 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-08-18T23:54:22.134 INFO:teuthology.orchestra.run.smithi190.stdout:45 files removed 2024-08-18T23:54:22.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-18T23:54:22.161 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-18T23:54:22.964 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 157 kB/s | 84 kB 00:00 2024-08-18T23:54:22.981 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 152 kB/s | 84 kB 00:00 2024-08-18T23:54:23.473 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-08-18T23:54:23.499 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-08-18T23:54:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-08-18T23:54:24.000 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-08-18T23:54:24.699 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-18T23:54:24.723 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-18T23:54:26.409 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-08-18T23:54:26.525 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-08-18T23:54:31.235 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.6 MB 00:01 2024-08-18T23:54:31.367 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 6.6 MB 00:01 2024-08-18T23:54:32.977 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 18 kB 00:00 2024-08-18T23:54:33.435 INFO:teuthology.orchestra.run.smithi190.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 18 kB 00:00 2024-08-18T23:54:33.899 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-08-18T23:54:34.347 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-08-18T23:54:39.274 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-08-18T23:54:39.803 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-18T23:54:41.457 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T23:54:41.458 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T23:54:41.469 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-18T23:54:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-18T23:54:41.470 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-18T23:54:41.471 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-18T23:54:41.473 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-18T23:54:41.475 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-18T23:54:41.476 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-18T23:54:41.535 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-08-18T23:54:41.543 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-08-18T23:54:41.543 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-18T23:54:41.544 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-18T23:54:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-18T23:54:41.546 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-18T23:54:41.547 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-18T23:54:41.548 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-18T23:54:41.549 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-18T23:54:41.550 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-18T23:54:41.551 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-18T23:54:41.552 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-18T23:54:41.553 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-18T23:54:41.554 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-18T23:54:41.555 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-08-18T23:54:41.556 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-18T23:54:41.556 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:54:41.556 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-08-18T23:54:41.556 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-08-18T23:54:41.556 INFO:teuthology.orchestra.run.smithi103.stdout:Install 148 Packages 2024-08-18T23:54:41.556 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 2 Packages 2024-08-18T23:54:41.556 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:54:41.557 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 218 M 2024-08-18T23:54:41.557 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-08-18T23:54:42.038 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T23:54:42.039 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-18T23:54:42.050 INFO:teuthology.orchestra.run.smithi190.stdout:Package NetworkManager-1:1.48.2-2.el9.x86_64 is already installed. 2024-08-18T23:54:42.051 INFO:teuthology.orchestra.run.smithi190.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-18T23:54:42.051 INFO:teuthology.orchestra.run.smithi190.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-18T23:54:42.052 INFO:teuthology.orchestra.run.smithi190.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-18T23:54:42.054 INFO:teuthology.orchestra.run.smithi190.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-18T23:54:42.056 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-18T23:54:42.057 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsprogs-6.4.0-3.el9.x86_64 is already installed. 2024-08-18T23:54:42.116 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2024-08-18T23:54:42.124 INFO:teuthology.orchestra.run.smithi190.stdout:======================================================================================= 2024-08-18T23:54:42.124 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2024-08-18T23:54:42.124 INFO:teuthology.orchestra.run.smithi190.stdout:======================================================================================= 2024-08-18T23:54:42.124 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2024-08-18T23:54:42.124 INFO:teuthology.orchestra.run.smithi190.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 6.6 k 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 896 k 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 145 k 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 1.5 M 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 146 k 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 3.6 M 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 7.4 M 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 49 k 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 11 M 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 49 M 2024-08-18T23:54:42.125 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 285 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 766 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 225 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-shell x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 27 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 18 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 32 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 753 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 127 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-18T23:54:42.126 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 188 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 369 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 350 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 117 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 85 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.1 M 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 170 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-18T23:54:42.127 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.4 M 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 3.2 M 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 21 M 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 32 k 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 2.4 M 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 249 k 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 4.7 M 2024-08-18T23:54:42.128 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 17 M 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1382.gde09dd01.el9 ceph-noarch 16 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 25 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 163 k 2024-08-18T23:54:42.129 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 507 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 5.4 M 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-18T23:54:42.130 INFO:teuthology.orchestra.run.smithi190.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-18T23:54:42.131 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 45 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_64 2:19.1.0-1382.gde09dd01.el9 ceph 136 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-18T23:54:42.132 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-18T23:54:42.133 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-18T23:54:42.134 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-18T23:54:42.135 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-18T23:54:42.136 INFO:teuthology.orchestra.run.smithi190.stdout:Installing weak dependencies: 2024-08-18T23:54:42.137 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-18T23:54:42.137 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:54:42.137 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2024-08-18T23:54:42.137 INFO:teuthology.orchestra.run.smithi190.stdout:======================================================================================= 2024-08-18T23:54:42.137 INFO:teuthology.orchestra.run.smithi190.stdout:Install 148 Packages 2024-08-18T23:54:42.137 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 2 Packages 2024-08-18T23:54:42.137 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:54:42.137 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 218 M 2024-08-18T23:54:42.138 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2024-08-18T23:54:42.415 INFO:teuthology.orchestra.run.smithi103.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 46 kB/s | 6.6 kB 00:00 2024-08-18T23:54:42.724 INFO:teuthology.orchestra.run.smithi103.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 2.8 MB/s | 896 kB 00:00 2024-08-18T23:54:42.807 INFO:teuthology.orchestra.run.smithi103.stdout:(3/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 10 MB/s | 5.4 MB 00:00 2024-08-18T23:54:42.830 INFO:teuthology.orchestra.run.smithi190.stdout:(1/150): ceph-19.1.0-1382.gde09dd01.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-08-18T23:54:42.832 INFO:teuthology.orchestra.run.smithi103.stdout:(4/150): ceph-immutable-object-cache-19.1.0-138 1.3 MB/s | 145 kB 00:00 2024-08-18T23:54:42.966 INFO:teuthology.orchestra.run.smithi103.stdout:(5/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 15 MB/s | 2.4 MB 00:00 2024-08-18T23:54:43.266 INFO:teuthology.orchestra.run.smithi103.stdout:(6/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 16 MB/s | 4.7 MB 00:00 2024-08-18T23:54:43.300 INFO:teuthology.orchestra.run.smithi103.stdout:(7/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 3.3 MB/s | 1.5 MB 00:00 2024-08-18T23:54:43.304 INFO:teuthology.orchestra.run.smithi190.stdout:(2/150): ceph-fuse-19.1.0-1382.gde09dd01.el9.x8 1.8 MB/s | 896 kB 00:00 2024-08-18T23:54:43.388 INFO:teuthology.orchestra.run.smithi190.stdout:(3/150): ceph-immutable-object-cache-19.1.0-138 1.7 MB/s | 145 kB 00:00 2024-08-18T23:54:43.559 INFO:teuthology.orchestra.run.smithi103.stdout:(8/150): ceph-common-19.1.0-1382.gde09dd01.el9. 16 MB/s | 21 MB 00:01 2024-08-18T23:54:43.601 INFO:teuthology.orchestra.run.smithi103.stdout:(9/150): ceph-selinux-19.1.0-1382.gde09dd01.el9 607 kB/s | 25 kB 00:00 2024-08-18T23:54:43.805 INFO:teuthology.orchestra.run.smithi190.stdout:(4/150): ceph-base-19.1.0-1382.gde09dd01.el9.x8 4.9 MB/s | 5.4 MB 00:01 2024-08-18T23:54:44.038 INFO:teuthology.orchestra.run.smithi190.stdout:(5/150): ceph-mds-19.1.0-1382.gde09dd01.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-08-18T23:54:44.114 INFO:teuthology.orchestra.run.smithi190.stdout:(6/150): ceph-mgr-19.1.0-1382.gde09dd01.el9.x86 4.9 MB/s | 1.5 MB 00:00 2024-08-18T23:54:44.184 INFO:teuthology.orchestra.run.smithi103.stdout:(10/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x8 18 MB/s | 17 MB 00:00 2024-08-18T23:54:44.259 INFO:teuthology.orchestra.run.smithi103.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 2.9 MB/s | 225 kB 00:00 2024-08-18T23:54:44.360 INFO:teuthology.orchestra.run.smithi103.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 270 kB/s | 27 kB 00:00 2024-08-18T23:54:44.452 INFO:teuthology.orchestra.run.smithi103.stdout:(13/150): libcephfs-devel-19.1.0-1382.gde09dd01 362 kB/s | 32 kB 00:00 2024-08-18T23:54:44.552 INFO:teuthology.orchestra.run.smithi103.stdout:(14/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 7.4 MB/s | 753 kB 00:00 2024-08-18T23:54:44.644 INFO:teuthology.orchestra.run.smithi103.stdout:(15/150): libcephsqlite-19.1.0-1382.gde09dd01.e 1.7 MB/s | 163 kB 00:00 2024-08-18T23:54:44.728 INFO:teuthology.orchestra.run.smithi103.stdout:(16/150): librados-devel-19.1.0-1382.gde09dd01. 1.5 MB/s | 127 kB 00:00 2024-08-18T23:54:44.820 INFO:teuthology.orchestra.run.smithi103.stdout:(17/150): libradosstriper1-19.1.0-1382.gde09dd0 5.4 MB/s | 507 kB 00:00 2024-08-18T23:54:44.864 INFO:teuthology.orchestra.run.smithi190.stdout:(7/150): ceph-mon-19.1.0-1382.gde09dd01.el9.x86 5.7 MB/s | 4.7 MB 00:00 2024-08-18T23:54:44.954 INFO:teuthology.orchestra.run.smithi103.stdout:(18/150): ceph-radosgw-19.1.0-1382.gde09dd01.el 6.4 MB/s | 11 MB 00:01 2024-08-18T23:54:45.037 INFO:teuthology.orchestra.run.smithi103.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 542 kB/s | 45 kB 00:00 2024-08-18T23:54:45.121 INFO:teuthology.orchestra.run.smithi103.stdout:(20/150): python3-ceph-common-19.1.0-1382.gde09 1.6 MB/s | 136 kB 00:00 2024-08-18T23:54:45.196 INFO:teuthology.orchestra.run.smithi103.stdout:(21/150): python3-cephfs-19.1.0-1382.gde09dd01. 2.4 MB/s | 188 kB 00:00 2024-08-18T23:54:45.280 INFO:teuthology.orchestra.run.smithi103.stdout:(22/150): python3-rados-19.1.0-1382.gde09dd01.e 4.3 MB/s | 369 kB 00:00 2024-08-18T23:54:45.355 INFO:teuthology.orchestra.run.smithi103.stdout:(23/150): python3-rbd-19.1.0-1382.gde09dd01.el9 4.6 MB/s | 350 kB 00:00 2024-08-18T23:54:45.431 INFO:teuthology.orchestra.run.smithi103.stdout:(24/150): python3-rgw-19.1.0-1382.gde09dd01.el9 1.5 MB/s | 117 kB 00:00 2024-08-18T23:54:45.489 INFO:teuthology.orchestra.run.smithi103.stdout:(25/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.4 MB/s | 85 kB 00:00 2024-08-18T23:54:45.798 INFO:teuthology.orchestra.run.smithi103.stdout:(26/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 10 MB/s | 3.1 MB 00:00 2024-08-18T23:54:45.865 INFO:teuthology.orchestra.run.smithi103.stdout:(27/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 5.1 MB/s | 5.4 MB 00:01 2024-08-18T23:54:45.890 INFO:teuthology.orchestra.run.smithi103.stdout:(28/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 1.8 MB/s | 170 kB 00:00 2024-08-18T23:54:46.231 INFO:teuthology.orchestra.run.smithi190.stdout:(8/150): ceph-osd-19.1.0-1382.gde09dd01.el9.x86 7.9 MB/s | 17 MB 00:02 2024-08-18T23:54:46.339 INFO:teuthology.orchestra.run.smithi190.stdout:(9/150): ceph-radosgw-19.1.0-1382.gde09dd01.el9 7.1 MB/s | 11 MB 00:01 2024-08-18T23:54:46.340 INFO:teuthology.orchestra.run.smithi103.stdout:(29/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 18 MB/s | 49 MB 00:02 2024-08-18T23:54:46.365 INFO:teuthology.orchestra.run.smithi190.stdout:(10/150): ceph-selinux-19.1.0-1382.gde09dd01.el 189 kB/s | 25 kB 00:00 2024-08-18T23:54:46.365 INFO:teuthology.orchestra.run.smithi103.stdout:(30/150): ceph-grafana-dashboards-19.1.0-1382.g 63 kB/s | 32 kB 00:00 2024-08-18T23:54:46.391 INFO:teuthology.orchestra.run.smithi103.stdout:(31/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 292 kB/s | 146 kB 00:00 2024-08-18T23:54:46.415 INFO:teuthology.orchestra.run.smithi190.stdout:(11/150): cephfs-mirror-19.1.0-1382.gde09dd01.e 4.4 MB/s | 225 kB 00:00 2024-08-18T23:54:46.458 INFO:teuthology.orchestra.run.smithi103.stdout:(32/150): ceph-mgr-modules-core-19.1.0-1382.gde 3.7 MB/s | 249 kB 00:00 2024-08-18T23:54:46.474 INFO:teuthology.orchestra.run.smithi190.stdout:(12/150): cephfs-shell-19.1.0-1382.gde09dd01.el 464 kB/s | 27 kB 00:00 2024-08-18T23:54:46.507 INFO:teuthology.orchestra.run.smithi190.stdout:(13/150): libcephfs-devel-19.1.0-1382.gde09dd01 958 kB/s | 32 kB 00:00 2024-08-18T23:54:46.541 INFO:teuthology.orchestra.run.smithi103.stdout:(33/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 18 MB/s | 3.6 MB 00:00 2024-08-18T23:54:46.575 INFO:teuthology.orchestra.run.smithi103.stdout:(34/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 422 kB/s | 49 kB 00:00 2024-08-18T23:54:46.591 INFO:teuthology.orchestra.run.smithi190.stdout:(14/150): libcephfs2-19.1.0-1382.gde09dd01.el9. 8.8 MB/s | 753 kB 00:00 2024-08-18T23:54:46.601 INFO:teuthology.orchestra.run.smithi103.stdout:(35/150): ceph-prometheus-alerts-19.1.0-1382.gd 280 kB/s | 16 kB 00:00 2024-08-18T23:54:46.626 INFO:teuthology.orchestra.run.smithi103.stdout:(36/150): ceph-volume-19.1.0-1382.gde09dd01.el9 5.6 MB/s | 285 kB 00:00 2024-08-18T23:54:46.659 INFO:teuthology.orchestra.run.smithi103.stdout:(37/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 13 MB/s | 766 kB 00:00 2024-08-18T23:54:46.685 INFO:teuthology.orchestra.run.smithi103.stdout:(38/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 311 kB/s | 18 kB 00:00 2024-08-18T23:54:46.785 INFO:teuthology.orchestra.run.smithi103.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 638 kB/s | 80 kB 00:00 2024-08-18T23:54:46.807 INFO:teuthology.orchestra.run.smithi190.stdout:(15/150): ceph-common-19.1.0-1382.gde09dd01.el9 5.2 MB/s | 21 MB 00:04 2024-08-18T23:54:46.833 INFO:teuthology.orchestra.run.smithi190.stdout:(16/150): libcephsqlite-19.1.0-1382.gde09dd01.e 675 kB/s | 163 kB 00:00 2024-08-18T23:54:46.844 INFO:teuthology.orchestra.run.smithi103.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-08-18T23:54:46.858 INFO:teuthology.orchestra.run.smithi190.stdout:(17/150): librados-devel-19.1.0-1382.gde09dd01. 2.5 MB/s | 127 kB 00:00 2024-08-18T23:54:46.877 INFO:teuthology.orchestra.run.smithi103.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-08-18T23:54:46.900 INFO:teuthology.orchestra.run.smithi190.stdout:(18/150): libradosstriper1-19.1.0-1382.gde09dd0 7.4 MB/s | 507 kB 00:00 2024-08-18T23:54:46.902 INFO:teuthology.orchestra.run.smithi103.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-08-18T23:54:46.944 INFO:teuthology.orchestra.run.smithi103.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-08-18T23:54:46.950 INFO:teuthology.orchestra.run.smithi190.stdout:(19/150): python3-ceph-argparse-19.1.0-1382.gde 908 kB/s | 45 kB 00:00 2024-08-18T23:54:46.969 INFO:teuthology.orchestra.run.smithi103.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-18T23:54:46.995 INFO:teuthology.orchestra.run.smithi103.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-18T23:54:47.000 INFO:teuthology.orchestra.run.smithi190.stdout:(20/150): python3-ceph-common-19.1.0-1382.gde09 2.7 MB/s | 136 kB 00:00 2024-08-18T23:54:47.012 INFO:teuthology.orchestra.run.smithi103.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-08-18T23:54:47.029 INFO:teuthology.orchestra.run.smithi103.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 6.2 MB/s | 215 kB 00:00 2024-08-18T23:54:47.051 INFO:teuthology.orchestra.run.smithi190.stdout:(21/150): python3-cephfs-19.1.0-1382.gde09dd01. 3.7 MB/s | 188 kB 00:00 2024-08-18T23:54:47.110 INFO:teuthology.orchestra.run.smithi190.stdout:(22/150): python3-rados-19.1.0-1382.gde09dd01.e 6.2 MB/s | 369 kB 00:00 2024-08-18T23:54:47.168 INFO:teuthology.orchestra.run.smithi190.stdout:(23/150): python3-rbd-19.1.0-1382.gde09dd01.el9 5.9 MB/s | 350 kB 00:00 2024-08-18T23:54:47.220 INFO:teuthology.orchestra.run.smithi190.stdout:(24/150): python3-rgw-19.1.0-1382.gde09dd01.el9 2.2 MB/s | 117 kB 00:00 2024-08-18T23:54:47.271 INFO:teuthology.orchestra.run.smithi190.stdout:(25/150): rbd-fuse-19.1.0-1382.gde09dd01.el9.x8 1.7 MB/s | 85 kB 00:00 2024-08-18T23:54:47.321 INFO:teuthology.orchestra.run.smithi103.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-08-18T23:54:47.371 INFO:teuthology.orchestra.run.smithi103.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-08-18T23:54:47.388 INFO:teuthology.orchestra.run.smithi190.stdout:(26/150): librgw2-19.1.0-1382.gde09dd01.el9.x86 10 MB/s | 5.4 MB 00:00 2024-08-18T23:54:47.421 INFO:teuthology.orchestra.run.smithi103.stdout:(50/150): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-08-18T23:54:47.438 INFO:teuthology.orchestra.run.smithi190.stdout:(27/150): rbd-nbd-19.1.0-1382.gde09dd01.el9.x86 3.4 MB/s | 170 kB 00:00 2024-08-18T23:54:47.447 INFO:teuthology.orchestra.run.smithi103.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-08-18T23:54:47.488 INFO:teuthology.orchestra.run.smithi190.stdout:(28/150): ceph-grafana-dashboards-19.1.0-1382.g 638 kB/s | 32 kB 00:00 2024-08-18T23:54:47.497 INFO:teuthology.orchestra.run.smithi103.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-08-18T23:54:47.547 INFO:teuthology.orchestra.run.smithi190.stdout:(29/150): rbd-mirror-19.1.0-1382.gde09dd01.el9. 11 MB/s | 3.1 MB 00:00 2024-08-18T23:54:47.572 INFO:teuthology.orchestra.run.smithi190.stdout:(30/150): ceph-mgr-cephadm-19.1.0-1382.gde09dd0 1.7 MB/s | 146 kB 00:00 2024-08-18T23:54:47.597 INFO:teuthology.orchestra.run.smithi103.stdout:(53/150): ceph-mgr-diskprediction-local-19.1.0- 6.0 MB/s | 7.4 MB 00:01 2024-08-18T23:54:47.623 INFO:teuthology.orchestra.run.smithi103.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-08-18T23:54:47.673 INFO:teuthology.orchestra.run.smithi103.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-08-18T23:54:47.698 INFO:teuthology.orchestra.run.smithi103.stdout:(56/150): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-08-18T23:54:47.757 INFO:teuthology.orchestra.run.smithi103.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-08-18T23:54:47.782 INFO:teuthology.orchestra.run.smithi103.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-08-18T23:54:47.789 INFO:teuthology.orchestra.run.smithi190.stdout:(31/150): ceph-mgr-dashboard-19.1.0-1382.gde09d 15 MB/s | 3.6 MB 00:00 2024-08-18T23:54:47.831 INFO:teuthology.orchestra.run.smithi190.stdout:(32/150): ceph-mgr-modules-core-19.1.0-1382.gde 5.9 MB/s | 249 kB 00:00 2024-08-18T23:54:47.881 INFO:teuthology.orchestra.run.smithi190.stdout:(33/150): ceph-mgr-rook-19.1.0-1382.gde09dd01.e 991 kB/s | 49 kB 00:00 2024-08-18T23:54:47.931 INFO:teuthology.orchestra.run.smithi190.stdout:(34/150): ceph-prometheus-alerts-19.1.0-1382.gd 330 kB/s | 16 kB 00:00 2024-08-18T23:54:47.949 INFO:teuthology.orchestra.run.smithi103.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-08-18T23:54:47.974 INFO:teuthology.orchestra.run.smithi103.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 3.0 MB/s | 581 kB 00:00 2024-08-18T23:54:47.990 INFO:teuthology.orchestra.run.smithi190.stdout:(35/150): ceph-volume-19.1.0-1382.gde09dd01.el9 4.8 MB/s | 285 kB 00:00 2024-08-18T23:54:48.000 INFO:teuthology.orchestra.run.smithi103.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 506 kB/s | 25 kB 00:00 2024-08-18T23:54:48.025 INFO:teuthology.orchestra.run.smithi103.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-08-18T23:54:48.065 INFO:teuthology.orchestra.run.smithi190.stdout:(36/150): cephadm-19.1.0-1382.gde09dd01.el9.noa 10 MB/s | 766 kB 00:00 2024-08-18T23:54:48.100 INFO:teuthology.orchestra.run.smithi103.stdout:(63/150): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-08-18T23:54:48.107 INFO:teuthology.orchestra.run.smithi190.stdout:(37/150): cephfs-top-19.1.0-1382.gde09dd01.el9. 439 kB/s | 18 kB 00:00 2024-08-18T23:54:48.125 INFO:teuthology.orchestra.run.smithi103.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-08-18T23:54:48.151 INFO:teuthology.orchestra.run.smithi103.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-08-18T23:54:48.233 INFO:teuthology.orchestra.run.smithi190.stdout:(38/150): ceph-mgr-diskprediction-local-19.1.0- 11 MB/s | 7.4 MB 00:00 2024-08-18T23:54:48.274 INFO:teuthology.orchestra.run.smithi190.stdout:(39/150): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-08-18T23:54:48.366 INFO:teuthology.orchestra.run.smithi190.stdout:(40/150): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-08-18T23:54:48.367 INFO:teuthology.orchestra.run.smithi103.stdout:(66/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-08-18T23:54:48.392 INFO:teuthology.orchestra.run.smithi190.stdout:(41/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-08-18T23:54:48.434 INFO:teuthology.orchestra.run.smithi190.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-08-18T23:54:48.501 INFO:teuthology.orchestra.run.smithi190.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-18T23:54:48.534 INFO:teuthology.orchestra.run.smithi190.stdout:(44/150): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-08-18T23:54:48.576 INFO:teuthology.orchestra.run.smithi190.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-08-18T23:54:48.618 INFO:teuthology.orchestra.run.smithi190.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-08-18T23:54:48.669 INFO:teuthology.orchestra.run.smithi190.stdout:(47/150): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-08-18T23:54:48.726 INFO:teuthology.orchestra.run.smithi103.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2024-08-18T23:54:48.785 INFO:teuthology.orchestra.run.smithi190.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-08-18T23:54:48.827 INFO:teuthology.orchestra.run.smithi190.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-08-18T23:54:48.861 INFO:teuthology.orchestra.run.smithi190.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-08-18T23:54:48.886 INFO:teuthology.orchestra.run.smithi190.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-08-18T23:54:48.912 INFO:teuthology.orchestra.run.smithi190.stdout:(52/150): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-08-18T23:54:48.927 INFO:teuthology.orchestra.run.smithi103.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 4.5 MB/s | 911 kB 00:00 2024-08-18T23:54:48.937 INFO:teuthology.orchestra.run.smithi190.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-08-18T23:54:48.985 INFO:teuthology.orchestra.run.smithi103.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-08-18T23:54:48.987 INFO:teuthology.orchestra.run.smithi190.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-08-18T23:54:49.038 INFO:teuthology.orchestra.run.smithi190.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-08-18T23:54:49.063 INFO:teuthology.orchestra.run.smithi190.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-08-18T23:54:49.088 INFO:teuthology.orchestra.run.smithi190.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-18T23:54:49.102 INFO:teuthology.orchestra.run.smithi103.stdout:(70/150): openblas-openmp-0.3.21-2.el9.x86_64.r 4.9 MB/s | 4.7 MB 00:00 2024-08-18T23:54:49.113 INFO:teuthology.orchestra.run.smithi190.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-08-18T23:54:49.147 INFO:teuthology.orchestra.run.smithi190.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-08-18T23:54:49.189 INFO:teuthology.orchestra.run.smithi190.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-08-18T23:54:49.214 INFO:teuthology.orchestra.run.smithi190.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-08-18T23:54:49.240 INFO:teuthology.orchestra.run.smithi190.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-08-18T23:54:49.265 INFO:teuthology.orchestra.run.smithi190.stdout:(63/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-18T23:54:49.286 INFO:teuthology.orchestra.run.smithi103.stdout:(71/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-08-18T23:54:49.290 INFO:teuthology.orchestra.run.smithi190.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-08-18T23:54:49.315 INFO:teuthology.orchestra.run.smithi190.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 705 kB/s | 35 kB 00:00 2024-08-18T23:54:49.328 INFO:teuthology.orchestra.run.smithi103.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-08-18T23:54:49.369 INFO:teuthology.orchestra.run.smithi103.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2024-08-18T23:54:49.407 INFO:teuthology.orchestra.run.smithi190.stdout:(66/150): openblas-openmp-0.3.21-2.el9.x86_64.r 41 MB/s | 4.7 MB 00:00 2024-08-18T23:54:49.428 INFO:teuthology.orchestra.run.smithi103.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-08-18T23:54:49.604 INFO:teuthology.orchestra.run.smithi103.stdout:(75/150): python3-devel-3.9.19-4.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2024-08-18T23:54:49.687 INFO:teuthology.orchestra.run.smithi103.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-08-18T23:54:49.737 INFO:teuthology.orchestra.run.smithi103.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-08-18T23:54:49.788 INFO:teuthology.orchestra.run.smithi103.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-08-18T23:54:49.816 INFO:teuthology.orchestra.run.smithi190.stdout:(67/150): ceph-test-19.1.0-1382.gde09dd01.el9.x 14 MB/s | 49 MB 00:03 2024-08-18T23:54:49.866 INFO:teuthology.orchestra.run.smithi190.stdout:(68/150): postgresql-13.14-1.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-08-18T23:54:49.871 INFO:teuthology.orchestra.run.smithi103.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-08-18T23:54:49.922 INFO:teuthology.orchestra.run.smithi103.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-08-18T23:54:49.933 INFO:teuthology.orchestra.run.smithi190.stdout:(69/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2024-08-18T23:54:49.959 INFO:teuthology.orchestra.run.smithi190.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-08-18T23:54:50.017 INFO:teuthology.orchestra.run.smithi190.stdout:(71/150): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-08-18T23:54:50.101 INFO:teuthology.orchestra.run.smithi190.stdout:(72/150): postgresql-server-13.14-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-08-18T23:54:50.126 INFO:teuthology.orchestra.run.smithi190.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 808 kB/s | 87 kB 00:00 2024-08-18T23:54:50.159 INFO:teuthology.orchestra.run.smithi190.stdout:(74/150): postgresql-contrib-13.14-1.el9.x86_64 2.6 MB/s | 911 kB 00:00 2024-08-18T23:54:50.176 INFO:teuthology.orchestra.run.smithi190.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-08-18T23:54:50.210 INFO:teuthology.orchestra.run.smithi190.stdout:(76/150): python3-devel-3.9.19-4.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-08-18T23:54:50.235 INFO:teuthology.orchestra.run.smithi190.stdout:(77/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-18T23:54:50.252 INFO:teuthology.orchestra.run.smithi190.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 614 kB/s | 26 kB 00:00 2024-08-18T23:54:50.269 INFO:teuthology.orchestra.run.smithi190.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 574 kB/s | 19 kB 00:00 2024-08-18T23:54:50.272 INFO:teuthology.orchestra.run.smithi103.stdout:(81/150): postgresql-server-13.14-1.el9.x86_64. 4.5 MB/s | 5.8 MB 00:01 2024-08-18T23:54:50.319 INFO:teuthology.orchestra.run.smithi190.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-08-18T23:54:50.344 INFO:teuthology.orchestra.run.smithi190.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 463 kB/s | 35 kB 00:00 2024-08-18T23:54:50.355 INFO:teuthology.orchestra.run.smithi103.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-08-18T23:54:50.387 INFO:teuthology.orchestra.run.smithi190.stdout:(82/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-08-18T23:54:50.456 INFO:teuthology.orchestra.run.smithi103.stdout:(83/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-08-18T23:54:50.462 INFO:teuthology.orchestra.run.smithi190.stdout:(83/150): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-08-18T23:54:50.487 INFO:teuthology.orchestra.run.smithi190.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-08-18T23:54:50.504 INFO:teuthology.orchestra.run.smithi190.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-08-18T23:54:50.506 INFO:teuthology.orchestra.run.smithi103.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-08-18T23:54:50.530 INFO:teuthology.orchestra.run.smithi190.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-18T23:54:50.555 INFO:teuthology.orchestra.run.smithi190.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-08-18T23:54:50.580 INFO:teuthology.orchestra.run.smithi190.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-18T23:54:50.606 INFO:teuthology.orchestra.run.smithi190.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-18T23:54:50.612 INFO:teuthology.orchestra.run.smithi103.stdout:(85/150): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-08-18T23:54:50.630 INFO:teuthology.orchestra.run.smithi190.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-18T23:54:50.640 INFO:teuthology.orchestra.run.smithi103.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 316 kB/s | 42 kB 00:00 2024-08-18T23:54:50.656 INFO:teuthology.orchestra.run.smithi190.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-18T23:54:50.699 INFO:teuthology.orchestra.run.smithi103.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-08-18T23:54:50.724 INFO:teuthology.orchestra.run.smithi103.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-08-18T23:54:50.731 INFO:teuthology.orchestra.run.smithi190.stdout:(92/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-18T23:54:50.756 INFO:teuthology.orchestra.run.smithi190.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-08-18T23:54:50.774 INFO:teuthology.orchestra.run.smithi103.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-18T23:54:50.782 INFO:teuthology.orchestra.run.smithi190.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-08-18T23:54:50.800 INFO:teuthology.orchestra.run.smithi103.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-08-18T23:54:50.807 INFO:teuthology.orchestra.run.smithi190.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-18T23:54:50.825 INFO:teuthology.orchestra.run.smithi103.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-18T23:54:50.832 INFO:teuthology.orchestra.run.smithi190.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-08-18T23:54:50.857 INFO:teuthology.orchestra.run.smithi190.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-08-18T23:54:50.875 INFO:teuthology.orchestra.run.smithi103.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-08-18T23:54:50.882 INFO:teuthology.orchestra.run.smithi190.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-18T23:54:50.908 INFO:teuthology.orchestra.run.smithi190.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-18T23:54:50.925 INFO:teuthology.orchestra.run.smithi103.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 886 kB/s | 44 kB 00:00 2024-08-18T23:54:50.933 INFO:teuthology.orchestra.run.smithi190.stdout:(100/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-18T23:54:50.958 INFO:teuthology.orchestra.run.smithi190.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-18T23:54:50.984 INFO:teuthology.orchestra.run.smithi190.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-08-18T23:54:50.992 INFO:teuthology.orchestra.run.smithi103.stdout:(94/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.8 MB/s | 5.1 MB 00:01 2024-08-18T23:54:51.043 INFO:teuthology.orchestra.run.smithi103.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-08-18T23:54:51.068 INFO:teuthology.orchestra.run.smithi103.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 478 kB/s | 36 kB 00:00 2024-08-18T23:54:51.093 INFO:teuthology.orchestra.run.smithi103.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-08-18T23:54:51.144 INFO:teuthology.orchestra.run.smithi103.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-18T23:54:51.169 INFO:teuthology.orchestra.run.smithi103.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-08-18T23:54:51.194 INFO:teuthology.orchestra.run.smithi103.stdout:(100/150): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-18T23:54:51.218 INFO:teuthology.orchestra.run.smithi190.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-08-18T23:54:51.219 INFO:teuthology.orchestra.run.smithi103.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-18T23:54:51.243 INFO:teuthology.orchestra.run.smithi190.stdout:(104/150): lua-devel-5.4.4-4.el9.x86_64.rpm 78 kB/s | 22 kB 00:00 2024-08-18T23:54:51.245 INFO:teuthology.orchestra.run.smithi103.stdout:(102/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-08-18T23:54:51.293 INFO:teuthology.orchestra.run.smithi190.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-08-18T23:54:51.318 INFO:teuthology.orchestra.run.smithi190.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-08-18T23:54:51.337 INFO:teuthology.orchestra.run.smithi103.stdout:(103/150): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-08-18T23:54:51.352 INFO:teuthology.orchestra.run.smithi190.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-08-18T23:54:51.392 INFO:teuthology.orchestra.run.smithi190.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 648 kB/s | 26 kB 00:00 2024-08-18T23:54:51.395 INFO:teuthology.orchestra.run.smithi103.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-18T23:54:51.427 INFO:teuthology.orchestra.run.smithi190.stdout:(109/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-08-18T23:54:51.429 INFO:teuthology.orchestra.run.smithi103.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-08-18T23:54:51.444 INFO:teuthology.orchestra.run.smithi190.stdout:(110/150): liboath-2.6.7-2.el9.x86_64.rpm 943 kB/s | 49 kB 00:00 2024-08-18T23:54:51.454 INFO:teuthology.orchestra.run.smithi103.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-08-18T23:54:51.478 INFO:teuthology.orchestra.run.smithi190.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 5.8 MB/s | 151 kB 00:00 2024-08-18T23:54:51.488 INFO:teuthology.orchestra.run.smithi103.stdout:(107/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-08-18T23:54:51.511 INFO:teuthology.orchestra.run.smithi190.stdout:(112/150): libunwind-1.6.2-1.el9.x86_64.rpm 803 kB/s | 67 kB 00:00 2024-08-18T23:54:51.530 INFO:teuthology.orchestra.run.smithi103.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-08-18T23:54:51.554 INFO:teuthology.orchestra.run.smithi190.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-08-18T23:54:51.555 INFO:teuthology.orchestra.run.smithi103.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-18T23:54:51.578 INFO:teuthology.orchestra.run.smithi190.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-18T23:54:51.581 INFO:teuthology.orchestra.run.smithi103.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-18T23:54:51.612 INFO:teuthology.orchestra.run.smithi190.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 961 kB/s | 32 kB 00:00 2024-08-18T23:54:51.614 INFO:teuthology.orchestra.run.smithi103.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-08-18T23:54:51.646 INFO:teuthology.orchestra.run.smithi190.stdout:(116/150): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-08-18T23:54:51.671 INFO:teuthology.orchestra.run.smithi190.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-08-18T23:54:51.690 INFO:teuthology.orchestra.run.smithi103.stdout:(112/150): libarrow-9.0.0-11.el9.x86_64.rpm 19 MB/s | 4.4 MB 00:00 2024-08-18T23:54:51.696 INFO:teuthology.orchestra.run.smithi190.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-18T23:54:51.748 INFO:teuthology.orchestra.run.smithi103.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-08-18T23:54:51.801 INFO:teuthology.orchestra.run.smithi103.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-08-18T23:54:51.801 INFO:teuthology.orchestra.run.smithi190.stdout:(119/150): libarrow-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 4.4 MB 00:00 2024-08-18T23:54:51.801 INFO:teuthology.orchestra.run.smithi190.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-08-18T23:54:51.807 INFO:teuthology.orchestra.run.smithi103.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-08-18T23:54:51.814 INFO:teuthology.orchestra.run.smithi190.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-08-18T23:54:51.832 INFO:teuthology.orchestra.run.smithi103.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-08-18T23:54:51.839 INFO:teuthology.orchestra.run.smithi190.stdout:(122/150): python3-google-auth-2.33.0-1.el9.noa 2.8 MB/s | 220 kB 00:00 2024-08-18T23:54:51.858 INFO:teuthology.orchestra.run.smithi103.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-08-18T23:54:51.864 INFO:teuthology.orchestra.run.smithi190.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-08-18T23:54:51.883 INFO:teuthology.orchestra.run.smithi103.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-18T23:54:51.890 INFO:teuthology.orchestra.run.smithi190.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-08-18T23:54:51.908 INFO:teuthology.orchestra.run.smithi103.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-18T23:54:51.915 INFO:teuthology.orchestra.run.smithi190.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-08-18T23:54:51.940 INFO:teuthology.orchestra.run.smithi190.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-08-18T23:54:51.942 INFO:teuthology.orchestra.run.smithi103.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-18T23:54:51.966 INFO:teuthology.orchestra.run.smithi190.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-08-18T23:54:51.967 INFO:teuthology.orchestra.run.smithi103.stdout:(121/150): python3-google-auth-2.33.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-08-18T23:54:51.991 INFO:teuthology.orchestra.run.smithi190.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-18T23:54:52.001 INFO:teuthology.orchestra.run.smithi103.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-08-18T23:54:52.016 INFO:teuthology.orchestra.run.smithi190.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-18T23:54:52.026 INFO:teuthology.orchestra.run.smithi103.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-08-18T23:54:52.041 INFO:teuthology.orchestra.run.smithi190.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-18T23:54:52.051 INFO:teuthology.orchestra.run.smithi103.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-08-18T23:54:52.067 INFO:teuthology.orchestra.run.smithi190.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-18T23:54:52.077 INFO:teuthology.orchestra.run.smithi103.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-08-18T23:54:52.100 INFO:teuthology.orchestra.run.smithi190.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-18T23:54:52.102 INFO:teuthology.orchestra.run.smithi103.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-08-18T23:54:52.125 INFO:teuthology.orchestra.run.smithi190.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-08-18T23:54:52.127 INFO:teuthology.orchestra.run.smithi103.stdout:(127/150): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-08-18T23:54:52.159 INFO:teuthology.orchestra.run.smithi190.stdout:(134/150): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-08-18T23:54:52.178 INFO:teuthology.orchestra.run.smithi103.stdout:(128/150): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-08-18T23:54:52.184 INFO:teuthology.orchestra.run.smithi190.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-08-18T23:54:52.203 INFO:teuthology.orchestra.run.smithi103.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-18T23:54:52.210 INFO:teuthology.orchestra.run.smithi190.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-08-18T23:54:52.228 INFO:teuthology.orchestra.run.smithi103.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-18T23:54:52.235 INFO:teuthology.orchestra.run.smithi190.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-08-18T23:54:52.260 INFO:teuthology.orchestra.run.smithi190.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-18T23:54:52.262 INFO:teuthology.orchestra.run.smithi103.stdout:(131/150): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-08-18T23:54:52.285 INFO:teuthology.orchestra.run.smithi190.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-18T23:54:52.288 INFO:teuthology.orchestra.run.smithi103.stdout:(132/150): python3-natsort-7.1.1-5.el9.noarch.r 984 kB/s | 58 kB 00:00 2024-08-18T23:54:52.304 INFO:teuthology.orchestra.run.smithi103.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 998 kB/s | 16 kB 00:00 2024-08-18T23:54:52.311 INFO:teuthology.orchestra.run.smithi190.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-08-18T23:54:52.330 INFO:teuthology.orchestra.run.smithi103.stdout:(134/150): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-08-18T23:54:52.336 INFO:teuthology.orchestra.run.smithi190.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-18T23:54:52.355 INFO:teuthology.orchestra.run.smithi103.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-08-18T23:54:52.372 INFO:teuthology.orchestra.run.smithi103.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 676 kB/s | 28 kB 00:00 2024-08-18T23:54:52.378 INFO:teuthology.orchestra.run.smithi190.stdout:(142/150): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-08-18T23:54:52.389 INFO:teuthology.orchestra.run.smithi103.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 914 kB/s | 31 kB 00:00 2024-08-18T23:54:52.395 INFO:teuthology.orchestra.run.smithi190.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-08-18T23:54:52.414 INFO:teuthology.orchestra.run.smithi103.stdout:(138/150): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-08-18T23:54:52.420 INFO:teuthology.orchestra.run.smithi190.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-08-18T23:54:52.439 INFO:teuthology.orchestra.run.smithi103.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-18T23:54:52.446 INFO:teuthology.orchestra.run.smithi190.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 395 kB/s | 20 kB 00:00 2024-08-18T23:54:52.465 INFO:teuthology.orchestra.run.smithi103.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-08-18T23:54:52.471 INFO:teuthology.orchestra.run.smithi190.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-18T23:54:52.490 INFO:teuthology.orchestra.run.smithi103.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-18T23:54:52.505 INFO:teuthology.orchestra.run.smithi190.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-18T23:54:52.515 INFO:teuthology.orchestra.run.smithi103.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-18T23:54:52.541 INFO:teuthology.orchestra.run.smithi103.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-18T23:54:52.555 INFO:teuthology.orchestra.run.smithi190.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-08-18T23:54:52.566 INFO:teuthology.orchestra.run.smithi103.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 798 kB/s | 20 kB 00:00 2024-08-18T23:54:52.592 INFO:teuthology.orchestra.run.smithi103.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-08-18T23:54:52.617 INFO:teuthology.orchestra.run.smithi103.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-18T23:54:52.676 INFO:teuthology.orchestra.run.smithi103.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-18T23:54:52.772 INFO:teuthology.orchestra.run.smithi190.stdout:(149/150): librados2-19.1.0-1382.gde09dd01.el9. 11 MB/s | 3.4 MB 00:00 2024-08-18T23:54:52.863 INFO:teuthology.orchestra.run.smithi190.stdout:(150/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 8.8 MB/s | 3.2 MB 00:00 2024-08-18T23:54:52.870 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2024-08-18T23:54:52.870 INFO:teuthology.orchestra.run.smithi190.stdout:Total 20 MB/s | 218 MB 00:10 2024-08-18T23:54:52.926 INFO:teuthology.orchestra.run.smithi103.stdout:(148/150): librados2-19.1.0-1382.gde09dd01.el9. 11 MB/s | 3.4 MB 00:00 2024-08-18T23:54:53.035 INFO:teuthology.orchestra.run.smithi103.stdout:(149/150): librbd1-19.1.0-1382.gde09dd01.el9.x8 8.8 MB/s | 3.2 MB 00:00 2024-08-18T23:54:53.401 INFO:teuthology.orchestra.run.smithi103.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.2 MB/s | 16 MB 00:02 2024-08-18T23:54:53.406 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-08-18T23:54:53.406 INFO:teuthology.orchestra.run.smithi103.stdout:Total 18 MB/s | 218 MB 00:11 2024-08-18T23:54:53.980 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2024-08-18T23:54:54.115 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2024-08-18T23:54:54.115 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2024-08-18T23:54:54.515 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-08-18T23:54:54.646 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-08-18T23:54:54.646 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-08-18T23:54:56.176 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2024-08-18T23:54:56.176 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2024-08-18T23:54:56.790 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-08-18T23:54:56.791 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-08-18T23:55:02.040 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2024-08-18T23:55:02.145 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-18T23:55:02.325 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-18T23:55:02.451 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-18T23:55:02.800 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-18T23:55:02.874 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-08-18T23:55:02.933 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T23:55:02.945 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-18T23:55:02.971 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-18T23:55:03.040 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T23:55:03.044 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-18T23:55:03.076 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T23:55:03.155 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T23:55:03.202 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T23:55:03.232 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-18T23:55:03.257 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-18T23:55:03.433 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-18T23:55:03.472 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-18T23:55:03.489 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T23:55:03.537 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-18T23:55:03.565 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T23:55:03.610 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 5/152 2024-08-18T23:55:03.648 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T23:55:03.669 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T23:55:03.699 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T23:55:03.744 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T23:55:03.768 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T23:55:03.782 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T23:55:03.792 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T23:55:03.811 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T23:55:03.819 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-18T23:55:03.845 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-18T23:55:04.066 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-08-18T23:55:04.122 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T23:55:04.126 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-08-18T23:55:04.145 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T23:55:04.168 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T23:55:04.249 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T23:55:04.271 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T23:55:04.278 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-18T23:55:04.344 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 13/152 2024-08-18T23:55:04.372 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T23:55:04.375 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-18T23:55:04.395 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-18T23:55:04.416 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-18T23:55:04.452 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-18T23:55:04.527 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-18T23:55:04.578 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-18T23:55:04.618 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-18T23:55:04.661 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-18T23:55:04.694 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-18T23:55:04.705 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T23:55:04.721 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-18T23:55:04.756 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-18T23:55:04.783 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-18T23:55:04.836 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-18T23:55:04.866 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-18T23:55:04.869 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-18T23:55:04.909 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-18T23:55:04.971 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-18T23:55:04.988 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-18T23:55:05.005 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-08-18T23:55:05.020 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-18T23:55:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-08-18T23:55:05.066 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-18T23:55:05.092 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-18T23:55:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-08-18T23:55:05.165 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-18T23:55:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-08-18T23:55:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 22/152 2024-08-18T23:55:05.207 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-18T23:55:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/152 2024-08-18T23:55:05.283 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-18T23:55:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/152 2024-08-18T23:55:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/152 2024-08-18T23:55:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/152 2024-08-18T23:55:05.426 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-18T23:55:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 27/152 2024-08-18T23:55:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/152 2024-08-18T23:55:05.485 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-18T23:55:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/152 2024-08-18T23:55:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/152 2024-08-18T23:55:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 31/152 2024-08-18T23:55:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 32/152 2024-08-18T23:55:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 33/152 2024-08-18T23:55:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/152 2024-08-18T23:55:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 35/152 2024-08-18T23:55:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/152 2024-08-18T23:55:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/152 2024-08-18T23:55:06.019 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-18T23:55:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/152 2024-08-18T23:55:06.106 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-18T23:55:06.142 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-18T23:55:06.186 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-18T23:55:06.223 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-18T23:55:06.255 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-18T23:55:06.312 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-18T23:55:06.384 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-18T23:55:06.440 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-18T23:55:06.476 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-18T23:55:06.524 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-18T23:55:06.559 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-18T23:55:06.602 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-18T23:55:06.607 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/152 2024-08-18T23:55:06.645 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-18T23:55:06.697 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/152 2024-08-18T23:55:06.724 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 41/152 2024-08-18T23:55:06.768 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/152 2024-08-18T23:55:06.785 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-18T23:55:06.797 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 43/152 2024-08-18T23:55:06.829 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-18T23:55:06.830 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/152 2024-08-18T23:55:06.871 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-18T23:55:06.886 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 45/152 2024-08-18T23:55:06.960 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-18T23:55:06.975 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-18T23:55:06.998 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-18T23:55:07.012 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-18T23:55:07.034 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-18T23:55:07.053 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-18T23:55:07.081 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-18T23:55:07.086 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-18T23:55:07.110 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-18T23:55:07.117 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-18T23:55:07.160 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-18T23:55:07.201 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-18T23:55:07.202 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-18T23:55:07.332 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-18T23:55:07.349 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-18T23:55:07.368 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-18T23:55:07.404 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-18T23:55:07.405 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-18T23:55:07.440 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-18T23:55:07.446 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-18T23:55:07.484 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-18T23:55:07.520 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-18T23:55:07.550 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-18T23:55:07.560 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-18T23:55:07.589 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-18T23:55:07.596 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-18T23:55:07.624 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-18T23:55:07.637 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-18T23:55:07.657 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-18T23:55:07.670 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-18T23:55:07.695 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-18T23:55:07.699 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-18T23:55:07.733 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-18T23:55:07.781 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-18T23:55:07.907 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-18T23:55:07.907 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-18T23:55:07.965 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-18T23:55:07.995 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-18T23:55:08.065 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-18T23:55:08.100 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-18T23:55:08.154 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-18T23:55:08.237 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-18T23:55:08.329 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-18T23:55:08.386 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-18T23:55:08.422 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-18T23:55:08.571 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-18T23:55:08.718 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-18T23:55:08.753 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-18T23:55:08.786 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-18T23:55:08.829 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-18T23:55:08.870 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-18T23:55:08.896 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-18T23:55:08.944 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-18T23:55:08.964 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-18T23:55:08.978 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-18T23:55:09.018 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-18T23:55:09.047 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-18T23:55:09.079 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-18T23:55:09.125 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-18T23:55:09.154 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-18T23:55:09.178 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-18T23:55:09.207 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-18T23:55:09.266 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-18T23:55:09.323 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-18T23:55:09.498 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-18T23:55:09.528 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-18T23:55:09.606 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-18T23:55:09.946 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-18T23:55:10.005 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-18T23:55:10.039 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-18T23:55:10.148 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-18T23:55:10.194 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 83/152 2024-08-18T23:55:10.239 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-18T23:55:10.291 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-18T23:55:10.328 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-18T23:55:10.384 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-18T23:55:10.403 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-18T23:55:10.563 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-08-18T23:55:10.590 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-08-18T23:55:10.669 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-18T23:55:11.355 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-18T23:55:11.473 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-18T23:55:11.702 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-18T23:55:11.781 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T23:55:11.802 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-18T23:55:11.826 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-18T23:55:12.137 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-18T23:55:12.180 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T23:55:12.275 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T23:55:12.302 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-18T23:55:12.338 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-18T23:55:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-18T23:55:12.812 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-18T23:55:12.828 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T23:55:12.842 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T23:55:12.869 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-18T23:55:12.898 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-18T23:55:13.006 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T23:55:13.035 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-18T23:55:13.207 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-18T23:55:13.246 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T23:55:13.339 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 97/152 2024-08-18T23:55:13.365 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 98/152 2024-08-18T23:55:13.402 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-18T23:55:13.874 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-18T23:55:13.905 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T23:55:13.978 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 101/152 2024-08-18T23:55:14.007 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 102/152 2024-08-18T23:55:15.298 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T23:55:15.331 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T23:55:15.896 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T23:55:15.934 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T23:55:16.018 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T23:55:16.018 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-18T23:55:16.019 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-18T23:55:16.019 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:16.069 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T23:55:16.475 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T23:55:16.513 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T23:55:17.062 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 103/152 2024-08-18T23:55:17.099 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T23:55:17.191 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 104/152 2024-08-18T23:55:17.191 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-18T23:55:17.192 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-18T23:55:17.192 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:17.226 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T23:55:27.661 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T23:55:27.661 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2024-08-18T23:55:27.661 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2024-08-18T23:55:27.662 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2024-08-18T23:55:27.662 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2024-08-18T23:55:27.662 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2024-08-18T23:55:27.662 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /root 2024-08-18T23:55:27.662 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2024-08-18T23:55:27.662 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:27.839 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T23:55:27.856 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T23:55:27.856 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:27.856 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-18T23:55:27.856 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:28.901 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 105/152 2024-08-18T23:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-08-18T23:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-08-18T23:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-08-18T23:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-08-18T23:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-08-18T23:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-08-18T23:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-08-18T23:55:28.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:29.099 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T23:55:29.115 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 106/152 2024-08-18T23:55:29.115 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:29.116 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-18T23:55:29.116 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:29.334 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T23:55:29.360 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T23:55:29.361 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:29.361 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-18T23:55:29.361 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T23:55:29.361 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T23:55:29.361 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:29.595 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T23:55:29.616 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T23:55:29.616 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:29.616 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-18T23:55:29.616 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T23:55:29.616 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T23:55:29.616 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:30.051 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T23:55:30.075 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T23:55:30.075 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:30.075 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-18T23:55:30.075 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T23:55:30.075 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T23:55:30.075 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:30.181 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-18T23:55:30.230 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-18T23:55:30.292 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-18T23:55:30.485 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-18T23:55:30.527 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-18T23:55:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T23:55:30.604 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-18T23:55:30.629 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 107/152 2024-08-18T23:55:30.629 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:30.629 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-18T23:55:30.630 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T23:55:30.630 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-18T23:55:30.630 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:30.692 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-18T23:55:30.827 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-18T23:55:30.853 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T23:55:30.868 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-18T23:55:30.876 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 108/152 2024-08-18T23:55:30.876 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:30.876 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-18T23:55:30.876 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T23:55:30.876 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-18T23:55:30.876 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:30.900 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-18T23:55:30.928 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-18T23:55:31.312 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T23:55:31.336 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 109/152 2024-08-18T23:55:31.336 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:31.336 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-18T23:55:31.337 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T23:55:31.337 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-18T23:55:31.337 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:31.433 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T23:55:31.451 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-18T23:55:31.460 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T23:55:31.491 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-18T23:55:31.507 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-18T23:55:31.554 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-18T23:55:31.568 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-18T23:55:31.583 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T23:55:31.755 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-18T23:55:31.813 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-18T23:55:31.890 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-18T23:55:31.978 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-18T23:55:32.117 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-18T23:55:32.155 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-18T23:55:32.200 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-18T23:55:32.231 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-18T23:55:32.623 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T23:55:32.644 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T23:55:32.660 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T23:55:32.672 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 121/152 2024-08-18T23:55:32.703 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 122/152 2024-08-18T23:55:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 123/152 2024-08-18T23:55:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T23:55:33.614 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T23:55:33.643 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T23:55:33.745 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T23:55:33.849 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 124/152 2024-08-18T23:55:33.897 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T23:55:33.922 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-18T23:55:33.946 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T23:55:33.969 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T23:55:33.970 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:33.970 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-18T23:55:33.970 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T23:55:33.970 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T23:55:33.970 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:34.021 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T23:55:34.033 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T23:55:34.130 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-18T23:55:34.183 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-18T23:55:34.857 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 125/152 2024-08-18T23:55:34.889 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T23:55:34.990 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 126/152 2024-08-18T23:55:35.087 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-18T23:55:35.124 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T23:55:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T23:55:35.148 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:35.148 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-18T23:55:35.148 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T23:55:35.148 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T23:55:35.148 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:35.168 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 127/152 2024-08-18T23:55:35.191 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T23:55:35.199 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T23:55:35.214 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T23:55:35.214 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:35.214 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-18T23:55:35.214 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:35.224 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 128/152 2024-08-18T23:55:35.224 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:35.224 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-18T23:55:35.224 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T23:55:35.224 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-18T23:55:35.224 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:35.258 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T23:55:35.275 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T23:55:35.281 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T23:55:35.281 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:35.282 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-18T23:55:35.282 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T23:55:35.282 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T23:55:35.282 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:35.287 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 129/152 2024-08-18T23:55:35.384 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 130/152 2024-08-18T23:55:35.440 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 131/152 2024-08-18T23:55:35.584 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T23:55:35.607 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T23:55:35.608 INFO:teuthology.orchestra.run.smithi190.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:35.608 INFO:teuthology.orchestra.run.smithi190.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-18T23:55:35.608 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T23:55:35.608 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T23:55:35.608 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:36.354 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-18T23:55:36.386 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T23:55:36.410 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 133/152 2024-08-18T23:55:36.410 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:36.410 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-18T23:55:36.411 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T23:55:36.411 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-18T23:55:36.411 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:36.453 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T23:55:36.477 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1382.gde09d 134/152 2024-08-18T23:55:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:36.477 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-18T23:55:36.477 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:36.521 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T23:55:36.546 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 135/152 2024-08-18T23:55:36.547 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:36.547 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-18T23:55:36.548 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T23:55:36.548 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-18T23:55:36.548 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:36.847 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T23:55:36.870 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 136/152 2024-08-18T23:55:36.871 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-18T23:55:36.871 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-18T23:55:36.871 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T23:55:36.871 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-18T23:55:36.871 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:40.454 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-18T23:55:40.495 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-18T23:55:40.553 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-18T23:55:40.585 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-18T23:55:40.612 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-18T23:55:40.791 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-18T23:55:40.841 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-18T23:55:40.871 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-18T23:55:41.442 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 137/152 2024-08-18T23:55:41.483 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 138/152 2024-08-18T23:55:41.496 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T23:55:41.535 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T23:55:41.545 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 139/152 2024-08-18T23:55:41.556 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T23:55:41.581 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 140/152 2024-08-18T23:55:41.617 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-18T23:55:41.804 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 142/152 2024-08-18T23:55:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-08-18T23:55:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 144/152 2024-08-18T23:55:42.386 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-18T23:55:42.481 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-18T23:55:42.508 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T23:55:42.536 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-18T23:55:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T23:55:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-08-18T23:55:42.628 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-18T23:55:42.669 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-18T23:55:42.669 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T23:55:42.744 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T23:55:42.744 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T23:55:43.412 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 146/152 2024-08-18T23:55:43.505 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-18T23:55:43.554 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-18T23:55:43.677 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-18T23:55:43.709 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-18T23:55:43.709 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T23:55:43.776 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-18T23:55:43.777 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-18T23:55:48.715 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-18T23:55:48.716 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-18T23:55:48.717 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-18T23:55:48.717 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-18T23:55:48.717 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-18T23:55:48.717 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-18T23:55:48.717 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-18T23:55:48.717 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-18T23:55:48.729 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-18T23:55:48.729 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-18T23:55:48.729 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-18T23:55:48.729 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-18T23:55:48.729 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-18T23:55:48.729 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-18T23:55:48.729 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-18T23:55:48.729 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-18T23:55:48.730 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-18T23:55:48.731 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-18T23:55:48.732 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-18T23:55:48.733 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-18T23:55:48.734 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-18T23:55:48.735 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-18T23:55:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-18T23:55:48.737 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-18T23:55:48.738 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-18T23:55:49.894 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 1/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 3/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 4/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1382.gde09d 5/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 6/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 7/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 8/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 9/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 10/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 11/152 2024-08-18T23:55:49.895 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 12/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 13/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 14/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_ 15/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 16/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 17/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_6 18/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86 19/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 20/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el 21/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.1.0-1382.gde09dd01.el9. 22/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_6 23/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 24/152 2024-08-18T23:55:49.896 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 25/152 2024-08-18T23:55:49.897 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 26/152 2024-08-18T23:55:49.897 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 27/152 2024-08-18T23:55:49.897 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 28/152 2024-08-18T23:55:49.897 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 29/152 2024-08-18T23:55:49.897 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01. 30/152 2024-08-18T23:55:49.908 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noa 31/152 2024-08-18T23:55:49.908 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.n 32/152 2024-08-18T23:55:49.908 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1382.gde0 33/152 2024-08-18T23:55:49.908 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el 34/152 2024-08-18T23:55:49.908 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 35/152 2024-08-18T23:55:49.908 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.e 36/152 2024-08-18T23:55:49.908 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 37/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 38/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 39/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-18T23:55:49.909 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-18T23:55:49.910 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-18T23:55:49.911 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 77/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-18T23:55:49.912 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-18T23:55:49.913 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-18T23:55:49.914 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-18T23:55:49.915 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-18T23:55:49.916 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 149/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-18T23:55:49.917 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 151/152 2024-08-18T23:55:50.908 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T23:55:50.908 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: automake-1.16.2-8.el9.noarch 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: bison-3.7.4-5.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.909 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.910 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: flex-2.6.4-9.el9.x86_64 2024-08-18T23:55:50.911 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-18T23:55:50.912 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-18T23:55:50.912 INFO:teuthology.orchestra.run.smithi190.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-18T23:55:50.912 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-18T23:55:50.912 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-18T23:55:50.912 INFO:teuthology.orchestra.run.smithi190.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-18T23:55:50.912 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-18T23:55:50.912 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-18T23:55:50.913 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: lua-5.4.4-4.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-18T23:55:50.914 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-13.14-1.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.915 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-18T23:55:50.916 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-18T23:55:50.917 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ply-3.11-14.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-18T23:55:50.918 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-18T23:55:50.919 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.921 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:50.921 INFO:teuthology.orchestra.run.smithi190.stdout: re2-1:20211101-3.el9.x86_64 2024-08-18T23:55:50.921 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-18T23:55:50.921 INFO:teuthology.orchestra.run.smithi190.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-18T23:55:50.921 INFO:teuthology.orchestra.run.smithi190.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-18T23:55:50.921 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-18T23:55:50.921 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-18T23:55:50.921 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-18T23:55:50.922 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:50.922 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2024-08-18T23:55:51.256 DEBUG:teuthology.parallel:result is None 2024-08-18T23:55:52.121 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-18T23:55:52.121 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:52.121 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-08-18T23:55:52.121 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.122 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.123 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.1.0-1382.gde09dd01.el9.noarch 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-18T23:55:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.125 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-18T23:55:52.126 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.14-1.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.127 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-18T23:55:52.128 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-18T23:55:52.129 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-18T23:55:52.130 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-18T23:55:52.131 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.132 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.133 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.1.0-1382.gde09dd01.el9.x86_64 2024-08-18T23:55:52.133 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-3.el9.x86_64 2024-08-18T23:55:52.133 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-18T23:55:52.133 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-18T23:55:52.133 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-18T23:55:52.133 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-18T23:55:52.133 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-18T23:55:52.133 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-18T23:55:52.134 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:52.134 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-08-18T23:55:52.464 DEBUG:teuthology.parallel:result is None 2024-08-18T23:55:52.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T23:55:52.607 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-18T23:55:52.629 INFO:teuthology.orchestra.run.smithi103.stdout:19.1.0-1382.gde09dd01.el9 2024-08-18T23:55:52.630 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-18T23:55:52.630 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-18T23:55:52.632 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-18T23:55:52.770 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-18T23:55:52.795 INFO:teuthology.orchestra.run.smithi190.stdout:19.1.0-1382.gde09dd01.el9 2024-08-18T23:55:52.795 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1382.gde09dd01.el9 2024-08-18T23:55:52.795 INFO:teuthology.task.install:The correct ceph version 19.1.0-1382.gde09dd01 is installed. 2024-08-18T23:55:52.797 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-18T23:55:52.798 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:52.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T23:55:52.825 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:55:52.826 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-18T23:55:52.861 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-18T23:55:52.862 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:52.862 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T23:55:52.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T23:55:52.956 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:55:52.957 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-08-18T23:55:52.982 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-18T23:55:53.047 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-18T23:55:53.047 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:53.047 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T23:55:53.072 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T23:55:53.138 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:55:53.138 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-18T23:55:53.164 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-18T23:55:53.231 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-18T23:55:53.231 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:53.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T23:55:53.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T23:55:53.322 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:55:53.322 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-08-18T23:55:53.346 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-18T23:55:53.410 INFO:teuthology.run_tasks:Running task ceph... 2024-08-18T23:55:53.485 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-18T23:55:53.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-08-18T23:55:53.487 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2024-08-18T23:55:53.512 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-18T23:55:53.512 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-18T23:55:53.554 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-18T23:55:53.579 INFO:tasks.ceph:Creating extra log directories... 2024-08-18T23:55:53.579 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-18T23:55:53.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-18T23:55:53.652 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-18T23:55:53.652 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-18T23:55:53.652 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-18T23:55:53.653 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:53.653 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-18T23:55:53.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-18T23:55:53.817 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-18T23:55:53.842 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:55:53.842 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-18T23:55:53.857 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-18T23:55:53.968 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-18T23:55:53.998 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-18T23:55:53.998 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-18T23:55:53.998 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/backtrace}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7860032', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '78215f5a1cf5eaf321d506a66539942e12851f34'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1664, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'sleep_before_teardown': 0, 'subset': '36/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '78215f5a1cf5eaf321d506a66539942e12851f34', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJsu3yGvzIfjuCNxtxoetjewyyglc+7DArQ7ysD12rEONIJ3mJU8F3rcZy5Ub3QWjKF5ULvbGAK+yOIq0wxRpI=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDgka3reqIMcMNf81KQRwide0EW4V0X9mNpZpai7UD/2W9YlnmCnvRAWAetuTfqM7LxGvTEFZQKfrzDXjrnbucA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_backtrace']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-18_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-18T23:55:53.999 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-18T23:55:54.001 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-18T23:55:54.049 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-08-18T23:55:54.056 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2024-08-18T23:55:54.113 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:54.113 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T23:55:54.135 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T23:55:54.136 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-08-18T23:55:54.191 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T23:55:54.191 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T23:55:54.191 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 674 Links: 1 2024-08-18T23:55:54.191 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T23:55:54.191 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T23:55:54.191 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-18 23:55:44.275302363 +0000 2024-08-18T23:55:54.191 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-18 23:54:00.755274774 +0000 2024-08-18T23:55:54.191 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-18 23:54:00.755274774 +0000 2024-08-18T23:55:54.192 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-18 23:54:00.755274774 +0000 2024-08-18T23:55:54.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T23:55:54.255 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-08-18T23:55:54.255 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-08-18T23:55:54.255 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000284922 s, 1.8 MB/s 2024-08-18T23:55:54.256 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T23:55:54.312 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 694 Links: 1 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-18 23:55:44.275302363 +0000 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-18 23:54:01.088270785 +0000 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-18 23:54:01.088270785 +0000 2024-08-18T23:55:54.368 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-18 23:54:01.088270785 +0000 2024-08-18T23:55:54.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T23:55:54.431 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-08-18T23:55:54.431 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-08-18T23:55:54.431 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000181081 s, 2.8 MB/s 2024-08-18T23:55:54.433 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T23:55:54.490 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-08-18T23:55:54.548 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T23:55:54.548 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T23:55:54.548 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-08-18T23:55:54.548 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T23:55:54.548 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T23:55:54.548 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-18 23:55:44.275302363 +0000 2024-08-18T23:55:54.549 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-18 23:54:01.416266856 +0000 2024-08-18T23:55:54.549 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-18 23:54:01.416266856 +0000 2024-08-18T23:55:54.549 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-18 23:54:01.416266856 +0000 2024-08-18T23:55:54.549 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T23:55:54.612 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-08-18T23:55:54.612 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-08-18T23:55:54.613 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000235172 s, 2.2 MB/s 2024-08-18T23:55:54.614 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T23:55:54.670 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-08-18T23:55:54.726 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T23:55:54.727 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T23:55:54.727 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 731 Links: 1 2024-08-18T23:55:54.727 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T23:55:54.727 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T23:55:54.727 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-18 23:55:44.276302343 +0000 2024-08-18T23:55:54.727 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-18 23:54:01.728263118 +0000 2024-08-18T23:55:54.727 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-18 23:54:01.728263118 +0000 2024-08-18T23:55:54.727 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-18 23:54:01.728263118 +0000 2024-08-18T23:55:54.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T23:55:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-08-18T23:55:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-08-18T23:55:54.791 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000196134 s, 2.6 MB/s 2024-08-18T23:55:54.793 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T23:55:54.850 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T23:55:54.850 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:55:54.850 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-08-18T23:55:54.867 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-18T23:55:54.868 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-08-18T23:55:54.923 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-18T23:55:54.923 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T23:55:54.923 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-08-18T23:55:54.923 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T23:55:54.923 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T23:55:54.924 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-08-18 23:55:43.270195439 +0000 2024-08-18T23:55:54.924 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-08-18 23:54:00.756487666 +0000 2024-08-18T23:55:54.924 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-08-18 23:54:00.756487666 +0000 2024-08-18T23:55:54.924 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-08-18 23:54:00.756487666 +0000 2024-08-18T23:55:54.924 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-18T23:55:54.988 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-08-18T23:55:54.988 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-08-18T23:55:54.988 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.00026232 s, 2.0 MB/s 2024-08-18T23:55:54.989 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-18T23:55:55.046 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-08-18T23:55:55.102 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-18T23:55:55.103 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T23:55:55.103 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-08-18T23:55:55.103 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T23:55:55.103 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T23:55:55.103 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-08-18 23:55:43.270195439 +0000 2024-08-18T23:55:55.103 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-08-18 23:54:01.094477726 +0000 2024-08-18T23:55:55.103 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-08-18 23:54:01.094477726 +0000 2024-08-18T23:55:55.103 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-08-18 23:54:01.094477726 +0000 2024-08-18T23:55:55.104 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-18T23:55:55.166 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-08-18T23:55:55.166 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-08-18T23:55:55.166 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000239552 s, 2.1 MB/s 2024-08-18T23:55:55.167 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-18T23:55:55.224 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-08-18 23:55:43.270195439 +0000 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-08-18 23:54:01.409468461 +0000 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-08-18 23:54:01.409468461 +0000 2024-08-18T23:55:55.280 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-08-18 23:54:01.409468461 +0000 2024-08-18T23:55:55.281 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-18T23:55:55.343 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-08-18T23:55:55.343 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-08-18T23:55:55.343 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000208555 s, 2.5 MB/s 2024-08-18T23:55:55.344 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-18T23:55:55.401 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-08-18T23:55:55.456 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-18T23:55:55.456 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-18T23:55:55.457 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-18T23:55:55.457 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-18T23:55:55.457 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2024-08-18T23:55:55.457 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-08-18 23:55:43.271195410 +0000 2024-08-18T23:55:55.457 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-08-18 23:54:01.727459109 +0000 2024-08-18T23:55:55.457 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-08-18 23:54:01.727459109 +0000 2024-08-18T23:55:55.457 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: 2024-08-18 23:54:01.727459109 +0000 2024-08-18T23:55:55.457 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-18T23:55:55.519 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-08-18T23:55:55.520 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-08-18T23:55:55.520 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000184682 s, 2.8 MB/s 2024-08-18T23:55:55.521 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-18T23:55:55.576 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T23:55:55.577 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-18T23:55:55.577 INFO:tasks.ceph:Generating config... 2024-08-18T23:55:55.578 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-18T23:55:55.578 INFO:tasks.ceph:[client] debug client = 20 2024-08-18T23:55:55.578 INFO:tasks.ceph:[client] debug ms = 1 2024-08-18T23:55:55.579 INFO:tasks.ceph:[client] pid file = 2024-08-18T23:55:55.579 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-18T23:55:55.579 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-18T23:55:55.579 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-18T23:55:55.580 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-18T23:55:55.580 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-18T23:55:55.580 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-18T23:55:55.580 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-18T23:55:55.580 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-08-18T23:55:55.580 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-18T23:55:55.580 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-08-18T23:55:55.580 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-18T23:55:55.580 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-18T23:55:55.580 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-08-18T23:55:55.580 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-08-18T23:55:55.580 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-18T23:55:55.580 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-18T23:55:55.580 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-08-18T23:55:55.581 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-18T23:55:55.581 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-18T23:55:55.581 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-18T23:55:55.581 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-18T23:55:55.581 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-18T23:55:55.581 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-18T23:55:55.581 INFO:tasks.ceph:Setting up mon.a... 2024-08-18T23:55:55.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-18T23:55:55.636 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.keyring 2024-08-18T23:55:55.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-18T23:55:55.681 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T23:55:55.746 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.103'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2024-08-18T23:55:55.747 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.103,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-18T23:55:55.748 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:55.749 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-18T23:55:55.802 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.103 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:55:55.888 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:55:55.888 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: generated fsid c396ba9f-4334-441d-8e0e-0892ec29262b 2024-08-18T23:55:55.888 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 0 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:fsid c396ba9f-4334-441d-8e0e-0892ec29262b 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:last_changed 2024-08-18T23:55:55.888225+0000 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-08-18T23:55:55.888225+0000 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:min_mon_release 17 (quincy) 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:election_strategy: 1 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2024-08-18T23:55:55.889 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-18T23:55:55.890 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-18T23:55:55.905 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c396ba9f-4334-441d-8e0e-0892ec29262b... 2024-08-18T23:55:55.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T23:55:55.947 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-18T23:55:55.987 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-08-18T23:55:55.988 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-08-18T23:55:55.989 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-08-18T23:55:55.990 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.103,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = c396ba9f-4334-441d-8e0e-0892ec29262b 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-08-18T23:55:55.991 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-08-18T23:55:55.992 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 20 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 20 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 10 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T23:55:55.993 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-08-18T23:55:55.994 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.995 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: mon down mkfs grace = 300 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: mon op complaint time = 120 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on pool no app = False 2024-08-18T23:55:55.996 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: client mount timeout = 600 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = "" 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-08-18T23:55:55.997 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout:[mds] 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds = 20 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds balancer = 20 2024-08-18T23:55:55.998 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-08-18T23:55:55.999 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug frag = True 2024-08-18T23:55:55.999 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug scatterstat = True 2024-08-18T23:55:55.999 INFO:teuthology.orchestra.run.smithi103.stdout: mds op complaint time = 180 2024-08-18T23:55:55.999 INFO:teuthology.orchestra.run.smithi103.stdout: mds verify scatter = True 2024-08-18T23:55:55.999 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2024-08-18T23:55:55.999 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2024-08-18T23:55:55.999 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-08-18T23:55:56.000 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-08-18T23:55:56.001 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-08-18T23:55:56.002 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.103,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = c396ba9f-4334-441d-8e0e-0892ec29262b 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.003 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.004 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-08-18T23:55:56.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-08-18T23:55:56.006 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-08-18T23:55:56.007 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: mon down mkfs grace = 300 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-08-18T23:55:56.008 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on pool no app = False 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-08-18T23:55:56.009 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2024-08-18T23:55:56.010 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-08-18T23:55:56.011 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-08-18T23:55:56.011 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-08-18T23:55:56.012 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-18T23:55:56.012 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-18T23:55:56.107 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-18T23:55:56.107 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:56.107 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-18T23:55:56.122 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:56.122 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-18T23:55:56.177 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:55:56.178 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:56.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-18T23:55:56.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T23:55:56.252 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:55:56.252 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:55:56.308 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:55:56.308 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:55:56.309 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-18T23:55:56.309 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-18T23:55:56.343 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:55:56.344 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:55:56.400 INFO:tasks.ceph:Setting up mon nodes... 2024-08-18T23:55:56.400 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-18T23:55:56.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-18T23:55:56.452 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-18T23:55:56.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-18T23:55:56.524 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-18T23:55:56.527 INFO:tasks.ceph:Setting up mds nodes... 2024-08-18T23:55:56.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-18T23:55:56.579 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-18T23:55:56.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-18T23:55:56.606 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-18T23:55:56.697 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-18T23:55:56.699 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-18T23:55:56.723 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-18T23:55:56.775 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-18T23:55:56.778 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-18T23:55:56.803 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-18T23:55:56.894 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-18T23:55:56.897 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-18T23:55:56.922 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-18T23:55:56.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-18T23:55:56.963 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-18T23:55:56.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-18T23:55:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-18T23:55:57.070 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-18T23:55:57.110 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-18T23:55:57.123 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-18T23:55:57.203 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-18T23:55:57.216 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-18T23:55:57.216 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-18T23:55:57.216 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-18T23:55:57.241 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T23:55:57.241 INFO:tasks.ceph:role: osd.0 2024-08-18T23:55:57.241 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:55:57.241 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-18T23:55:57.313 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T23:55:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T23:55:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T23:55:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-18T23:55:57.314 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T23:55:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-08-18T23:55:57.314 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T23:55:57.314 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-18T23:55:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T23:55:57.314 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T23:55:57.794 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-08-18T23:55:57.796 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-08-18T23:55:57.797 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-18T23:55:57.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-18T23:55:57.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-18T23:55:58.010 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T23:55:58.010 INFO:tasks.ceph:role: osd.1 2024-08-18T23:55:58.010 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:55:58.010 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-18T23:55:58.083 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T23:55:58.083 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T23:55:58.083 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T23:55:58.083 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-18T23:55:58.083 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T23:55:58.084 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-08-18T23:55:58.084 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T23:55:58.084 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-18T23:55:58.084 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T23:55:58.084 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T23:55:58.540 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-08-18T23:55:58.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-08-18T23:55:58.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-18T23:55:58.615 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-18T23:55:58.685 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-18T23:55:58.751 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T23:55:58.751 INFO:tasks.ceph:role: osd.2 2024-08-18T23:55:58.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:55:58.751 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T23:55:58.823 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T23:55:59.308 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-08-18T23:55:59.310 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-08-18T23:55:59.311 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-18T23:55:59.403 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-18T23:55:59.433 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-18T23:55:59.498 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-18T23:55:59.498 INFO:tasks.ceph:role: osd.3 2024-08-18T23:55:59.498 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:55:59.498 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T23:55:59.571 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T23:56:00.053 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-08-18T23:56:00.056 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-08-18T23:56:00.056 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-18T23:56:00.183 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-18T23:56:00.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:00.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:00.302+0000 7f5f359dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-18T23:56:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:00.304+0000 7f5f359dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-18T23:56:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:00.305+0000 7f5f359dc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-18T23:56:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:00.305+0000 7f5f359dc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-18T23:56:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:00.305+0000 7f5f359dc640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-18T23:56:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:00.309+0000 7f5f359dc640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-18T23:56:03.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-18T23:56:03.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:03.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:03.274+0000 7fd834501640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-18T23:56:03.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:03.274+0000 7fd834501640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-18T23:56:03.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:03.274+0000 7fd834501640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-18T23:56:03.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:03.274+0000 7fd834501640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-18T23:56:03.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:03.274+0000 7fd834501640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-18T23:56:03.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:03.275+0000 7fd834501640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-18T23:56:06.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-18T23:56:06.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:06.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:06.248+0000 7fd5d7b88640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-18T23:56:06.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:06.249+0000 7fd5d7b88640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-18T23:56:06.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:06.249+0000 7fd5d7b88640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-18T23:56:06.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:06.249+0000 7fd5d7b88640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-18T23:56:06.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:06.249+0000 7fd5d7b88640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-18T23:56:06.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:06.249+0000 7fd5d7b88640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-18T23:56:09.093 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-18T23:56:09.122 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:09.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:09.211+0000 7fdb70f88640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-18T23:56:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:09.212+0000 7fdb70f88640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-18T23:56:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:09.212+0000 7fdb70f88640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-18T23:56:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:09.212+0000 7fdb70f88640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-18T23:56:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:09.212+0000 7fdb70f88640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-18T23:56:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:09.212+0000 7fdb70f88640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-18T23:56:12.071 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-18T23:56:12.096 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-18T23:56:12.127 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T23:56:12.127 INFO:tasks.ceph:role: osd.4 2024-08-18T23:56:12.127 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:56:12.128 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T23:56:12.204 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T23:56:12.700 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-08-18T23:56:12.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-08-18T23:56:12.702 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-18T23:56:12.835 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-18T23:56:12.867 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-18T23:56:12.933 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T23:56:12.933 INFO:tasks.ceph:role: osd.5 2024-08-18T23:56:12.933 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:56:12.933 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-18T23:56:13.005 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T23:56:13.005 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T23:56:13.005 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T23:56:13.006 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-18T23:56:13.006 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T23:56:13.006 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-08-18T23:56:13.006 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T23:56:13.006 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-18T23:56:13.006 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T23:56:13.006 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T23:56:13.462 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-08-18T23:56:13.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-08-18T23:56:13.465 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-18T23:56:13.552 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-18T23:56:13.581 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-18T23:56:13.645 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T23:56:13.646 INFO:tasks.ceph:role: osd.6 2024-08-18T23:56:13.646 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:56:13.646 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-18T23:56:13.717 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T23:56:13.718 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T23:56:14.211 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-08-18T23:56:14.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-08-18T23:56:14.214 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-18T23:56:14.327 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-18T23:56:14.356 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-18T23:56:14.420 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-18T23:56:14.421 INFO:tasks.ceph:role: osd.7 2024-08-18T23:56:14.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:56:14.421 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-18T23:56:14.493 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-18T23:56:14.494 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-18T23:56:14.984 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-08-18T23:56:14.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-08-18T23:56:14.987 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-18T23:56:15.114 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-18T23:56:15.145 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:15.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:15.251+0000 7f36d0227640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-18T23:56:15.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:15.251+0000 7f36d0227640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-18T23:56:15.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:15.251+0000 7f36d0227640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-18T23:56:15.254 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:15.251+0000 7f36d0227640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-18T23:56:15.255 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:15.251+0000 7f36d0227640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-18T23:56:15.255 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:15.251+0000 7f36d0227640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-18T23:56:18.114 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-18T23:56:18.144 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:18.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:18.234+0000 7fbb54a2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-18T23:56:18.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:18.235+0000 7fbb54a2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-18T23:56:18.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:18.235+0000 7fbb54a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-18T23:56:18.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:18.235+0000 7fbb54a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-18T23:56:18.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:18.235+0000 7fbb54a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-18T23:56:18.237 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:18.235+0000 7fbb54a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-18T23:56:21.088 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-18T23:56:21.117 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:21.207 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:21.205+0000 7f9502c2f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-18T23:56:21.207 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:21.206+0000 7f9502c2f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-18T23:56:21.207 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:21.206+0000 7f9502c2f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-18T23:56:21.207 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:21.206+0000 7f9502c2f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-18T23:56:21.207 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:21.206+0000 7f9502c2f640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-18T23:56:21.208 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:21.206+0000 7f9502c2f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-18T23:56:24.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:56:24.003 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:56:24.081 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-18T23:56:24.147 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:24.235 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:24.234+0000 7fb9d2616640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-18T23:56:24.235 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:24.234+0000 7fb9d2616640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-18T23:56:24.235 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:24.234+0000 7fb9d2616640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-18T23:56:24.235 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:24.234+0000 7fb9d2616640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-18T23:56:24.235 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:24.234+0000 7fb9d2616640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-18T23:56:24.236 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:24.235+0000 7fb9d2616640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-18T23:56:27.088 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-18T23:56:27.117 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-18T23:56:27.117 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:27.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-18T23:56:27.147 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:27.147 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-18T23:56:27.216 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:27.216 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-18T23:56:27.285 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:27.285 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-18T23:56:27.352 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:27.352 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-18T23:56:27.418 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:27.418 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-18T23:56:27.484 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:27.484 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-18T23:56:27.550 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:27.550 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-18T23:56:27.580 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:27.580 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-18T23:56:27.649 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:27.649 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-18T23:56:27.718 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:27.718 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-18T23:56:27.785 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:27.785 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-18T23:56:27.853 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:27.853 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-18T23:56:27.918 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:27.918 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-18T23:56:27.984 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:27.984 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-18T23:56:28.001 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:28.001 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-18T23:56:28.057 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:28.057 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-18T23:56:28.073 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:28.073 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-18T23:56:28.129 INFO:tasks.ceph:Adding keys to all mons... 2024-08-18T23:56:28.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-18T23:56:28.132 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-18T23:56:28.173 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2024-08-18T23:56:28.173 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAMisJmi0zvGhAAP6SHUwBw0WOeSABNoSKtLQ== 2024-08-18T23:56:28.173 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2024-08-18T23:56:28.173 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAMisJmbxR6IhAAWzYaMaVb3mACjrCHwisFnA== 2024-08-18T23:56:28.173 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2024-08-18T23:56:28.173 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAMisJmvtOIKRAAkUJgPcoJLHEkQ9GLPtPyFQ== 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAQisJmJwIlEhAAqnwaxX9h8Hem4LXIXfH/Ug== 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQATisJmjUhsEBAAHvQTYaQZwJJcpZX8FPYvWg== 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAWisJm5tvjDhAAI+E3A5xbHKx6uslpuvwh+A== 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAZisJm03+sDBAA9loaBbDipYGGC1FD6H8QhA== 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAMisJmO+g9HxAAqwDIMFCJG/wcQQT+YJHlmg== 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAMisJmtQ81LhAA+phuLrahZ68PDi/RlIUrwA== 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2024-08-18T23:56:28.174 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAMisJm2bZVNRAAuCGrIiOMhMCWKn90/joplQ== 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAfisJmus0CDxAAO/7I/hA5ShqV91vJsAuzDA== 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAiisJm7IgLDhAA0KYeD6bay0CkNZDE3B/hkA== 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAlisJmuMxQDBAAUHgybWTbKUHeW58ApBPqIw== 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAoisJm8+wBDhAABaWUI5VlNpDCgVdXRAaALQ== 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAMisJm8shqORAAhfpG5RVY14+bkkc4GjljTQ== 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout:[client.2] 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQANisJmJXxnAxAAEKU4VxzNDSnDs+WRxDuDiQ== 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQANisJm0MKWBhAAXM0NgNzD0WSJ7v2Ykt6aBg== 2024-08-18T23:56:28.175 INFO:teuthology.orchestra.run.smithi103.stdout:[client.3] 2024-08-18T23:56:28.176 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQANisJmlZceDBAAHsLZkEzrYCJVQRVBTCh2bw== 2024-08-18T23:56:28.193 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2024-08-18T23:56:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAMisJmi0zvGhAAP6SHUwBw0WOeSABNoSKtLQ== 2024-08-18T23:56:28.193 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-08-18T23:56:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAMisJmbxR6IhAAWzYaMaVb3mACjrCHwisFnA== 2024-08-18T23:56:28.193 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-08-18T23:56:28.193 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAMisJmvtOIKRAAkUJgPcoJLHEkQ9GLPtPyFQ== 2024-08-18T23:56:28.193 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAQisJmJwIlEhAAqnwaxX9h8Hem4LXIXfH/Ug== 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQATisJmjUhsEBAAHvQTYaQZwJJcpZX8FPYvWg== 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAWisJm5tvjDhAAI+E3A5xbHKx6uslpuvwh+A== 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAZisJm03+sDBAA9loaBbDipYGGC1FD6H8QhA== 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAMisJmO+g9HxAAqwDIMFCJG/wcQQT+YJHlmg== 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAMisJmtQ81LhAA+phuLrahZ68PDi/RlIUrwA== 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAMisJm2bZVNRAAuCGrIiOMhMCWKn90/joplQ== 2024-08-18T23:56:28.194 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAfisJmus0CDxAAO/7I/hA5ShqV91vJsAuzDA== 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAiisJm7IgLDhAA0KYeD6bay0CkNZDE3B/hkA== 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAlisJmuMxQDBAAUHgybWTbKUHeW58ApBPqIw== 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAoisJm8+wBDhAABaWUI5VlNpDCgVdXRAaALQ== 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAMisJm8shqORAAhfpG5RVY14+bkkc4GjljTQ== 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout:[client.2] 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQANisJmJXxnAxAAEKU4VxzNDSnDs+WRxDuDiQ== 2024-08-18T23:56:28.195 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2024-08-18T23:56:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQANisJm0MKWBhAAXM0NgNzD0WSJ7v2Ykt6aBg== 2024-08-18T23:56:28.196 INFO:teuthology.orchestra.run.smithi190.stdout:[client.3] 2024-08-18T23:56:28.196 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQANisJmlZceDBAAHsLZkEzrYCJVQRVBTCh2bw== 2024-08-18T23:56:28.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T23:56:28.219 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T23:56:28.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T23:56:28.289 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T23:56:28.343 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T23:56:28.345 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T23:56:28.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.400 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.453 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.504 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.506 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.558 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.609 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T23:56:28.611 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-18T23:56:28.661 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T23:56:28.664 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T23:56:28.717 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T23:56:28.719 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-18T23:56:28.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.775 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.827 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.880 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.934 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-18T23:56:28.984 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T23:56:28.987 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T23:56:29.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T23:56:29.043 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T23:56:29.096 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T23:56:29.099 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T23:56:29.155 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T23:56:29.158 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-18T23:56:29.211 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-18T23:56:29.211 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-18T23:56:29.236 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T23:56:29.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-18T23:56:29.356 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-18T23:56:29.381 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T23:56:29.477 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-18T23:56:29.501 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-18T23:56:29.565 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-18T23:56:29.660 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-18T23:56:29.684 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:29.687 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-18T23:56:29.740 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-18T23:56:29.740 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-18T23:56:29.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-18T23:56:29.743 INFO:tasks.ceph.mon.a:Started 2024-08-18T23:56:29.743 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-18T23:56:29.743 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-18T23:56:29.785 INFO:tasks.ceph.mon.b:Started 2024-08-18T23:56:29.785 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-18T23:56:29.785 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-18T23:56:29.787 INFO:tasks.ceph.mon.c:Started 2024-08-18T23:56:29.788 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-18T23:56:29.788 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-18T23:56:29.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-18T23:56:29.790 INFO:tasks.ceph.mgr.y:Started 2024-08-18T23:56:29.790 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-18T23:56:29.790 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-18T23:56:29.793 INFO:tasks.ceph.mgr.x:Started 2024-08-18T23:56:29.793 INFO:tasks.ceph:Setting crush tunables to default 2024-08-18T23:56:29.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd crush tunables default 2024-08-18T23:56:29.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.891+0000 7f5ac7d81640 1 Processor -- start 2024-08-18T23:56:29.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.891+0000 7f5ac7d81640 1 -- start start 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac7d81640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 0x7f5ac00b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac7d81640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ac015b570 0x7f5ac00b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac7d81640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 0x7f5ac006e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac7d81640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac006b900 con 0x7f5ac015b570 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac7d81640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac006e230 con 0x7f5ac00b4610 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac7d81640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac006e4d0 con 0x7f5ac015a6b0 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac531c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ac015b570 0x7f5ac00b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac531c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ac015b570 0x7f5ac00b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59966/0 (socket says 172.21.15.103:59966) 2024-08-18T23:56:29.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac531c640 1 -- 172.21.15.103:0/3481958256 learned_addr learned my addr 172.21.15.103:0/3481958256 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac531c640 1 -- 172.21.15.103:0/3481958256 >> v2:172.21.15.103:3300/0 conn(0x7f5ac015b570 msgr2=0x7f5ac00b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac531c640 1 -- 172.21.15.103:0/3481958256 >> v2:172.21.15.103:3300/0 conn(0x7f5ac015b570 msgr2=0x7f5ac00b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac631e640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 0x7f5ac006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac531c640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.103:3300/0 conn(0x7f5ac015b570 0x7f5ac00b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac5b1d640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 0x7f5ac00b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac531c640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.103:3300/0 conn(0x7f5ac015b570 0x7f5ac00b40d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac631e640 1 -- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 msgr2=0x7f5ac006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac631e640 1 -- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 msgr2=0x7f5ac006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac631e640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 0x7f5ac006e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac631e640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 0x7f5ac006e8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac5b1d640 1 -- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 msgr2=0x7f5ac00b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac5b1d640 1 -- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 msgr2=0x7f5ac00b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac5b1d640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 0x7f5ac00b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-18T23:56:29.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:29.892+0000 7f5ac5b1d640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 0x7f5ac00b36e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-18T23:56:30.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac531c640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.103:3300/0 conn(0x7f5ac015b570 0x7f5ac00b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac5b1d640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 0x7f5ac00b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac631e640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 0x7f5ac006e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac531c640 1 -- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 msgr2=0x7f5ac00b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac531c640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 0x7f5ac00b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac531c640 1 -- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 msgr2=0x7f5ac006e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac531c640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 0x7f5ac006e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac531c640 1 -- 172.21.15.103:0/3481958256 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac006bb30 con 0x7f5ac015b570 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.093+0000 7f5ac5b1d640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 0x7f5ac00b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.094+0000 7f5ac531c640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015b570 0x7f5ac00b40d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0072f90 tx=0x7f5ab002cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e549822ee4e12a44 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.094+0000 7f5ac4b1b640 1 -- 172.21.15.103:0/3481958256 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0036070 con 0x7f5ac015b570 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.094+0000 7f5ac4b1b640 1 -- 172.21.15.103:0/3481958256 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab0032850 con 0x7f5ac015b570 2024-08-18T23:56:30.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.094+0000 7f5ac4b1b640 1 -- 172.21.15.103:0/3481958256 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0032c20 con 0x7f5ac015b570 2024-08-18T23:56:30.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 -- 172.21.15.103:0/3481958256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015b570 msgr2=0x7f5ac00b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015b570 0x7f5ac00b40d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0072f90 tx=0x7f5ab002cac0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 -- 172.21.15.103:0/3481958256 shutdown_connections 2024-08-18T23:56:30.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 --2- 172.21.15.103:0/3481958256 >> v2:172.21.15.190:3300/0 conn(0x7f5ac00b4610 0x7f5ac006e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015b570 0x7f5ac00b40d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 --2- 172.21.15.103:0/3481958256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac015a6b0 0x7f5ac00b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 -- 172.21.15.103:0/3481958256 >> 172.21.15.103:0/3481958256 conn(0x7f5ac00d0610 msgr2=0x7f5ac00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:30.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 -- 172.21.15.103:0/3481958256 shutdown_connections 2024-08-18T23:56:30.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.095+0000 7f5ac7d81640 1 -- 172.21.15.103:0/3481958256 wait complete. 2024-08-18T23:56:30.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.096+0000 7f5ac7d81640 1 Processor -- start 2024-08-18T23:56:30.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.096+0000 7f5ac7d81640 1 -- start start 2024-08-18T23:56:30.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac7d81640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac00b4610 0x7f5ac00aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac7d81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015a6b0 0x7f5ac01e5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac7d81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ac015b570 0x7f5ac01e5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac7d81640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac015bcb0 con 0x7f5ac015a6b0 2024-08-18T23:56:30.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac7d81640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac015b9b0 con 0x7f5ac015b570 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac7d81640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac015be30 con 0x7f5ac00b4610 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015a6b0 0x7f5ac01e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015a6b0 0x7f5ac01e5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60006/0 (socket says 172.21.15.103:60006) 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 -- 172.21.15.103:0/4020335708 learned_addr learned my addr 172.21.15.103:0/4020335708 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac5b1d640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac00b4610 0x7f5ac00aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac631e640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ac015b570 0x7f5ac01e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 -- 172.21.15.103:0/4020335708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac00b4610 msgr2=0x7f5ac00aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac00b4610 0x7f5ac00aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 -- 172.21.15.103:0/4020335708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ac015b570 msgr2=0x7f5ac01e5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ac015b570 0x7f5ac01e5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 -- 172.21.15.103:0/4020335708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac0152480 con 0x7f5ac015a6b0 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.097+0000 7f5ac531c640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015a6b0 0x7f5ac01e5120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ab002d0b0 tx=0x7f5ab0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.098+0000 7f5ab67fc640 1 -- 172.21.15.103:0/4020335708 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0036040 con 0x7f5ac015a6b0 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.098+0000 7f5ab67fc640 1 -- 172.21.15.103:0/4020335708 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ab000a190 con 0x7f5ac015a6b0 2024-08-18T23:56:30.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.098+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac0152760 con 0x7f5ac015a6b0 2024-08-18T23:56:30.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.098+0000 7f5ab67fc640 1 -- 172.21.15.103:0/4020335708 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0030d60 con 0x7f5ac015a6b0 2024-08-18T23:56:30.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.098+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac0152d20 con 0x7f5ac015a6b0 2024-08-18T23:56:30.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.098+0000 7f5ab67fc640 1 -- 172.21.15.103:0/4020335708 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5ab0039070 con 0x7f5ac015a6b0 2024-08-18T23:56:30.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.098+0000 7f5ab67fc640 1 -- 172.21.15.103:0/4020335708 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5ab00037f0 con 0x7f5ac015a6b0 2024-08-18T23:56:30.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.099+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac006fb00 con 0x7f5ac015a6b0 2024-08-18T23:56:30.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.102+0000 7f5ab67fc640 1 -- 172.21.15.103:0/4020335708 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f5ab0063f20 con 0x7f5ac015a6b0 2024-08-18T23:56:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.164+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5ac00753e0 con 0x7f5ac015a6b0 2024-08-18T23:56:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.166+0000 7f5ab67fc640 1 -- 172.21.15.103:0/4020335708 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5ab0052020 con 0x7f5ac015a6b0 2024-08-18T23:56:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-08-18T23:56:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015a6b0 msgr2=0x7f5ac01e5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015a6b0 0x7f5ac01e5120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ab002d0b0 tx=0x7f5ab0004730 comp rx=0 tx=0).stop 2024-08-18T23:56:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 shutdown_connections 2024-08-18T23:56:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ac015b570 0x7f5ac01e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac015a6b0 0x7f5ac01e5120 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 --2- 172.21.15.103:0/4020335708 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ac00b4610 0x7f5ac00aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 >> 172.21.15.103:0/4020335708 conn(0x7f5ac00d0610 msgr2=0x7f5ac015ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 shutdown_connections 2024-08-18T23:56:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:30.167+0000 7f5ac7d81640 1 -- 172.21.15.103:0/4020335708 wait complete. 2024-08-18T23:56:30.179 INFO:tasks.ceph:check_enable_crimson: False 2024-08-18T23:56:30.179 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-18T23:56:30.180 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:30.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-18T23:56:30.207 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:30.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-18T23:56:30.272 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:30.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-18T23:56:30.273 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:30.271+0000 7fc5cc41c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-18T23:56:30.275 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:30.273+0000 7f09eb00d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-18T23:56:30.297 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:56:30.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-18T23:56:30.325 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:30.323+0000 7f09eb00d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T23:56:30.326 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:30.324+0000 7fc5cc41c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-18T23:56:30.351 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:30.351 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-18T23:56:30.377 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:30.378 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-18T23:56:30.435 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:30.434+0000 7fc5cc41c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T23:56:30.436 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:30.434+0000 7f09eb00d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-18T23:56:30.443 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:30.443 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-18T23:56:30.508 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:56:30.508 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-18T23:56:30.558 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:30.556+0000 7fc5cc41c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T23:56:30.564 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:30.562+0000 7f09eb00d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-18T23:56:30.572 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 7b1f9a3a-f06c-433c-82ff-713f4b6795f2 0 2024-08-18T23:56:30.672 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:30.671+0000 7fc5cc41c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T23:56:30.683 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:30.681+0000 7f09eb00d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-18T23:56:30.712 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.710+0000 7f8f19f44640 1 Processor -- start 2024-08-18T23:56:30.713 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.710+0000 7f8f19f44640 1 -- start start 2024-08-18T23:56:30.714 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f19f44640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f14154e30 0x7f8f1406cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.714 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f19f44640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8f14155210 0x7f8f1415e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.714 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f19f44640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1406c7d0 con 0x7f8f140722b0 2024-08-18T23:56:30.714 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f19f44640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1406d0f0 con 0x7f8f14155210 2024-08-18T23:56:30.714 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f19f44640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1406bc50 con 0x7f8f14154e30 2024-08-18T23:56:30.714 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f137fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f14154e30 0x7f8f1406cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.715 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f137fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f14154e30 0x7f8f1406cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57554/0 (socket says 172.21.15.190:57554) 2024-08-18T23:56:30.715 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f0bfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8f14155210 0x7f8f1415e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.715 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.711+0000 7f8f137fe640 1 -- 172.21.15.190:0/2169468066 learned_addr learned my addr 172.21.15.190:0/2169468066 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:30.715 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.712+0000 7f8f0bfff640 1 -- 172.21.15.190:0/2169468066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f14154e30 msgr2=0x7f8f1406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:30.715 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.712+0000 7f8f0bfff640 1 --2- 172.21.15.190:0/2169468066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f14154e30 0x7f8f1406cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.715 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.712+0000 7f8f0bfff640 1 -- 172.21.15.190:0/2169468066 >> v1:172.21.15.103:6789/0 conn(0x7f8f140722b0 legacy=0x7f8f14161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.715 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.712+0000 7f8f0bfff640 1 -- 172.21.15.190:0/2169468066 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1406bf30 con 0x7f8f14155210 2024-08-18T23:56:30.715 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.712+0000 7f8f137fe640 1 --2- 172.21.15.190:0/2169468066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f14154e30 0x7f8f1406cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.712+0000 7f8f0bfff640 1 --2- 172.21.15.190:0/2169468066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f14155210 0x7f8f1415e520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0097a0 tx=0x7f8efc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd8182f00d73ba99 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f12ffd640 1 -- 172.21.15.190:0/2169468066 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc037070 con 0x7f8f14155210 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f12ffd640 1 -- 172.21.15.190:0/2169468066 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8efc02ae50 con 0x7f8f14155210 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f12ffd640 1 -- 172.21.15.190:0/2169468066 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc032660 con 0x7f8f14155210 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f19f44640 1 -- 172.21.15.190:0/2169468066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f14155210 msgr2=0x7f8f1415e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f19f44640 1 --2- 172.21.15.190:0/2169468066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f14155210 0x7f8f1415e520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0097a0 tx=0x7f8efc02a100 comp rx=0 tx=0).stop 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f19f44640 1 -- 172.21.15.190:0/2169468066 shutdown_connections 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f19f44640 1 --2- 172.21.15.190:0/2169468066 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f14155210 0x7f8f1415e520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.717 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f19f44640 1 --2- 172.21.15.190:0/2169468066 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f14154e30 0x7f8f1406cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f19f44640 1 -- 172.21.15.190:0/2169468066 >> 172.21.15.190:0/2169468066 conn(0x7f8f140b2670 msgr2=0x7f8f140b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:30.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f19f44640 1 -- 172.21.15.190:0/2169468066 shutdown_connections 2024-08-18T23:56:30.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.713+0000 7f8f19f44640 1 -- 172.21.15.190:0/2169468066 wait complete. 2024-08-18T23:56:30.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f19f44640 1 Processor -- start 2024-08-18T23:56:30.718 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f19f44640 1 -- start start 2024-08-18T23:56:30.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f19f44640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f140722b0 0x7f8f1413bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f19f44640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f14154e30 0x7f8f1414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f19f44640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f1415ff90 0x7f8f14160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f19f44640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1406fae0 con 0x7f8f14154e30 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f19f44640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1406c4f0 con 0x7f8f1415ff90 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f19f44640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1406b900 con 0x7f8f140722b0 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f137fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f140722b0 0x7f8f1413bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f13fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f1415ff90 0x7f8f14160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f137fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f140722b0 0x7f8f1413bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57568/0 (socket says 172.21.15.190:57568) 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f137fe640 1 -- 172.21.15.190:0/1530143004 learned_addr learned my addr 172.21.15.190:0/1530143004 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.715+0000 7f8f0bfff640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f14154e30 0x7f8f1414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f13fff640 1 -- 172.21.15.190:0/1530143004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f140722b0 msgr2=0x7f8f1413bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f13fff640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f140722b0 0x7f8f1413bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f13fff640 1 -- 172.21.15.190:0/1530143004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f14154e30 msgr2=0x7f8f1414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f13fff640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f14154e30 0x7f8f1414df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f13fff640 1 -- 172.21.15.190:0/1530143004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1414fd10 con 0x7f8f1415ff90 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f137fe640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f140722b0 0x7f8f1413bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f13fff640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f1415ff90 0x7f8f14160420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c690 tx=0x7f8f0c00cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f10ff9640 1 -- 172.21.15.190:0/1530143004 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c003b70 con 0x7f8f1415ff90 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f10ff9640 1 -- 172.21.15.190:0/1530143004 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c003d10 con 0x7f8f1415ff90 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1414fff0 con 0x7f8f1415ff90 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f10ff9640 1 -- 172.21.15.190:0/1530143004 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c005310 con 0x7f8f1415ff90 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f141505b0 con 0x7f8f1415ff90 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f10ff9640 1 -- 172.21.15.190:0/1530143004 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f0c0054b0 con 0x7f8f1415ff90 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.716+0000 7f8f10ff9640 1 -- 172.21.15.190:0/1530143004 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8f0c012880 con 0x7f8f1415ff90 2024-08-18T23:56:30.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.717+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1406cbb0 con 0x7f8f1415ff90 2024-08-18T23:56:30.723 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.719+0000 7f8f10ff9640 1 -- 172.21.15.190:0/1530143004 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f8f0c012a80 con 0x7f8f1415ff90 2024-08-18T23:56:30.766 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:30.765+0000 7fc5cc41c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T23:56:30.783 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:30.781+0000 7f09eb00d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-18T23:56:30.789 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.787+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7b1f9a3a-f06c-433c-82ff-713f4b6795f2", "id": 0} v 0) -- 0x7f8f1406d300 con 0x7f8f1415ff90 2024-08-18T23:56:30.795 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.793+0000 7f8f10ff9640 1 -- 172.21.15.190:0/1530143004 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7b1f9a3a-f06c-433c-82ff-713f4b6795f2", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8f0c012c60 con 0x7f8f1415ff90 2024-08-18T23:56:30.796 INFO:teuthology.orchestra.run.smithi190.stdout:0 2024-08-18T23:56:30.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f1415ff90 msgr2=0x7f8f14160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f1415ff90 0x7f8f14160420 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c690 tx=0x7f8f0c00cb50 comp rx=0 tx=0).stop 2024-08-18T23:56:30.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 shutdown_connections 2024-08-18T23:56:30.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f1415ff90 0x7f8f14160420 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f14154e30 0x7f8f1414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 --2- 172.21.15.190:0/1530143004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f140722b0 0x7f8f1413bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 >> 172.21.15.190:0/1530143004 conn(0x7f8f140b2670 msgr2=0x7f8f14160e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:30.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 shutdown_connections 2024-08-18T23:56:30.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.794+0000 7f8f19f44640 1 -- 172.21.15.190:0/1530143004 wait complete. 2024-08-18T23:56:30.807 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96 1 2024-08-18T23:56:30.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.905+0000 7fe2c0047640 1 Processor -- start 2024-08-18T23:56:30.907 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.905+0000 7fe2c0047640 1 -- start start 2024-08-18T23:56:30.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2c0047640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2b815e570 0x7fe2b80722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2c0047640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe2b815e9e0 0x7fe2b80727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2c0047640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b806fb10 con 0x7fe2b8154ec0 2024-08-18T23:56:30.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2c0047640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b806c840 con 0x7fe2b815e9e0 2024-08-18T23:56:30.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2c0047640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b806bcc0 con 0x7fe2b815e570 2024-08-18T23:56:30.908 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2bd5e2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2b815e570 0x7fe2b80722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2bd5e2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2b815e570 0x7fe2b80722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56566/0 (socket says 172.21.15.190:56566) 2024-08-18T23:56:30.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2bd5e2640 1 -- 172.21.15.190:0/727097462 learned_addr learned my addr 172.21.15.190:0/727097462 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:30.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2be5e4640 1 --2- 172.21.15.190:0/727097462 >> v2:172.21.15.103:3300/0 conn(0x7fe2b815e9e0 0x7fe2b80727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2bd5e2640 1 -- 172.21.15.190:0/727097462 >> v2:172.21.15.103:3300/0 conn(0x7fe2b815e9e0 msgr2=0x7fe2b80727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:30.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2bd5e2640 1 --2- 172.21.15.190:0/727097462 >> v2:172.21.15.103:3300/0 conn(0x7fe2b815e9e0 0x7fe2b80727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2bd5e2640 1 -- 172.21.15.190:0/727097462 >> v1:172.21.15.190:6789/0 conn(0x7fe2b8154ec0 legacy=0x7fe2b806cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.909 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.906+0000 7fe2bd5e2640 1 -- 172.21.15.190:0/727097462 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b806bfa0 con 0x7fe2b815e570 2024-08-18T23:56:30.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.907+0000 7fe2bd5e2640 1 --2- 172.21.15.190:0/727097462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b815e570 0x7fe2b80722b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8067eb0 tx=0x7fe2a802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39eb0c6a054c9359 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:30.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.907+0000 7fe2bcde1640 1 -- 172.21.15.190:0/727097462 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8037070 con 0x7fe2b815e570 2024-08-18T23:56:30.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.907+0000 7fe2bcde1640 1 -- 172.21.15.190:0/727097462 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a8032440 con 0x7fe2b815e570 2024-08-18T23:56:30.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.907+0000 7fe2bcde1640 1 -- 172.21.15.190:0/727097462 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8032810 con 0x7fe2b815e570 2024-08-18T23:56:30.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.908+0000 7fe2c0047640 1 -- 172.21.15.190:0/727097462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b815e570 msgr2=0x7fe2b80722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.910 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.908+0000 7fe2c0047640 1 --2- 172.21.15.190:0/727097462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b815e570 0x7fe2b80722b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8067eb0 tx=0x7fe2a802a270 comp rx=0 tx=0).stop 2024-08-18T23:56:30.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.908+0000 7fe2c0047640 1 -- 172.21.15.190:0/727097462 shutdown_connections 2024-08-18T23:56:30.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.908+0000 7fe2c0047640 1 --2- 172.21.15.190:0/727097462 >> v2:172.21.15.103:3300/0 conn(0x7fe2b815e9e0 0x7fe2b80727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.908+0000 7fe2c0047640 1 --2- 172.21.15.190:0/727097462 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b815e570 0x7fe2b80722b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.908+0000 7fe2c0047640 1 -- 172.21.15.190:0/727097462 >> 172.21.15.190:0/727097462 conn(0x7fe2b80b2670 msgr2=0x7fe2b80b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:30.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.908+0000 7fe2c0047640 1 -- 172.21.15.190:0/727097462 shutdown_connections 2024-08-18T23:56:30.911 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.908+0000 7fe2c0047640 1 -- 172.21.15.190:0/727097462 wait complete. 2024-08-18T23:56:30.913 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.909+0000 7fe2c0047640 1 Processor -- start 2024-08-18T23:56:30.913 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.909+0000 7fe2c0047640 1 -- start start 2024-08-18T23:56:30.913 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2c0047640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b8154ec0 0x7fe2b80cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2c0047640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2b815e570 0x7fe2b8146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2c0047640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b815e9e0 0x7fe2b81e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2c0047640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b806b900 con 0x7fe2b815e570 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2c0047640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b806c560 con 0x7fe2b8154ec0 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2c0047640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b806ba80 con 0x7fe2b815e9e0 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b8154ec0 0x7fe2b80cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b8154ec0 0x7fe2b80cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56568/0 (socket says 172.21.15.190:56568) 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 -- 172.21.15.190:0/4214514548 learned_addr learned my addr 172.21.15.190:0/4214514548 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2be5e4640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b815e9e0 0x7fe2b81e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bd5e2640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2b815e570 0x7fe2b8146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 -- 172.21.15.190:0/4214514548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b815e9e0 msgr2=0x7fe2b81e9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.914 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b815e9e0 0x7fe2b81e9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.915 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 -- 172.21.15.190:0/4214514548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2b815e570 msgr2=0x7fe2b8146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.915 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2b815e570 0x7fe2b8146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.915 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 -- 172.21.15.190:0/4214514548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b8158140 con 0x7fe2b8154ec0 2024-08-18T23:56:30.915 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2bdde3640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b8154ec0 0x7fe2b80cf540 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c400 tx=0x7fe2b400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:30.915 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2ae7fc640 1 -- 172.21.15.190:0/4214514548 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40052d0 con 0x7fe2b8154ec0 2024-08-18T23:56:30.915 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2ae7fc640 1 -- 172.21.15.190:0/4214514548 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b4005490 con 0x7fe2b8154ec0 2024-08-18T23:56:30.915 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b8157b80 con 0x7fe2b8154ec0 2024-08-18T23:56:30.916 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2ae7fc640 1 -- 172.21.15.190:0/4214514548 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4007260 con 0x7fe2b8154ec0 2024-08-18T23:56:30.916 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.910+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b80ccc00 con 0x7fe2b8154ec0 2024-08-18T23:56:30.916 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.911+0000 7fe2ae7fc640 1 -- 172.21.15.190:0/4214514548 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2b4007400 con 0x7fe2b8154ec0 2024-08-18T23:56:30.916 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.911+0000 7fe2ae7fc640 1 -- 172.21.15.190:0/4214514548 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe2b4003b20 con 0x7fe2b8154ec0 2024-08-18T23:56:30.916 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.911+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b81552a0 con 0x7fe2b8154ec0 2024-08-18T23:56:30.916 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.913+0000 7fe2ae7fc640 1 -- 172.21.15.190:0/4214514548 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fe2b40035f0 con 0x7fe2b8154ec0 2024-08-18T23:56:30.933 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:30.931+0000 7f09eb00d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T23:56:30.934 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:30.933+0000 7fc5cc41c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-18T23:56:30.976 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:30.974+0000 7fc5cc41c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T23:56:30.976 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:30.974+0000 7f09eb00d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-18T23:56:30.984 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.982+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96", "id": 1} v 0) -- 0x7fe2b806d300 con 0x7fe2b8154ec0 2024-08-18T23:56:30.992 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.990+0000 7fe2ae7fc640 1 -- 172.21.15.190:0/4214514548 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe2b4003d20 con 0x7fe2b8154ec0 2024-08-18T23:56:30.992 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-08-18T23:56:30.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b8154ec0 msgr2=0x7fe2b80cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:30.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b8154ec0 0x7fe2b80cf540 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c400 tx=0x7fe2b400c8c0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.993 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 shutdown_connections 2024-08-18T23:56:30.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b815e9e0 0x7fe2b81e9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2b815e570 0x7fe2b8146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 --2- 172.21.15.190:0/4214514548 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b8154ec0 0x7fe2b80cf540 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:30.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 >> 172.21.15.190:0/4214514548 conn(0x7fe2b80b2670 msgr2=0x7fe2b80b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:30.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 shutdown_connections 2024-08-18T23:56:30.994 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:30.991+0000 7fe2c0047640 1 -- 172.21.15.190:0/4214514548 wait complete. 2024-08-18T23:56:31.003 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 6f95c531-a160-44bb-ba3b-cb14c0d8211e 2 2024-08-18T23:56:31.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.100+0000 7fec38077640 1 Processor -- start 2024-08-18T23:56:31.102 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.100+0000 7fec38077640 1 -- start start 2024-08-18T23:56:31.104 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec38077640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fec300cf810 0x7fec300cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.104 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec38077640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3006f9c0 con 0x7fec3015af20 2024-08-18T23:56:31.104 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec38077640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec300cf4d0 con 0x7fec3006e4e0 2024-08-18T23:56:31.104 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec38077640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fec300d01a0 con 0x7fec300cf810 2024-08-18T23:56:31.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec35612640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fec300cf810 0x7fec300cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec35612640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fec300cf810 0x7fec300cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56578/0 (socket says 172.21.15.190:56578) 2024-08-18T23:56:31.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec36614640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fec3006e4e0 0x7fec3006e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:49928/0 (socket says 172.21.15.190:49928) 2024-08-18T23:56:31.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec35612640 1 -- 172.21.15.190:0/2211202913 learned_addr learned my addr 172.21.15.190:0/2211202913 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec35612640 1 -- 172.21.15.190:0/2211202913 >> v1:172.21.15.190:6789/0 conn(0x7fec3006e4e0 legacy=0x7fec3006e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec35612640 1 -- 172.21.15.190:0/2211202913 >> v1:172.21.15.103:6789/0 conn(0x7fec3015af20 legacy=0x7fec300cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.102+0000 7fec35612640 1 -- 172.21.15.190:0/2211202913 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec3006fc60 con 0x7fec300cf810 2024-08-18T23:56:31.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.103+0000 7fec35612640 1 --2- 172.21.15.190:0/2211202913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec300cf810 0x7fec300cfc60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0098a0 tx=0x7fec2c02a3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfb04ed2e15037ee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.106 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.103+0000 7fec34e11640 1 -- 172.21.15.190:0/2211202913 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c037070 con 0x7fec300cf810 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.103+0000 7fec34e11640 1 -- 172.21.15.190:0/2211202913 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2c032640 con 0x7fec300cf810 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.103+0000 7fec34e11640 1 -- 172.21.15.190:0/2211202913 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2c032a10 con 0x7fec300cf810 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.104+0000 7fec38077640 1 -- 172.21.15.190:0/2211202913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec300cf810 msgr2=0x7fec300cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.104+0000 7fec38077640 1 --2- 172.21.15.190:0/2211202913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec300cf810 0x7fec300cfc60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0098a0 tx=0x7fec2c02a3c0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.104+0000 7fec38077640 1 -- 172.21.15.190:0/2211202913 shutdown_connections 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.104+0000 7fec38077640 1 --2- 172.21.15.190:0/2211202913 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec300cf810 0x7fec300cfc60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.104+0000 7fec38077640 1 -- 172.21.15.190:0/2211202913 >> 172.21.15.190:0/2211202913 conn(0x7fec300d0eb0 msgr2=0x7fec300d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.104+0000 7fec38077640 1 -- 172.21.15.190:0/2211202913 shutdown_connections 2024-08-18T23:56:31.107 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.104+0000 7fec38077640 1 -- 172.21.15.190:0/2211202913 wait complete. 2024-08-18T23:56:31.108 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.106+0000 7fec38077640 1 Processor -- start 2024-08-18T23:56:31.108 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.106+0000 7fec38077640 1 -- start start 2024-08-18T23:56:31.110 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec38077640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec3006e4e0 0x7fec301428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec38077640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec300cf810 0x7fec300cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec38077640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec3015af20 0x7fec300ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec38077640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec300cf190 con 0x7fec300cf810 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec38077640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fec300702b0 con 0x7fec3015af20 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec38077640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fec300b0700 con 0x7fec3006e4e0 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec35e13640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec3006e4e0 0x7fec301428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec35e13640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec3006e4e0 0x7fec301428e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57586/0 (socket says 172.21.15.190:57586) 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec36614640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec3015af20 0x7fec300ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec35e13640 1 -- 172.21.15.190:0/390586890 learned_addr learned my addr 172.21.15.190:0/390586890 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec35612640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec300cf810 0x7fec300cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec36614640 1 -- 172.21.15.190:0/390586890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec3006e4e0 msgr2=0x7fec301428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.111 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec36614640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec3006e4e0 0x7fec301428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec36614640 1 -- 172.21.15.190:0/390586890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec300cf810 msgr2=0x7fec300cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.107+0000 7fec36614640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec300cf810 0x7fec300cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec36614640 1 -- 172.21.15.190:0/390586890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec30147020 con 0x7fec3015af20 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec35e13640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec3006e4e0 0x7fec301428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec36614640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec3015af20 0x7fec300ae710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fec2800c720 tx=0x7fec2800cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec267fc640 1 -- 172.21.15.190:0/390586890 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28017070 con 0x7fec3015af20 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec267fc640 1 -- 172.21.15.190:0/390586890 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2800ce30 con 0x7fec3015af20 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec30147300 con 0x7fec3015af20 2024-08-18T23:56:31.112 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec267fc640 1 -- 172.21.15.190:0/390586890 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2800a840 con 0x7fec3015af20 2024-08-18T23:56:31.113 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec301478c0 con 0x7fec3015af20 2024-08-18T23:56:31.113 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec267fc640 1 -- 172.21.15.190:0/390586890 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fec2801a070 con 0x7fec3015af20 2024-08-18T23:56:31.113 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.108+0000 7fec267fc640 1 -- 172.21.15.190:0/390586890 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fec28007820 con 0x7fec3015af20 2024-08-18T23:56:31.113 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.109+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3015b300 con 0x7fec3015af20 2024-08-18T23:56:31.114 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.113+0000 7fec267fc640 1 -- 172.21.15.190:0/390586890 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fec28007070 con 0x7fec3015af20 2024-08-18T23:56:31.181 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.179+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6f95c531-a160-44bb-ba3b-cb14c0d8211e", "id": 2} v 0) -- 0x7fec300afef0 con 0x7fec3015af20 2024-08-18T23:56:31.186 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.184+0000 7fec267fc640 1 -- 172.21.15.190:0/390586890 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6f95c531-a160-44bb-ba3b-cb14c0d8211e", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fec28007350 con 0x7fec3015af20 2024-08-18T23:56:31.186 INFO:teuthology.orchestra.run.smithi190.stdout:2 2024-08-18T23:56:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec3015af20 msgr2=0x7fec300ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec3015af20 0x7fec300ae710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fec2800c720 tx=0x7fec2800cbe0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 shutdown_connections 2024-08-18T23:56:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec3015af20 0x7fec300ae710 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec300cf810 0x7fec300cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 --2- 172.21.15.190:0/390586890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec3006e4e0 0x7fec301428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 >> 172.21.15.190:0/390586890 conn(0x7fec300d0eb0 msgr2=0x7fec300d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.188 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 shutdown_connections 2024-08-18T23:56:31.188 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.185+0000 7fec38077640 1 -- 172.21.15.190:0/390586890 wait complete. 2024-08-18T23:56:31.197 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 3bec0691-db8a-4585-b836-a7514d5f4608 3 2024-08-18T23:56:31.272 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.270+0000 7fc5cc41c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T23:56:31.275 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.274+0000 7f09eb00d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-18T23:56:31.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.293+0000 7f589ce0a640 1 Processor -- start 2024-08-18T23:56:31.295 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.293+0000 7f589ce0a640 1 -- start start 2024-08-18T23:56:31.296 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.294+0000 7f589ce0a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f58980b3850 0x7f589806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.294+0000 7f589ce0a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589806c350 con 0x7f589806be40 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.294+0000 7f589ce0a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589806c630 con 0x7f58980b3c30 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.294+0000 7f589ce0a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f589806cf60 con 0x7f58980b3850 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.294+0000 7f589659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f58980b3850 0x7f589806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.294+0000 7f589659c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f58980b3850 0x7f589806b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56598/0 (socket says 172.21.15.190:56598) 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.294+0000 7f589659c640 1 -- 172.21.15.190:0/1855358405 learned_addr learned my addr 172.21.15.190:0/1855358405 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.295+0000 7f589659c640 1 -- 172.21.15.190:0/1855358405 >> v1:172.21.15.190:6789/0 conn(0x7f58980b3c30 legacy=0x7f589815f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.295+0000 7f589659c640 1 -- 172.21.15.190:0/1855358405 >> v1:172.21.15.103:6789/0 conn(0x7f589806be40 legacy=0x7f589815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.297 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.295+0000 7f589659c640 1 -- 172.21.15.190:0/1855358405 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589806c910 con 0x7f58980b3850 2024-08-18T23:56:31.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.296+0000 7f589659c640 1 --2- 172.21.15.190:0/1855358405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f589806b900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f589806d0e0 tx=0x7f588802a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a1cf08abbb44c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.296+0000 7f589559a640 1 -- 172.21.15.190:0/1855358405 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888037070 con 0x7f58980b3850 2024-08-18T23:56:31.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.296+0000 7f589559a640 1 -- 172.21.15.190:0/1855358405 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5888032640 con 0x7f58980b3850 2024-08-18T23:56:31.298 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.296+0000 7f589559a640 1 -- 172.21.15.190:0/1855358405 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888032a10 con 0x7f58980b3850 2024-08-18T23:56:31.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.296+0000 7f589ce0a640 1 -- 172.21.15.190:0/1855358405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 msgr2=0x7f589806b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.296+0000 7f589ce0a640 1 --2- 172.21.15.190:0/1855358405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f589806b900 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f589806d0e0 tx=0x7f588802a2e0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.297+0000 7f589ce0a640 1 -- 172.21.15.190:0/1855358405 shutdown_connections 2024-08-18T23:56:31.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.297+0000 7f589ce0a640 1 --2- 172.21.15.190:0/1855358405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f589806b900 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.297+0000 7f589ce0a640 1 -- 172.21.15.190:0/1855358405 >> 172.21.15.190:0/1855358405 conn(0x7f58980d0610 msgr2=0x7f58980d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.297+0000 7f589ce0a640 1 -- 172.21.15.190:0/1855358405 shutdown_connections 2024-08-18T23:56:31.299 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.297+0000 7f589ce0a640 1 -- 172.21.15.190:0/1855358405 wait complete. 2024-08-18T23:56:31.300 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.298+0000 7f589ce0a640 1 Processor -- start 2024-08-18T23:56:31.300 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.298+0000 7f589ce0a640 1 -- start start 2024-08-18T23:56:31.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589ce0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f589806be40 0x7f5898142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589ce0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f5898143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589ce0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58980b3c30 0x7f5898139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589ce0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58981692b0 con 0x7f58980b3c30 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589ce0a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5898169130 con 0x7f58980b3850 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589ce0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5898169430 con 0x7f589806be40 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f5898143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f589806be40 0x7f5898142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f5898143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56606/0 (socket says 172.21.15.190:56606) 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f589806be40 0x7f5898142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57596/0 (socket says 172.21.15.190:57596) 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 -- 172.21.15.190:0/3905872124 learned_addr learned my addr 172.21.15.190:0/3905872124 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5896d9d640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58980b3c30 0x7f5898139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 -- 172.21.15.190:0/3905872124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f589806be40 msgr2=0x7f5898142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f589806be40 0x7f5898142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 -- 172.21.15.190:0/3905872124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58980b3c30 msgr2=0x7f5898139950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58980b3c30 0x7f5898139950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 -- 172.21.15.190:0/3905872124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5898139e90 con 0x7f58980b3850 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f589659c640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f589806be40 0x7f5898142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5895d9b640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f5898143ef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c430 tx=0x7f588c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.299+0000 7f5886ffd640 1 -- 172.21.15.190:0/3905872124 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c0052d0 con 0x7f58980b3850 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.300+0000 7f5886ffd640 1 -- 172.21.15.190:0/3905872124 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f588c005490 con 0x7f58980b3850 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.300+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5898142f20 con 0x7f58980b3850 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.300+0000 7f5886ffd640 1 -- 172.21.15.190:0/3905872124 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588c007260 con 0x7f58980b3850 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.300+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58981434e0 con 0x7f58980b3850 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.300+0000 7f5886ffd640 1 -- 172.21.15.190:0/3905872124 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f588c007400 con 0x7f58980b3850 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.300+0000 7f5886ffd640 1 -- 172.21.15.190:0/3905872124 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f588c011590 con 0x7f58980b3850 2024-08-18T23:56:31.304 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.300+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589806b900 con 0x7f58980b3850 2024-08-18T23:56:31.305 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.302+0000 7f5886ffd640 1 -- 172.21.15.190:0/3905872124 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f588c0035f0 con 0x7f58980b3850 2024-08-18T23:56:31.318 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.317+0000 7fc5cc41c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T23:56:31.325 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.324+0000 7f09eb00d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-18T23:56:31.370 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.369+0000 7fc5cc41c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T23:56:31.371 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.370+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3bec0691-db8a-4585-b836-a7514d5f4608", "id": 3} v 0) -- 0x7f5898067be0 con 0x7f58980b3850 2024-08-18T23:56:31.377 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.375+0000 7f5886ffd640 1 -- 172.21.15.190:0/3905872124 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bec0691-db8a-4585-b836-a7514d5f4608", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f588c003ad0 con 0x7f58980b3850 2024-08-18T23:56:31.377 INFO:teuthology.orchestra.run.smithi190.stdout:3 2024-08-18T23:56:31.379 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 msgr2=0x7f5898143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.379 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f5898143ef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f588c00c430 tx=0x7f588c00c8f0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.379 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 shutdown_connections 2024-08-18T23:56:31.379 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58980b3c30 0x7f5898139950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.380 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58980b3850 0x7f5898143ef0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.380 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 --2- 172.21.15.190:0/3905872124 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f589806be40 0x7f5898142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.380 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 >> 172.21.15.190:0/3905872124 conn(0x7f58980d0610 msgr2=0x7f58980ae0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.380 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 shutdown_connections 2024-08-18T23:56:31.380 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.376+0000 7f589ce0a640 1 -- 172.21.15.190:0/3905872124 wait complete. 2024-08-18T23:56:31.380 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.377+0000 7f09eb00d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-18T23:56:31.388 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 1ebcbeef-b261-4928-aaac-bcfc4f059480 4 2024-08-18T23:56:31.487 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.485+0000 7ff252279640 1 Processor -- start 2024-08-18T23:56:31.487 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.485+0000 7ff252279640 1 -- start start 2024-08-18T23:56:31.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.485+0000 7ff252279640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff24c15af20 0x7ff24c0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.485+0000 7ff252279640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.485+0000 7ff252279640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff24c06f9c0 con 0x7ff24c0cfd50 2024-08-18T23:56:31.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.485+0000 7ff252279640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff24c0702b0 con 0x7ff24c15af20 2024-08-18T23:56:31.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.485+0000 7ff252279640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff24c0cf4d0 con 0x7ff24c0cefc0 2024-08-18T23:56:31.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24bfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff24c15af20 0x7ff24c0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.489 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24bfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff24c15af20 0x7ff24c0cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56614/0 (socket says 172.21.15.190:56614) 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57602/0 (socket says 172.21.15.190:57602) 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24bfff640 1 -- 172.21.15.190:0/1749278146 learned_addr learned my addr 172.21.15.190:0/1749278146 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24b7fe640 1 -- 172.21.15.190:0/1749278146 >> v2:172.21.15.190:3300/0 conn(0x7ff24c15af20 msgr2=0x7ff24c0cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24b7fe640 1 --2- 172.21.15.190:0/1749278146 >> v2:172.21.15.190:3300/0 conn(0x7ff24c15af20 0x7ff24c0cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24b7fe640 1 -- 172.21.15.190:0/1749278146 >> v1:172.21.15.190:6789/0 conn(0x7ff24c0cfd50 legacy=0x7ff24c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24b7fe640 1 -- 172.21.15.190:0/1749278146 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c06fc60 con 0x7ff24c0cefc0 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.486+0000 7ff24bfff640 1 --2- 172.21.15.190:0/1749278146 >> v2:172.21.15.190:3300/0 conn(0x7ff24c15af20 0x7ff24c0cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff24b7fe640 1 --2- 172.21.15.190:0/1749278146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c0cf810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff2400097a0 tx=0x7ff24002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2dde83281fa5ee2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff24affd640 1 -- 172.21.15.190:0/1749278146 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240037070 con 0x7ff24c0cefc0 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff24affd640 1 -- 172.21.15.190:0/1749278146 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff240032440 con 0x7ff24c0cefc0 2024-08-18T23:56:31.490 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff24affd640 1 -- 172.21.15.190:0/1749278146 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff240032810 con 0x7ff24c0cefc0 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff252279640 1 -- 172.21.15.190:0/1749278146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 msgr2=0x7ff24c0cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff252279640 1 --2- 172.21.15.190:0/1749278146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c0cf810 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff2400097a0 tx=0x7ff24002a210 comp rx=0 tx=0).stop 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff252279640 1 -- 172.21.15.190:0/1749278146 shutdown_connections 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff252279640 1 --2- 172.21.15.190:0/1749278146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c0cf810 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff252279640 1 --2- 172.21.15.190:0/1749278146 >> v2:172.21.15.190:3300/0 conn(0x7ff24c15af20 0x7ff24c0cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.487+0000 7ff252279640 1 -- 172.21.15.190:0/1749278146 >> 172.21.15.190:0/1749278146 conn(0x7ff24c0d0eb0 msgr2=0x7ff24c0d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.488+0000 7ff252279640 1 -- 172.21.15.190:0/1749278146 shutdown_connections 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.488+0000 7ff252279640 1 -- 172.21.15.190:0/1749278146 wait complete. 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.489+0000 7ff252279640 1 Processor -- start 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.489+0000 7ff252279640 1 -- start start 2024-08-18T23:56:31.494 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff252279640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c1f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff252279640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff24c0cfd50 0x7ff24c06eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff252279640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff24c15af20 0x7ff24c06f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff252279640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c0b0700 con 0x7ff24c15af20 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff252279640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff24c0d0160 con 0x7ff24c0cfd50 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff252279640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff24c147c90 con 0x7ff24c0cefc0 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c1f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c1f1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57610/0 (socket says 172.21.15.190:57610) 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 -- 172.21.15.190:0/3755283469 learned_addr learned my addr 172.21.15.190:0/3755283469 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24b7fe640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff24c0cfd50 0x7ff24c06eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff250816640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff24c15af20 0x7ff24c06f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 -- 172.21.15.190:0/3755283469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff24c0cfd50 msgr2=0x7ff24c06eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff24c0cfd50 0x7ff24c06eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.495 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 -- 172.21.15.190:0/3755283469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff24c15af20 msgr2=0x7ff24c06f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff24c15af20 0x7ff24c06f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 -- 172.21.15.190:0/3755283469 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c14b660 con 0x7ff24c0cefc0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff24bfff640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c1f1f80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00e9b0 tx=0x7ff23c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff248ff9640 1 -- 172.21.15.190:0/3755283469 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c017070 con 0x7ff24c0cefc0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff248ff9640 1 -- 172.21.15.190:0/3755283469 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff23c00c9a0 con 0x7ff24c0cefc0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24c14b900 con 0x7ff24c0cefc0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff248ff9640 1 -- 172.21.15.190:0/3755283469 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23c00cd50 con 0x7ff24c0cefc0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.490+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff24c14bec0 con 0x7ff24c0cefc0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.491+0000 7ff248ff9640 1 -- 172.21.15.190:0/3755283469 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff23c01a070 con 0x7ff24c0cefc0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.491+0000 7ff248ff9640 1 -- 172.21.15.190:0/3755283469 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff23c013470 con 0x7ff24c0cefc0 2024-08-18T23:56:31.496 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.491+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff24c15b300 con 0x7ff24c0cefc0 2024-08-18T23:56:31.497 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.493+0000 7ff248ff9640 1 -- 172.21.15.190:0/3755283469 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7ff23c006020 con 0x7ff24c0cefc0 2024-08-18T23:56:31.504 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.503+0000 7fc5cc41c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T23:56:31.520 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.519+0000 7f09eb00d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-18T23:56:31.548 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.547+0000 7fc5cc41c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T23:56:31.564 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.562+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1ebcbeef-b261-4928-aaac-bcfc4f059480", "id": 4} v 0) -- 0x7ff24c0b1910 con 0x7ff24c0cefc0 2024-08-18T23:56:31.566 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.565+0000 7f09eb00d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-18T23:56:31.570 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.568+0000 7ff248ff9640 1 -- 172.21.15.190:0/3755283469 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ebcbeef-b261-4928-aaac-bcfc4f059480", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7ff23c0064d0 con 0x7ff24c0cefc0 2024-08-18T23:56:31.570 INFO:teuthology.orchestra.run.smithi190.stdout:4 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 msgr2=0x7ff24c1f1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c1f1f80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff23c00e9b0 tx=0x7ff23c00ee70 comp rx=0 tx=0).stop 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 shutdown_connections 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff24c15af20 0x7ff24c06f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff24c0cfd50 0x7ff24c06eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 --2- 172.21.15.190:0/3755283469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff24c0cefc0 0x7ff24c1f1f80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 >> 172.21.15.190:0/3755283469 conn(0x7ff24c0d0eb0 msgr2=0x7ff24c0b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 shutdown_connections 2024-08-18T23:56:31.571 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.569+0000 7ff252279640 1 -- 172.21.15.190:0/3755283469 wait complete. 2024-08-18T23:56:31.581 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 7c35f08e-6a41-4c0a-b689-f1b0f8f502c5 5 2024-08-18T23:56:31.600 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.598+0000 7fc5cc41c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T23:56:31.622 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.620+0000 7f09eb00d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-18T23:56:31.680 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.678+0000 7ff61e6ed640 1 Processor -- start 2024-08-18T23:56:31.680 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.678+0000 7ff61e6ed640 1 -- start start 2024-08-18T23:56:31.681 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.678+0000 7ff61e6ed640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff61806fab0 0x7ff6180d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.678+0000 7ff61e6ed640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6180ced80 con 0x7ff61815e200 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.678+0000 7ff61e6ed640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff618070250 con 0x7ff6180d01f0 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.678+0000 7ff61e6ed640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff618072760 con 0x7ff61806fab0 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.679+0000 7ff6177fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff61806fab0 0x7ff6180d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.679+0000 7ff6177fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff61806fab0 0x7ff6180d19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56626/0 (socket says 172.21.15.190:56626) 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.679+0000 7ff6177fe640 1 -- 172.21.15.190:0/900222718 learned_addr learned my addr 172.21.15.190:0/900222718 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.679+0000 7ff6177fe640 1 -- 172.21.15.190:0/900222718 >> v1:172.21.15.190:6789/0 conn(0x7ff6180d01f0 legacy=0x7ff6180d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.679+0000 7ff6177fe640 1 -- 172.21.15.190:0/900222718 >> v1:172.21.15.103:6789/0 conn(0x7ff61815e200 legacy=0x7ff618073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.679+0000 7ff6177fe640 1 -- 172.21.15.190:0/900222718 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6180704f0 con 0x7ff61806fab0 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.679+0000 7ff6177fe640 1 --2- 172.21.15.190:0/900222718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61806fab0 0x7ff6180d19d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff600009870 tx=0x7ff60002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01a37a83211bffa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff616ffd640 1 -- 172.21.15.190:0/900222718 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600037070 con 0x7ff61806fab0 2024-08-18T23:56:31.682 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff616ffd640 1 -- 172.21.15.190:0/900222718 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff600032440 con 0x7ff61806fab0 2024-08-18T23:56:31.683 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff616ffd640 1 -- 172.21.15.190:0/900222718 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600032810 con 0x7ff61806fab0 2024-08-18T23:56:31.683 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff61e6ed640 1 -- 172.21.15.190:0/900222718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61806fab0 msgr2=0x7ff6180d19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.684 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff61e6ed640 1 --2- 172.21.15.190:0/900222718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61806fab0 0x7ff6180d19d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff600009870 tx=0x7ff60002a270 comp rx=0 tx=0).stop 2024-08-18T23:56:31.684 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff61e6ed640 1 -- 172.21.15.190:0/900222718 shutdown_connections 2024-08-18T23:56:31.684 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff61e6ed640 1 --2- 172.21.15.190:0/900222718 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61806fab0 0x7ff6180d19d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.684 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff61e6ed640 1 -- 172.21.15.190:0/900222718 >> 172.21.15.190:0/900222718 conn(0x7ff6180d0eb0 msgr2=0x7ff6180d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.684 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff61e6ed640 1 -- 172.21.15.190:0/900222718 shutdown_connections 2024-08-18T23:56:31.684 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.680+0000 7ff61e6ed640 1 -- 172.21.15.190:0/900222718 wait complete. 2024-08-18T23:56:31.684 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.681+0000 7ff61e6ed640 1 Processor -- start 2024-08-18T23:56:31.684 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.682+0000 7ff61e6ed640 1 -- start start 2024-08-18T23:56:31.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.682+0000 7ff61e6ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff61806fab0 0x7ff6181f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.682+0000 7ff61e6ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6180d01f0 0x7ff6181e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.682+0000 7ff61e6ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61815e200 0x7ff6180b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.686 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.682+0000 7ff61e6ed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff61815e5e0 con 0x7ff6180d01f0 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.682+0000 7ff61e6ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff618072d00 con 0x7ff61815e200 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.682+0000 7ff61e6ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff61806e4e0 con 0x7ff61806fab0 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61cc8a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61815e200 0x7ff6180b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff617fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff61806fab0 0x7ff6181f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff617fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff61806fab0 0x7ff6181f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57612/0 (socket says 172.21.15.190:57612) 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff617fff640 1 -- 172.21.15.190:0/2894908054 learned_addr learned my addr 172.21.15.190:0/2894908054 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff6177fe640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6180d01f0 0x7ff6181e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61cc8a640 1 -- 172.21.15.190:0/2894908054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff61806fab0 msgr2=0x7ff6181f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61cc8a640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff61806fab0 0x7ff6181f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61cc8a640 1 -- 172.21.15.190:0/2894908054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6180d01f0 msgr2=0x7ff6181e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61cc8a640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6180d01f0 0x7ff6181e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.687 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61cc8a640 1 -- 172.21.15.190:0/2894908054 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6181f8960 con 0x7ff61815e200 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff617fff640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff61806fab0 0x7ff6181f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61cc8a640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61815e200 0x7ff6180b1d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c6c0 tx=0x7ff61000cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff614ff9640 1 -- 172.21.15.190:0/2894908054 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610003b70 con 0x7ff61815e200 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff614ff9640 1 -- 172.21.15.190:0/2894908054 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff610003d10 con 0x7ff61815e200 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6181e6eb0 con 0x7ff61815e200 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff614ff9640 1 -- 172.21.15.190:0/2894908054 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6100052f0 con 0x7ff61815e200 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6181e7470 con 0x7ff61815e200 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff614ff9640 1 -- 172.21.15.190:0/2894908054 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff610005490 con 0x7ff61815e200 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.683+0000 7ff614ff9640 1 -- 172.21.15.190:0/2894908054 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7ff6100129f0 con 0x7ff61815e200 2024-08-18T23:56:31.688 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.684+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6180cfdd0 con 0x7ff61815e200 2024-08-18T23:56:31.689 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.686+0000 7ff614ff9640 1 -- 172.21.15.190:0/2894908054 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7ff6180cfdd0 con 0x7ff61815e200 2024-08-18T23:56:31.749 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.747+0000 7fc5cc41c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T23:56:31.757 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.755+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c35f08e-6a41-4c0a-b689-f1b0f8f502c5", "id": 5} v 0) -- 0x7ff618073a10 con 0x7ff61815e200 2024-08-18T23:56:31.762 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.760+0000 7ff614ff9640 1 -- 172.21.15.190:0/2894908054 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c35f08e-6a41-4c0a-b689-f1b0f8f502c5", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7ff610012c40 con 0x7ff61815e200 2024-08-18T23:56:31.762 INFO:teuthology.orchestra.run.smithi190.stdout:5 2024-08-18T23:56:31.763 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61815e200 msgr2=0x7ff6180b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.763 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61815e200 0x7ff6180b1d20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c6c0 tx=0x7ff61000cb80 comp rx=0 tx=0).stop 2024-08-18T23:56:31.763 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 shutdown_connections 2024-08-18T23:56:31.764 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff61815e200 0x7ff6180b1d20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.764 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6180d01f0 0x7ff6181e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.764 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 --2- 172.21.15.190:0/2894908054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff61806fab0 0x7ff6181f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.764 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 >> 172.21.15.190:0/2894908054 conn(0x7ff6180d0eb0 msgr2=0x7ff6180d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.764 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 shutdown_connections 2024-08-18T23:56:31.764 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.761+0000 7ff61e6ed640 1 -- 172.21.15.190:0/2894908054 wait complete. 2024-08-18T23:56:31.774 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 89517b57-3fe1-4fce-ab99-9bd7459c26cb 6 2024-08-18T23:56:31.781 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.779+0000 7f09eb00d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-18T23:56:31.807 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.805+0000 7fc5cc41c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T23:56:31.847 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.845+0000 7f09eb00d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-18T23:56:31.851 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.850+0000 7fc5cc41c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T23:56:31.879 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.877+0000 7f8e35b81640 1 Processor -- start 2024-08-18T23:56:31.880 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.877+0000 7f8e35b81640 1 -- start start 2024-08-18T23:56:31.881 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e35b81640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8e300cf810 0x7f8e300cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e35b81640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8e3006e4e0 0x7f8e3006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e35b81640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e3006f9c0 con 0x7f8e3015af20 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e35b81640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8e300d01a0 con 0x7f8e3006e4e0 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e35b81640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8e300702b0 con 0x7f8e300cf810 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e27fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8e300cf810 0x7f8e300cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e27fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8e300cf810 0x7f8e300cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56646/0 (socket says 172.21.15.190:56646) 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e27fff640 1 -- 172.21.15.190:0/476299817 learned_addr learned my addr 172.21.15.190:0/476299817 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e2ffff640 1 --2- 172.21.15.190:0/476299817 >> v2:172.21.15.103:3300/0 conn(0x7f8e3006e4e0 0x7f8e3006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e27fff640 1 -- 172.21.15.190:0/476299817 >> v2:172.21.15.103:3300/0 conn(0x7f8e3006e4e0 msgr2=0x7f8e3006e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e27fff640 1 --2- 172.21.15.190:0/476299817 >> v2:172.21.15.103:3300/0 conn(0x7f8e3006e4e0 0x7f8e3006e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.882 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e27fff640 1 -- 172.21.15.190:0/476299817 >> v1:172.21.15.103:6789/0 conn(0x7f8e3015af20 legacy=0x7f8e300cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.879+0000 7f8e27fff640 1 -- 172.21.15.190:0/476299817 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e300cf4d0 con 0x7f8e300cf810 2024-08-18T23:56:31.883 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.880+0000 7f8e27fff640 1 --2- 172.21.15.190:0/476299817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e300cf810 0x7f8e300cfc60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009870 tx=0x7f8e1802a330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813afb35899b4e11 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.880+0000 7f8e2effd640 1 -- 172.21.15.190:0/476299817 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18037070 con 0x7f8e300cf810 2024-08-18T23:56:31.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.880+0000 7f8e2effd640 1 -- 172.21.15.190:0/476299817 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e18032640 con 0x7f8e300cf810 2024-08-18T23:56:31.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.880+0000 7f8e2effd640 1 -- 172.21.15.190:0/476299817 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18032a10 con 0x7f8e300cf810 2024-08-18T23:56:31.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.881+0000 7f8e35b81640 1 -- 172.21.15.190:0/476299817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e300cf810 msgr2=0x7f8e300cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.881+0000 7f8e35b81640 1 --2- 172.21.15.190:0/476299817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e300cf810 0x7f8e300cfc60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009870 tx=0x7f8e1802a330 comp rx=0 tx=0).stop 2024-08-18T23:56:31.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.881+0000 7f8e35b81640 1 -- 172.21.15.190:0/476299817 shutdown_connections 2024-08-18T23:56:31.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.881+0000 7f8e35b81640 1 --2- 172.21.15.190:0/476299817 >> v2:172.21.15.103:3300/0 conn(0x7f8e3006e4e0 0x7f8e3006e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.884 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.881+0000 7f8e35b81640 1 --2- 172.21.15.190:0/476299817 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e300cf810 0x7f8e300cfc60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.885 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.881+0000 7f8e35b81640 1 -- 172.21.15.190:0/476299817 >> 172.21.15.190:0/476299817 conn(0x7f8e300d0eb0 msgr2=0x7f8e300d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.885 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.881+0000 7f8e35b81640 1 -- 172.21.15.190:0/476299817 shutdown_connections 2024-08-18T23:56:31.885 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.881+0000 7f8e35b81640 1 -- 172.21.15.190:0/476299817 wait complete. 2024-08-18T23:56:31.885 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.882+0000 7f8e35b81640 1 Processor -- start 2024-08-18T23:56:31.885 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.882+0000 7f8e35b81640 1 -- start start 2024-08-18T23:56:31.887 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e35b81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3006e4e0 0x7f8e3009d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.887 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e35b81640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e300cf810 0x7f8e30153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.887 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e35b81640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015af20 0x7f8e30156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:31.887 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e35b81640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e300cf190 con 0x7f8e300cf810 2024-08-18T23:56:31.887 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e35b81640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3006ff40 con 0x7f8e3006e4e0 2024-08-18T23:56:31.887 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e35b81640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e300b0700 con 0x7f8e3015af20 2024-08-18T23:56:31.887 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3006e4e0 0x7f8e3009d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.887 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015af20 0x7f8e30156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3006e4e0 0x7f8e3009d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56662/0 (socket says 172.21.15.190:56662) 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2f7fe640 1 -- 172.21.15.190:0/41179228 learned_addr learned my addr 172.21.15.190:0/41179228 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e27fff640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e300cf810 0x7f8e30153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2ffff640 1 -- 172.21.15.190:0/41179228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3006e4e0 msgr2=0x7f8e3009d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2ffff640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3006e4e0 0x7f8e3009d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2ffff640 1 -- 172.21.15.190:0/41179228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e300cf810 msgr2=0x7f8e30153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2ffff640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e300cf810 0x7f8e30153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2ffff640 1 -- 172.21.15.190:0/41179228 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e301f4790 con 0x7f8e3015af20 2024-08-18T23:56:31.888 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2f7fe640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3006e4e0 0x7f8e3009d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2ffff640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015af20 0x7f8e30156580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800efc0 tx=0x7f8e2800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2cff9640 1 -- 172.21.15.190:0/41179228 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28018020 con 0x7f8e3015af20 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2cff9640 1 -- 172.21.15.190:0/41179228 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e28014480 con 0x7f8e3015af20 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e30154250 con 0x7f8e3015af20 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.883+0000 7f8e2cff9640 1 -- 172.21.15.190:0/41179228 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28014870 con 0x7f8e3015af20 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.884+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e301f4d10 con 0x7f8e3015af20 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.884+0000 7f8e2cff9640 1 -- 172.21.15.190:0/41179228 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e28005d10 con 0x7f8e3015af20 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.884+0000 7f8e2cff9640 1 -- 172.21.15.190:0/41179228 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f8e280139d0 con 0x7f8e3015af20 2024-08-18T23:56:31.889 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.884+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3015b300 con 0x7f8e3015af20 2024-08-18T23:56:31.890 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.888+0000 7f8e2cff9640 1 -- 172.21.15.190:0/41179228 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f8e28022030 con 0x7f8e3015af20 2024-08-18T23:56:31.897 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.895+0000 7f09eb00d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-18T23:56:31.906 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:31.905+0000 7fc5cc41c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T23:56:31.957 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:31.955+0000 7f09eb00d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-18T23:56:31.958 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.957+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "89517b57-3fe1-4fce-ab99-9bd7459c26cb", "id": 6} v 0) -- 0x7f8e300cbed0 con 0x7f8e3015af20 2024-08-18T23:56:31.964 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.962+0000 7f8e2cff9640 1 -- 172.21.15.190:0/41179228 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89517b57-3fe1-4fce-ab99-9bd7459c26cb", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f8e28010040 con 0x7f8e3015af20 2024-08-18T23:56:31.964 INFO:teuthology.orchestra.run.smithi190.stdout:6 2024-08-18T23:56:31.965 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015af20 msgr2=0x7f8e30156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:31.965 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015af20 0x7f8e30156580 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800efc0 tx=0x7f8e2800c490 comp rx=0 tx=0).stop 2024-08-18T23:56:31.965 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 shutdown_connections 2024-08-18T23:56:31.965 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e3015af20 0x7f8e30156580 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.966 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e300cf810 0x7f8e30153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.966 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 --2- 172.21.15.190:0/41179228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e3006e4e0 0x7f8e3009d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:31.966 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 >> 172.21.15.190:0/41179228 conn(0x7f8e300d0eb0 msgr2=0x7f8e300b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:31.966 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 shutdown_connections 2024-08-18T23:56:31.966 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:31.963+0000 7f8e35b81640 1 -- 172.21.15.190:0/41179228 wait complete. 2024-08-18T23:56:31.976 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new ea9953da-93fc-481f-bf91-afcbaa141807 7 2024-08-18T23:56:32.067 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:32.066+0000 7fc5cc41c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T23:56:32.075 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.073+0000 7f02ff4e6640 1 Processor -- start 2024-08-18T23:56:32.075 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.073+0000 7f02ff4e6640 1 -- start start 2024-08-18T23:56:32.077 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02ff4e6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f02f8154ec0 0x7f02f806cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.077 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02ff4e6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f815e570 0x7f02f80722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.077 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02ff4e6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f02f815e9b0 0x7f02f80727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.077 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02ff4e6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f02f806c840 con 0x7f02f8154ec0 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02ff4e6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f02f806fb10 con 0x7f02f815e9b0 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02ff4e6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f02f806d0f0 con 0x7f02f815e570 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fca81640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f815e570 0x7f02f80722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fda83640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f02f815e9b0 0x7f02f80727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fca81640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f815e570 0x7f02f80722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57632/0 (socket says 172.21.15.190:57632) 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fca81640 1 -- 172.21.15.190:0/1766095682 learned_addr learned my addr 172.21.15.190:0/1766095682 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fd282640 1 --2- 172.21.15.190:0/1766095682 >> v2:172.21.15.103:3300/0 conn(0x7f02f8154ec0 0x7f02f806cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fda83640 1 -- 172.21.15.190:0/1766095682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f815e570 msgr2=0x7f02f80722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fda83640 1 --2- 172.21.15.190:0/1766095682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f815e570 0x7f02f80722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fda83640 1 -- 172.21.15.190:0/1766095682 >> v2:172.21.15.103:3300/0 conn(0x7f02f8154ec0 msgr2=0x7f02f806cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:32.078 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fda83640 1 --2- 172.21.15.190:0/1766095682 >> v2:172.21.15.103:3300/0 conn(0x7f02f8154ec0 0x7f02f806cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fda83640 1 -- 172.21.15.190:0/1766095682 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f806bcc0 con 0x7f02f815e9b0 2024-08-18T23:56:32.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.074+0000 7f02fca81640 1 --2- 172.21.15.190:0/1766095682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f815e570 0x7f02f80722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:32.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.075+0000 7f02fda83640 1 --2- 172.21.15.190:0/1766095682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e9b0 0x7f02f80727f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f02f8067eb0 tx=0x7f02f002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db14525aba07d09 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:32.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.075+0000 7f02effff640 1 -- 172.21.15.190:0/1766095682 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0031600 con 0x7f02f815e9b0 2024-08-18T23:56:32.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.075+0000 7f02effff640 1 -- 172.21.15.190:0/1766095682 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f00317a0 con 0x7f02f815e9b0 2024-08-18T23:56:32.079 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.075+0000 7f02effff640 1 -- 172.21.15.190:0/1766095682 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f0031b70 con 0x7f02f815e9b0 2024-08-18T23:56:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1766095682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e9b0 msgr2=0x7f02f80727f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 --2- 172.21.15.190:0/1766095682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e9b0 0x7f02f80727f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f02f8067eb0 tx=0x7f02f002a5d0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1766095682 shutdown_connections 2024-08-18T23:56:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 --2- 172.21.15.190:0/1766095682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e9b0 0x7f02f80727f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 --2- 172.21.15.190:0/1766095682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f815e570 0x7f02f80722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.082 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 --2- 172.21.15.190:0/1766095682 >> v2:172.21.15.103:3300/0 conn(0x7f02f8154ec0 0x7f02f806cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1766095682 >> 172.21.15.190:0/1766095682 conn(0x7f02f80b2670 msgr2=0x7f02f80b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1766095682 shutdown_connections 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.076+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1766095682 wait complete. 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.077+0000 7f02ff4e6640 1 Processor -- start 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.077+0000 7f02ff4e6640 1 -- start start 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02ff4e6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f8154ec0 0x7f02f8151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02ff4e6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e570 0x7f02f8141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02ff4e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f815e9b0 0x7f02f814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02ff4e6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f02f806c560 con 0x7f02f815e9b0 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02ff4e6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f02f806c280 con 0x7f02f815e570 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02ff4e6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f02f806b900 con 0x7f02f8154ec0 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fca81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e570 0x7f02f8141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.083 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fd282640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f8154ec0 0x7f02f8151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fca81640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e570 0x7f02f8141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:56680/0 (socket says 172.21.15.190:56680) 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fca81640 1 -- 172.21.15.190:0/1102106654 learned_addr learned my addr 172.21.15.190:0/1102106654 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fd282640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f8154ec0 0x7f02f8151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:57644/0 (socket says 172.21.15.190:57644) 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fda83640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f815e9b0 0x7f02f814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fca81640 1 -- 172.21.15.190:0/1102106654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f8154ec0 msgr2=0x7f02f8151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fca81640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f8154ec0 0x7f02f8151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fca81640 1 -- 172.21.15.190:0/1102106654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f815e9b0 msgr2=0x7f02f814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fca81640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f815e9b0 0x7f02f814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fca81640 1 -- 172.21.15.190:0/1102106654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f81418a0 con 0x7f02f815e570 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.078+0000 7f02fd282640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f8154ec0 0x7f02f8151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.079+0000 7f02fca81640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e570 0x7f02f8141360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f02f400e9d0 tx=0x7f02f400ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.079+0000 7f02edffb640 1 -- 172.21.15.190:0/1102106654 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4017070 con 0x7f02f815e570 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.079+0000 7f02edffb640 1 -- 172.21.15.190:0/1102106654 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f400ca60 con 0x7f02f815e570 2024-08-18T23:56:32.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.079+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f814ba20 con 0x7f02f815e570 2024-08-18T23:56:32.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.079+0000 7f02edffb640 1 -- 172.21.15.190:0/1102106654 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f400ce10 con 0x7f02f815e570 2024-08-18T23:56:32.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.079+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f814e750 con 0x7f02f815e570 2024-08-18T23:56:32.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.079+0000 7f02edffb640 1 -- 172.21.15.190:0/1102106654 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02f401a070 con 0x7f02f815e570 2024-08-18T23:56:32.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.079+0000 7f02edffb640 1 -- 172.21.15.190:0/1102106654 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f02f401cab0 con 0x7f02f815e570 2024-08-18T23:56:32.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.080+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f81552a0 con 0x7f02f815e570 2024-08-18T23:56:32.085 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.082+0000 7f02edffb640 1 -- 172.21.15.190:0/1102106654 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f02f401c450 con 0x7f02f815e570 2024-08-18T23:56:32.111 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:32.110+0000 7fc5cc41c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T23:56:32.128 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:32.126+0000 7f09eb00d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-18T23:56:32.150 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.148+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea9953da-93fc-481f-bf91-afcbaa141807", "id": 7} v 0) -- 0x7f02f80aed40 con 0x7f02f815e570 2024-08-18T23:56:32.158 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.156+0000 7f02edffb640 1 -- 172.21.15.190:0/1102106654 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea9953da-93fc-481f-bf91-afcbaa141807", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f02f401c630 con 0x7f02f815e570 2024-08-18T23:56:32.158 INFO:teuthology.orchestra.run.smithi190.stdout:7 2024-08-18T23:56:32.159 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e570 msgr2=0x7f02f8141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e570 0x7f02f8141360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f02f400e9d0 tx=0x7f02f400ee90 comp rx=0 tx=0).stop 2024-08-18T23:56:32.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 shutdown_connections 2024-08-18T23:56:32.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02f815e9b0 0x7f02f814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f815e570 0x7f02f8141360 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 --2- 172.21.15.190:0/1102106654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f8154ec0 0x7f02f8151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 >> 172.21.15.190:0/1102106654 conn(0x7f02f80b2670 msgr2=0x7f02f80b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:32.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 shutdown_connections 2024-08-18T23:56:32.160 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:56:32.157+0000 7f02ff4e6640 1 -- 172.21.15.190:0/1102106654 wait complete. 2024-08-18T23:56:32.170 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-18T23:56:32.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-18T23:56:32.172 INFO:tasks.ceph.osd.0:Started 2024-08-18T23:56:32.172 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-18T23:56:32.172 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-18T23:56:32.173 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:32.172+0000 7f09eb00d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-18T23:56:32.174 INFO:tasks.ceph.osd.1:Started 2024-08-18T23:56:32.174 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-18T23:56:32.174 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-18T23:56:32.177 INFO:tasks.ceph.osd.2:Started 2024-08-18T23:56:32.177 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-18T23:56:32.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-18T23:56:32.179 INFO:tasks.ceph.osd.3:Started 2024-08-18T23:56:32.179 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-18T23:56:32.179 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-18T23:56:32.181 INFO:tasks.ceph.osd.4:Started 2024-08-18T23:56:32.181 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-18T23:56:32.181 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-18T23:56:32.184 INFO:tasks.ceph.osd.5:Started 2024-08-18T23:56:32.184 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-18T23:56:32.184 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-18T23:56:32.186 INFO:tasks.ceph.osd.6:Started 2024-08-18T23:56:32.186 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-18T23:56:32.186 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-18T23:56:32.188 INFO:tasks.ceph.osd.7:Started 2024-08-18T23:56:32.189 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:56:32.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.304+0000 7f00670f4640 1 Processor -- start 2024-08-18T23:56:32.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.304+0000 7f00670f4640 1 -- start start 2024-08-18T23:56:32.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f00670f4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f006015a730 0x7f006006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f00670f4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f00600b5970 0x7f006006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f00670f4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f006015e160 con 0x7f006015a350 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f00670f4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f006006ed40 con 0x7f006015a730 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f00670f4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f006015e440 con 0x7f00600b5970 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f005ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f006015a730 0x7f006006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f0064e90640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f006015a350 0x7f00600cfd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:36380/0 (socket says 172.21.15.103:36380) 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f0064e90640 1 -- 172.21.15.103:0/1189939582 learned_addr learned my addr 172.21.15.103:0/1189939582 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f0065691640 1 --2- 172.21.15.103:0/1189939582 >> v2:172.21.15.190:3300/0 conn(0x7f00600b5970 0x7f006006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f005ffff640 1 -- 172.21.15.103:0/1189939582 >> v2:172.21.15.190:3300/0 conn(0x7f00600b5970 msgr2=0x7f006006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f005ffff640 1 --2- 172.21.15.103:0/1189939582 >> v2:172.21.15.190:3300/0 conn(0x7f00600b5970 0x7f006006ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f005ffff640 1 -- 172.21.15.103:0/1189939582 >> v1:172.21.15.103:6789/0 conn(0x7f006015a350 legacy=0x7f00600cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f005f7fe640 1 -- 172.21.15.103:0/1189939582 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043247515 0 0) 0x7f006015e160 con 0x7f006015a350 2024-08-18T23:56:32.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.305+0000 7f005ffff640 1 -- 172.21.15.103:0/1189939582 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006015e720 con 0x7f006015a730 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.306+0000 7f005ffff640 1 --2- 172.21.15.103:0/1189939582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a730 0x7f006006c910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00600cfce0 tx=0x7f004c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145c973ac4273e98 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.306+0000 7f005f7fe640 1 -- 172.21.15.103:0/1189939582 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c037070 con 0x7f006015a730 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.306+0000 7f005f7fe640 1 -- 172.21.15.103:0/1189939582 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c032440 con 0x7f006015a730 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.306+0000 7f005f7fe640 1 -- 172.21.15.103:0/1189939582 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c032810 con 0x7f006015a730 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.307+0000 7f00670f4640 1 -- 172.21.15.103:0/1189939582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a730 msgr2=0x7f006006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.307+0000 7f00670f4640 1 --2- 172.21.15.103:0/1189939582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a730 0x7f006006c910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00600cfce0 tx=0x7f004c02a1a0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.307+0000 7f00670f4640 1 -- 172.21.15.103:0/1189939582 shutdown_connections 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.307+0000 7f00670f4640 1 --2- 172.21.15.103:0/1189939582 >> v2:172.21.15.190:3300/0 conn(0x7f00600b5970 0x7f006006ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.307+0000 7f00670f4640 1 --2- 172.21.15.103:0/1189939582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a730 0x7f006006c910 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.307+0000 7f00670f4640 1 -- 172.21.15.103:0/1189939582 >> 172.21.15.103:0/1189939582 conn(0x7f00600b2a90 msgr2=0x7f0060071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.307+0000 7f00670f4640 1 -- 172.21.15.103:0/1189939582 shutdown_connections 2024-08-18T23:56:32.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.307+0000 7f00670f4640 1 -- 172.21.15.103:0/1189939582 wait complete. 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.308+0000 7f00670f4640 1 Processor -- start 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.308+0000 7f00670f4640 1 -- start start 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f00670f4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b5970 0x7f006014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f00670f4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a350 0x7f0060150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f00670f4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f006015a730 0x7f00600b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f00670f4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00600ce850 con 0x7f006015a350 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f00670f4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f00600ce6d0 con 0x7f00600b5970 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f00670f4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0060067680 con 0x7f006015a730 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a350 0x7f0060150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a350 0x7f0060150cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60032/0 (socket says 172.21.15.103:60032) 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 -- 172.21.15.103:0/3589000635 learned_addr learned my addr 172.21.15.103:0/3589000635 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:32.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f0064e90640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b5970 0x7f006014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f0065691640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f006015a730 0x7f00600b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 -- 172.21.15.103:0/3589000635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f006015a730 msgr2=0x7f00600b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f006015a730 0x7f00600b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 -- 172.21.15.103:0/3589000635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b5970 msgr2=0x7f006014cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b5970 0x7f006014cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 -- 172.21.15.103:0/3589000635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0060151200 con 0x7f006015a350 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.309+0000 7f005ffff640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a350 0x7f0060150cc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f004c009890 tx=0x7f004c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.310+0000 7f005d7fa640 1 -- 172.21.15.103:0/3589000635 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c037040 con 0x7f006015a350 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.310+0000 7f005d7fa640 1 -- 172.21.15.103:0/3589000635 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c042070 con 0x7f006015a350 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.310+0000 7f005d7fa640 1 -- 172.21.15.103:0/3589000635 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c030bd0 con 0x7f006015a350 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.310+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0060151780 con 0x7f006015a350 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.310+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006014c070 con 0x7f006015a350 2024-08-18T23:56:32.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.310+0000 7f005d7fa640 1 -- 172.21.15.103:0/3589000635 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f004c047460 con 0x7f006015a350 2024-08-18T23:56:32.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.310+0000 7f005d7fa640 1 -- 172.21.15.103:0/3589000635 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f004c03db10 con 0x7f006015a350 2024-08-18T23:56:32.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.311+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00600733f0 con 0x7f006015a350 2024-08-18T23:56:32.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.313+0000 7f005d7fa640 1 -- 172.21.15.103:0/3589000635 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f004c03dde0 con 0x7f006015a350 2024-08-18T23:56:32.318 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:32.317+0000 7fc5cc41c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T23:56:32.359 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:32.358+0000 7f09eb00d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-18T23:56:32.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.370+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f006006cb10 con 0x7f006015a350 2024-08-18T23:56:32.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.371+0000 7f005d7fa640 1 -- 172.21.15.103:0/3589000635 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f004c03d440 con 0x7f006015a350 2024-08-18T23:56:32.372 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:56:32.372 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":10,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:32.151302+0000","last_up_change":"0.000000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:56:32.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a350 msgr2=0x7f0060150cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:32.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a350 0x7f0060150cc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f004c009890 tx=0x7f004c0046c0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 shutdown_connections 2024-08-18T23:56:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f006015a730 0x7f00600b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f006015a350 0x7f0060150cc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 --2- 172.21.15.103:0/3589000635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00600b5970 0x7f006014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 >> 172.21.15.103:0/3589000635 conn(0x7f00600b2a90 msgr2=0x7f006014e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 shutdown_connections 2024-08-18T23:56:32.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:32.372+0000 7f00670f4640 1 -- 172.21.15.103:0/3589000635 wait complete. 2024-08-18T23:56:32.383 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-18T23:56:32.384 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-18T23:56:32.607 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:32.606+0000 7fc5cc41c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T23:56:32.643 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:32.641+0000 7f09eb00d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-18T23:56:32.779 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-08-18T23:56:32.778+0000 7f3742816640 -1 Falling back to public interface 2024-08-18T23:56:32.785 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-08-18T23:56:32.783+0000 7f8795a12640 -1 Falling back to public interface 2024-08-18T23:56:32.788 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-08-18T23:56:32.787+0000 7f2d2a80c640 -1 Falling back to public interface 2024-08-18T23:56:32.790 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-08-18T23:56:32.788+0000 7f4ea5631640 -1 Falling back to public interface 2024-08-18T23:56:32.796 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-08-18T23:56:32.795+0000 7fad12d57640 -1 Falling back to public interface 2024-08-18T23:56:32.802 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-08-18T23:56:32.800+0000 7f9ff5a12640 -1 Falling back to public interface 2024-08-18T23:56:32.807 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-08-18T23:56:32.805+0000 7f3cbac27640 -1 Falling back to public interface 2024-08-18T23:56:32.809 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-08-18T23:56:32.808+0000 7ff350015640 -1 Falling back to public interface 2024-08-18T23:56:32.963 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:32.962+0000 7fc5cc41c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-18T23:56:32.998 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:32.996+0000 7f09eb00d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-18T23:56:33.004 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:33.003+0000 7fc5cc41c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T23:56:33.039 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:33.037+0000 7f09eb00d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-18T23:56:33.047 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:33.046+0000 7fc5cc41c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T23:56:33.085 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-08-18T23:56:33.083+0000 7f09eb00d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-18T23:56:33.190 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T23:56:33.283 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.281+0000 7efeb80ed640 1 Processor -- start 2024-08-18T23:56:33.283 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.281+0000 7efeb80ed640 1 -- start start 2024-08-18T23:56:33.284 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.282+0000 7efeb80ed640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efeb015afd0 0x7efeb00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:33.284 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.282+0000 7efeb80ed640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb00b5520 con 0x7efeb00b4c00 2024-08-18T23:56:33.284 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.282+0000 7efeb80ed640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb006ef80 con 0x7efeb00b42c0 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.282+0000 7efeb80ed640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7efeb006fbe0 con 0x7efeb015afd0 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.282+0000 7efeb5e89640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efeb00b4c00 0x7efeb0070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49364/0 (socket says 172.21.15.103:49364) 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.282+0000 7efeb5e89640 1 -- 172.21.15.103:0/2781240541 learned_addr learned my addr 172.21.15.103:0/2781240541 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.283+0000 7efeb5688640 1 --2- 172.21.15.103:0/2781240541 >> v2:172.21.15.190:3300/0 conn(0x7efeb015afd0 0x7efeb00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.283+0000 7efeb4e87640 1 -- 172.21.15.103:0/2781240541 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2447973506 0 0) 0x7efeb00b5520 con 0x7efeb00b4c00 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.283+0000 7efeb4e87640 1 -- 172.21.15.103:0/2781240541 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe9c003520 con 0x7efeb00b4c00 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.283+0000 7efeb5688640 1 -- 172.21.15.103:0/2781240541 >> v1:172.21.15.190:6789/0 conn(0x7efeb00b42c0 legacy=0x7efeb00ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.283+0000 7efeb5688640 1 -- 172.21.15.103:0/2781240541 >> v1:172.21.15.103:6789/0 conn(0x7efeb00b4c00 legacy=0x7efeb0070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:33.285 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.283+0000 7efeb5688640 1 -- 172.21.15.103:0/2781240541 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb006f590 con 0x7efeb015afd0 2024-08-18T23:56:33.286 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb5688640 1 --2- 172.21.15.103:0/2781240541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb015afd0 0x7efeb00b4fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efea00097a0 tx=0x7efea002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f95c8bae703e7ddc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:33.286 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb4e87640 1 -- 172.21.15.103:0/2781240541 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0037070 con 0x7efeb015afd0 2024-08-18T23:56:33.286 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb4e87640 1 -- 172.21.15.103:0/2781240541 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea0032440 con 0x7efeb015afd0 2024-08-18T23:56:33.286 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb4e87640 1 -- 172.21.15.103:0/2781240541 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea00327f0 con 0x7efeb015afd0 2024-08-18T23:56:33.287 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb80ed640 1 -- 172.21.15.103:0/2781240541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb015afd0 msgr2=0x7efeb00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:33.287 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb80ed640 1 --2- 172.21.15.103:0/2781240541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb015afd0 0x7efeb00b4fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efea00097a0 tx=0x7efea002a230 comp rx=0 tx=0).stop 2024-08-18T23:56:33.287 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb80ed640 1 -- 172.21.15.103:0/2781240541 shutdown_connections 2024-08-18T23:56:33.287 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb80ed640 1 --2- 172.21.15.103:0/2781240541 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb015afd0 0x7efeb00b4fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:33.287 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb80ed640 1 -- 172.21.15.103:0/2781240541 >> 172.21.15.103:0/2781240541 conn(0x7efeb006c950 msgr2=0x7efeb006cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:33.287 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb80ed640 1 -- 172.21.15.103:0/2781240541 shutdown_connections 2024-08-18T23:56:33.287 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.284+0000 7efeb80ed640 1 -- 172.21.15.103:0/2781240541 wait complete. 2024-08-18T23:56:33.289 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb80ed640 1 Processor -- start 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb80ed640 1 -- start start 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb80ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb00b42c0 0x7efeb009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb80ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb00b4c00 0x7efeb0156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb80ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb015afd0 0x7efeb014d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb80ed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efeb006ec00 con 0x7efeb00b4c00 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb80ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efeb006ea80 con 0x7efeb00b42c0 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb80ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efeb00d14a0 con 0x7efeb015afd0 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb5688640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb00b4c00 0x7efeb0156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb5688640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb00b4c00 0x7efeb0156d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45204/0 (socket says 172.21.15.103:45204) 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.286+0000 7efeb5688640 1 -- 172.21.15.103:0/3902788581 learned_addr learned my addr 172.21.15.103:0/3902788581 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb5e89640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb00b42c0 0x7efeb009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb668a640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb015afd0 0x7efeb014d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:33.290 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb5688640 1 -- 172.21.15.103:0/3902788581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb015afd0 msgr2=0x7efeb014d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb5688640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb015afd0 0x7efeb014d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb5688640 1 -- 172.21.15.103:0/3902788581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb00b42c0 msgr2=0x7efeb009aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb5688640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb00b42c0 0x7efeb009aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb5688640 1 -- 172.21.15.103:0/3902788581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb009b160 con 0x7efeb00b4c00 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb5688640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb00b4c00 0x7efeb0156d20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efea0000c00 tx=0x7efea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efea67fc640 1 -- 172.21.15.103:0/3902788581 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0037050 con 0x7efeb00b4c00 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efea67fc640 1 -- 172.21.15.103:0/3902788581 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea0038040 con 0x7efeb00b4c00 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb009b440 con 0x7efeb00b4c00 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efea67fc640 1 -- 172.21.15.103:0/3902788581 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0004450 con 0x7efeb00b4c00 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb009ba00 con 0x7efeb00b4c00 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efea67fc640 1 -- 172.21.15.103:0/3902788581 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efea003c6d0 con 0x7efeb00b4c00 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.287+0000 7efea67fc640 1 -- 172.21.15.103:0/3902788581 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7efea003e450 con 0x7efeb00b4c00 2024-08-18T23:56:33.291 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.288+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb00b4fe0 con 0x7efeb00b4c00 2024-08-18T23:56:33.292 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.290+0000 7efea67fc640 1 -- 172.21.15.103:0/3902788581 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7efea003cb50 con 0x7efeb00b4c00 2024-08-18T23:56:33.350 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.348+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efeb006d140 con 0x7efeb00b4c00 2024-08-18T23:56:33.350 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.349+0000 7efea67fc640 1 -- 172.21.15.103:0/3902788581 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7efea003cd30 con 0x7efeb00b4c00 2024-08-18T23:56:33.350 INFO:teuthology.misc.health.smithi103.stdout: 2024-08-18T23:56:33.351 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":10,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:32.151302+0000","last_up_change":"0.000000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:56:33.351 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb00b4c00 msgr2=0x7efeb0156d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:33.351 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb00b4c00 0x7efeb0156d20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efea0000c00 tx=0x7efea00046c0 comp rx=0 tx=0).stop 2024-08-18T23:56:33.352 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 shutdown_connections 2024-08-18T23:56:33.352 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb015afd0 0x7efeb014d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:33.352 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efeb00b4c00 0x7efeb0156d20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:33.352 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 --2- 172.21.15.103:0/3902788581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb00b42c0 0x7efeb009aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:33.352 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 >> 172.21.15.103:0/3902788581 conn(0x7efeb006c950 msgr2=0x7efeb00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:33.352 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 shutdown_connections 2024-08-18T23:56:33.352 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:33.350+0000 7efeb80ed640 1 -- 172.21.15.103:0/3902788581 wait complete. 2024-08-18T23:56:33.360 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-18T23:56:35.169 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:35.168+0000 7fc56c173640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-18T23:56:35.171 INFO:tasks.ceph.mgr.y.smithi103.stderr:2024-08-18T23:56:35.170+0000 7fc56c173640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-18T23:56:36.245 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-08-18T23:56:36.244+0000 7f3742816640 -1 osd.1 0 log_to_monitors true 2024-08-18T23:56:36.274 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-08-18T23:56:36.273+0000 7f2d2a80c640 -1 osd.0 0 log_to_monitors true 2024-08-18T23:56:36.275 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-08-18T23:56:36.274+0000 7f4ea5631640 -1 osd.7 0 log_to_monitors true 2024-08-18T23:56:36.281 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-08-18T23:56:36.280+0000 7f9ff5a12640 -1 osd.4 0 log_to_monitors true 2024-08-18T23:56:36.285 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-08-18T23:56:36.284+0000 7f8795a12640 -1 osd.5 0 log_to_monitors true 2024-08-18T23:56:36.300 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-08-18T23:56:36.299+0000 7f3cbac27640 -1 osd.6 0 log_to_monitors true 2024-08-18T23:56:36.340 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-08-18T23:56:36.339+0000 7ff350015640 -1 osd.2 0 log_to_monitors true 2024-08-18T23:56:36.342 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-08-18T23:56:36.341+0000 7fad12d57640 -1 osd.3 0 log_to_monitors true 2024-08-18T23:56:40.166 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T23:56:40.232 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-08-18T23:56:40.229+0000 7f9ff13df640 -1 osd.4 0 waiting for initial osdmap 2024-08-18T23:56:40.241 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-08-18T23:56:40.240+0000 7f3cb6bbd640 -1 osd.6 0 waiting for initial osdmap 2024-08-18T23:56:40.248 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-08-18T23:56:40.247+0000 7f9fe91ff640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T23:56:40.254 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-08-18T23:56:40.254+0000 7f3cae9dd640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T23:56:40.309 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-08-18T23:56:40.308+0000 7f8791c36640 -1 osd.5 0 waiting for initial osdmap 2024-08-18T23:56:40.312 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-08-18T23:56:40.309+0000 7ff34c140640 -1 osd.2 0 waiting for initial osdmap 2024-08-18T23:56:40.316 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.311+0000 7f85c21ea640 1 Processor -- start 2024-08-18T23:56:40.316 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.311+0000 7f85c21ea640 1 -- start start 2024-08-18T23:56:40.316 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.312+0000 7f85c21ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc072260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:40.316 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.312+0000 7f85c21ea640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f85bc162a90 0x7f85bc0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:40.316 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.312+0000 7f85c21ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85bc0727a0 con 0x7f85bc0b5940 2024-08-18T23:56:40.316 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.312+0000 7f85c21ea640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f85bc0ce490 con 0x7f85bc162a90 2024-08-18T23:56:40.316 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.312+0000 7f85c21ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85bc070830 con 0x7f85bc071e80 2024-08-18T23:56:40.317 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.313+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc072260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:40.317 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.313+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc072260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:54896/0 (socket says 172.21.15.103:54896) 2024-08-18T23:56:40.317 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.313+0000 7f85bb7fe640 1 -- 172.21.15.103:0/3999297906 learned_addr learned my addr 172.21.15.103:0/3999297906 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:40.317 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.313+0000 7f85bb7fe640 1 -- 172.21.15.103:0/3999297906 >> v2:172.21.15.103:3300/0 conn(0x7f85bc162a90 msgr2=0x7f85bc0b5400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T23:56:40.317 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.313+0000 7f85bb7fe640 1 --2- 172.21.15.103:0/3999297906 >> v2:172.21.15.103:3300/0 conn(0x7f85bc162a90 0x7f85bc0b5400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.317 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.313+0000 7f85bb7fe640 1 -- 172.21.15.103:0/3999297906 >> v1:172.21.15.190:6789/0 conn(0x7f85bc0b5940 legacy=0x7f85bc1660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:40.317 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.313+0000 7f85bb7fe640 1 -- 172.21.15.103:0/3999297906 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc163050 con 0x7f85bc071e80 2024-08-18T23:56:40.317 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.315+0000 7f85bb7fe640 1 --2- 172.21.15.103:0/3999297906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc072260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009870 tx=0x7f85ac02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a56a12a7184b90c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:40.318 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.317+0000 7f85ba7fc640 1 -- 172.21.15.103:0/3999297906 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac037070 con 0x7f85bc071e80 2024-08-18T23:56:40.318 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.317+0000 7f85ba7fc640 1 -- 172.21.15.103:0/3999297906 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ac032440 con 0x7f85bc071e80 2024-08-18T23:56:40.319 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.317+0000 7f85ba7fc640 1 -- 172.21.15.103:0/3999297906 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac0327f0 con 0x7f85bc071e80 2024-08-18T23:56:40.320 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.318+0000 7f85c21ea640 1 -- 172.21.15.103:0/3999297906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 msgr2=0x7f85bc072260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:40.320 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.318+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3999297906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc072260 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009870 tx=0x7f85ac02a290 comp rx=0 tx=0).stop 2024-08-18T23:56:40.320 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.318+0000 7f85c21ea640 1 -- 172.21.15.103:0/3999297906 shutdown_connections 2024-08-18T23:56:40.320 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.318+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3999297906 >> v2:172.21.15.103:3300/0 conn(0x7f85bc162a90 0x7f85bc0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.320 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.318+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3999297906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc072260 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.320 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.318+0000 7f85c21ea640 1 -- 172.21.15.103:0/3999297906 >> 172.21.15.103:0/3999297906 conn(0x7f85bc0d0790 msgr2=0x7f85bc0d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:40.320 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.318+0000 7f85c21ea640 1 -- 172.21.15.103:0/3999297906 shutdown_connections 2024-08-18T23:56:40.320 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.318+0000 7f85c21ea640 1 -- 172.21.15.103:0/3999297906 wait complete. 2024-08-18T23:56:40.321 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.320+0000 7f85c21ea640 1 Processor -- start 2024-08-18T23:56:40.322 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.321+0000 7f85c21ea640 1 -- start start 2024-08-18T23:56:40.324 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.322+0000 7f85c21ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:40.324 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.322+0000 7f85c21ea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85bc0b5940 0x7f85bc0ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:40.324 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.322+0000 7f85c21ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85bc162a90 0x7f85bc0ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:40.324 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.322+0000 7f85c21ea640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc1638f0 con 0x7f85bc0b5940 2024-08-18T23:56:40.324 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.322+0000 7f85c21ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85bc163610 con 0x7f85bc162a90 2024-08-18T23:56:40.324 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85c21ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85bc06b840 con 0x7f85bc071e80 2024-08-18T23:56:40.326 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:40.326 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85bb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc160350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:54906/0 (socket says 172.21.15.103:54906) 2024-08-18T23:56:40.326 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85bb7fe640 1 -- 172.21.15.103:0/3184657855 learned_addr learned my addr 172.21.15.103:0/3184657855 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:40.326 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85baffd640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85bc0b5940 0x7f85bc0ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:40.326 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85baffd640 1 -- 172.21.15.103:0/3184657855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 msgr2=0x7f85bc160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85baffd640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85bbfff640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85bc162a90 0x7f85bc0ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85baffd640 1 -- 172.21.15.103:0/3184657855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85bc162a90 msgr2=0x7f85bc0ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.323+0000 7f85baffd640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85bc162a90 0x7f85bc0ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.324+0000 7f85baffd640 1 -- 172.21.15.103:0/3184657855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85bc143390 con 0x7f85bc0b5940 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.324+0000 7f85bbfff640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85bc162a90 0x7f85bc0ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.324+0000 7f85baffd640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85bc0b5940 0x7f85bc0ab440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f85b000b3e0 tx=0x7f85b000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.325+0000 7f85a3fff640 1 -- 172.21.15.103:0/3184657855 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0015020 con 0x7f85bc0b5940 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.325+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85bc143670 con 0x7f85bc0b5940 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.325+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85bc15fb50 con 0x7f85bc0b5940 2024-08-18T23:56:40.327 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.325+0000 7f85a3fff640 1 -- 172.21.15.103:0/3184657855 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b0011830 con 0x7f85bc0b5940 2024-08-18T23:56:40.328 INFO:tasks.ceph.osd.2.smithi103.stderr:2024-08-18T23:56:40.325+0000 7ff34374c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T23:56:40.328 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.326+0000 7f85a3fff640 1 -- 172.21.15.103:0/3184657855 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0011c40 con 0x7f85bc0b5940 2024-08-18T23:56:40.328 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.327+0000 7f85a3fff640 1 -- 172.21.15.103:0/3184657855 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f85b0018020 con 0x7f85bc0b5940 2024-08-18T23:56:40.329 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-08-18T23:56:40.327+0000 7f8789242640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T23:56:40.329 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.327+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c005290 con 0x7f85bc0b5940 2024-08-18T23:56:40.329 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-08-18T23:56:40.328+0000 7f373e0a5640 -1 osd.1 0 waiting for initial osdmap 2024-08-18T23:56:40.331 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.329+0000 7f85a3fff640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85a806be70 0x7f85a806e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:40.331 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.329+0000 7f85bb7fe640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85a806be70 0x7f85a806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:40.331 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.329+0000 7f85a3fff640 1 -- 172.21.15.103:0/3184657855 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f85b0089d70 con 0x7f85bc0b5940 2024-08-18T23:56:40.331 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.330+0000 7f85bb7fe640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85a806be70 0x7f85a806e330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f85ac02a2d0 tx=0x7f85ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:40.338 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.337+0000 7f85a3fff640 1 -- 172.21.15.103:0/3184657855 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f85b001f020 con 0x7f85bc0b5940 2024-08-18T23:56:40.345 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-08-18T23:56:40.344+0000 7fad0eced640 -1 osd.3 0 waiting for initial osdmap 2024-08-18T23:56:40.349 INFO:tasks.ceph.osd.1.smithi103.stderr:2024-08-18T23:56:40.348+0000 7f3735ec5640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T23:56:40.351 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-08-18T23:56:40.350+0000 7f2d261ce640 -1 osd.0 0 waiting for initial osdmap 2024-08-18T23:56:40.362 INFO:tasks.ceph.osd.3.smithi103.stderr:2024-08-18T23:56:40.361+0000 7fad06b0d640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T23:56:40.366 INFO:tasks.ceph.osd.0.smithi103.stderr:2024-08-18T23:56:40.365+0000 7f2d1dfee640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T23:56:40.402 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-08-18T23:56:40.401+0000 7f4ea1394640 -1 osd.7 0 waiting for initial osdmap 2024-08-18T23:56:40.411 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-08-18T23:56:40.411+0000 7f4e989b1640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-18T23:56:40.512 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.511+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f859c005580 con 0x7f85bc0b5940 2024-08-18T23:56:40.513 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.511+0000 7f85a3fff640 1 -- 172.21.15.103:0/3184657855 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f85b0059570 con 0x7f85bc0b5940 2024-08-18T23:56:40.513 INFO:teuthology.misc.health.smithi103.stdout: 2024-08-18T23:56:40.513 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":12,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:38.174949+0000","last_up_change":"0.000000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85a806be70 msgr2=0x7f85a806e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85a806be70 0x7f85a806e330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f85ac02a2d0 tx=0x7f85ac02e000 comp rx=0 tx=0).stop 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85bc0b5940 msgr2=0x7f85bc0ab440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85bc0b5940 0x7f85bc0ab440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f85b000b3e0 tx=0x7f85b000b8a0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 shutdown_connections 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85a806be70 0x7f85a806e330 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85bc162a90 0x7f85bc0ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85bc0b5940 0x7f85bc0ab440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 --2- 172.21.15.103:0/3184657855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85bc071e80 0x7f85bc160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 >> 172.21.15.103:0/3184657855 conn(0x7f85bc0d0790 msgr2=0x7f85bc1622c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:40.515 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 shutdown_connections 2024-08-18T23:56:40.516 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:40.513+0000 7f85c21ea640 1 -- 172.21.15.103:0/3184657855 wait complete. 2024-08-18T23:56:40.524 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-18T23:56:47.331 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-18T23:56:47.433 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.432+0000 7f4df2f2e640 1 Processor -- start 2024-08-18T23:56:47.433 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.432+0000 7f4df2f2e640 1 -- start start 2024-08-18T23:56:47.436 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df2f2e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4dec15f660 0x7f4dec0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.436 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df2f2e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4dec0cd750 0x7f4dec0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.436 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df2f2e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dec0cf7f0 con 0x7f4dec0ccc00 2024-08-18T23:56:47.436 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df2f2e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f4dec0d05e0 con 0x7f4dec15f660 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df2f2e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4dec0d08c0 con 0x7f4dec0cd750 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df0cca640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4dec15f660 0x7f4dec0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4debfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4dec0ccc00 0x7f4dec0cd040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:36784/0 (socket says 172.21.15.103:36784) 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4debfff640 1 -- 172.21.15.103:0/387606016 learned_addr learned my addr 172.21.15.103:0/387606016 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df0cca640 1 -- 172.21.15.103:0/387606016 >> v2:172.21.15.190:3300/0 conn(0x7f4dec0cd750 msgr2=0x7f4dec0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df14cb640 1 --2- 172.21.15.103:0/387606016 >> v2:172.21.15.190:3300/0 conn(0x7f4dec0cd750 0x7f4dec0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4deb7fe640 1 -- 172.21.15.103:0/387606016 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697087245 0 0) 0x7f4dec0cf7f0 con 0x7f4dec0ccc00 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df0cca640 1 --2- 172.21.15.103:0/387606016 >> v2:172.21.15.190:3300/0 conn(0x7f4dec0cd750 0x7f4dec0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df0cca640 1 -- 172.21.15.103:0/387606016 >> v1:172.21.15.103:6789/0 conn(0x7f4dec0ccc00 legacy=0x7f4dec0cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df0cca640 1 -- 172.21.15.103:0/387606016 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec0d0ba0 con 0x7f4dec15f660 2024-08-18T23:56:47.437 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.433+0000 7f4df14cb640 1 --2- 172.21.15.103:0/387606016 >> v2:172.21.15.190:3300/0 conn(0x7f4dec0cd750 0x7f4dec0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.434+0000 7f4df0cca640 1 --2- 172.21.15.103:0/387606016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec0cdd30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0744c0 tx=0x7f4de002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cc730b55f88d46 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.434+0000 7f4deb7fe640 1 -- 172.21.15.103:0/387606016 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0037070 con 0x7f4dec15f660 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.434+0000 7f4deb7fe640 1 -- 172.21.15.103:0/387606016 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de0032440 con 0x7f4dec15f660 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.434+0000 7f4deb7fe640 1 -- 172.21.15.103:0/387606016 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de002ae60 con 0x7f4dec15f660 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.434+0000 7f4df2f2e640 1 -- 172.21.15.103:0/387606016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 msgr2=0x7f4dec0cdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.434+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/387606016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec0cdd30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0744c0 tx=0x7f4de002a110 comp rx=0 tx=0).stop 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.435+0000 7f4df2f2e640 1 -- 172.21.15.103:0/387606016 shutdown_connections 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.435+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/387606016 >> v2:172.21.15.190:3300/0 conn(0x7f4dec0cd750 0x7f4dec0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.438 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.435+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/387606016 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec0cdd30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.439 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.435+0000 7f4df2f2e640 1 -- 172.21.15.103:0/387606016 >> 172.21.15.103:0/387606016 conn(0x7f4dec0d1ed0 msgr2=0x7f4dec0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:47.439 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.435+0000 7f4df2f2e640 1 -- 172.21.15.103:0/387606016 shutdown_connections 2024-08-18T23:56:47.439 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.435+0000 7f4df2f2e640 1 -- 172.21.15.103:0/387606016 wait complete. 2024-08-18T23:56:47.441 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.436+0000 7f4df2f2e640 1 Processor -- start 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.436+0000 7f4df2f2e640 1 -- start start 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df2f2e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dec0ccc00 0x7f4dec09f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df2f2e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dec0cd750 0x7f4dec0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df2f2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec070890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df2f2e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0c61a0 con 0x7f4dec15f660 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df2f2e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0cf510 con 0x7f4dec0ccc00 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df2f2e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec0c6320 con 0x7f4dec0cd750 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec070890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43452/0 (socket says 172.21.15.103:43452) 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 -- 172.21.15.103:0/55702926 learned_addr learned my addr 172.21.15.103:0/55702926 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df0cca640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dec0ccc00 0x7f4dec09f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.442 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4debfff640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dec0cd750 0x7f4dec0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 -- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dec0cd750 msgr2=0x7f4dec0cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dec0cd750 0x7f4dec0cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 -- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dec0ccc00 msgr2=0x7f4dec09f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dec0ccc00 0x7f4dec09f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 -- 172.21.15.103:0/55702926 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec1f1820 con 0x7f4dec15f660 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df0cca640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dec0ccc00 0x7f4dec09f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df14cb640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec070890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4de400cf20 tx=0x7f4de400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4de97fa640 1 -- 172.21.15.103:0/55702926 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de401a070 con 0x7f4dec15f660 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4de97fa640 1 -- 172.21.15.103:0/55702926 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de400d840 con 0x7f4dec15f660 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.437+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec1f1b00 con 0x7f4dec15f660 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.438+0000 7f4de97fa640 1 -- 172.21.15.103:0/55702926 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de400dc30 con 0x7f4dec15f660 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.438+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec1f20c0 con 0x7f4dec15f660 2024-08-18T23:56:47.443 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.439+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec0c5c60 con 0x7f4dec15f660 2024-08-18T23:56:47.444 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.439+0000 7f4de97fa640 1 -- 172.21.15.103:0/55702926 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4de401d070 con 0x7f4dec15f660 2024-08-18T23:56:47.444 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.439+0000 7f4de97fa640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4dd006be30 0x7f4dd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.444 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.439+0000 7f4de97fa640 1 -- 172.21.15.103:0/55702926 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4de408b410 con 0x7f4dec15f660 2024-08-18T23:56:47.444 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.439+0000 7f4df0cca640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4dd006be30 0x7f4dd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.444 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.440+0000 7f4df0cca640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4dd006be30 0x7f4dd006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4de0034000 tx=0x7f4de002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:47.445 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.444+0000 7f4de97fa640 1 -- 172.21.15.103:0/55702926 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4de405a110 con 0x7f4dec15f660 2024-08-18T23:56:47.612 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.610+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dec0cdf40 con 0x7f4dec15f660 2024-08-18T23:56:47.612 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.611+0000 7f4de97fa640 1 -- 172.21.15.103:0/55702926 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12920 (secure 0 0 0) 0x7f4de4059a10 con 0x7f4dec15f660 2024-08-18T23:56:47.613 INFO:teuthology.misc.health.smithi103.stdout: 2024-08-18T23:56:47.613 INFO:teuthology.misc.health.smithi103.stdout:{"epoch":16,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:44.248333+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4dd006be30 msgr2=0x7f4dd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4dd006be30 0x7f4dd006e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4de0034000 tx=0x7f4de002e000 comp rx=0 tx=0).stop 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 msgr2=0x7f4dec070890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec070890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4de400cf20 tx=0x7f4de400a7d0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 shutdown_connections 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4dd006be30 0x7f4dd006e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4dec15f660 0x7f4dec070890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dec0cd750 0x7f4dec0cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 --2- 172.21.15.103:0/55702926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dec0ccc00 0x7f4dec09f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.615 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 >> 172.21.15.103:0/55702926 conn(0x7f4dec0d1ed0 msgr2=0x7f4dec0b6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:47.616 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 shutdown_connections 2024-08-18T23:56:47.616 INFO:teuthology.misc.health.smithi103.stderr:2024-08-18T23:56:47.613+0000 7f4df2f2e640 1 -- 172.21.15.103:0/55702926 wait complete. 2024-08-18T23:56:47.624 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-18T23:56:47.624 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-18T23:56:47.624 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T23:56:47.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T23:56:47.627 INFO:tasks.ceph.mds.a:Started 2024-08-18T23:56:47.627 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T23:56:47.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T23:56:47.629 INFO:tasks.ceph.mds.c:Started 2024-08-18T23:56:47.629 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T23:56:47.629 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T23:56:47.632 INFO:tasks.ceph.mds.b:Started 2024-08-18T23:56:47.632 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T23:56:47.632 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T23:56:47.634 INFO:tasks.ceph.mds.d:Started 2024-08-18T23:56:47.635 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-18T23:56:47.635 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:56:47.701 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-08-18T23:56:47.701 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-08-18T23:56:47.717 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-08-18T23:56:47.718 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-08-18T23:56:47.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.738+0000 7f8a2279d640 1 Processor -- start 2024-08-18T23:56:47.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.738+0000 7f8a2279d640 1 -- start start 2024-08-18T23:56:47.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2279d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a1c15aa90 0x7f8a1c06f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2279d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2279d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8a1c072900 0x7f8a1c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2279d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8a1c070670 con 0x7f8a1c15aa90 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2279d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8a1c06f810 con 0x7f8a1c072900 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2279d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1c06fa60 con 0x7f8a1c15bba0 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2179b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a1c15aa90 0x7f8a1c06f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2179b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a1c15aa90 0x7f8a1c06f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43492/0 (socket says 172.21.15.103:43492) 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.739+0000 7f8a2179b640 1 -- 172.21.15.103:0/2946712176 learned_addr learned my addr 172.21.15.103:0/2946712176 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a21f9c640 1 --2- 172.21.15.103:0/2946712176 >> v2:172.21.15.190:3300/0 conn(0x7f8a1c072900 0x7f8a1c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a20f9a640 1 --2- 172.21.15.103:0/2946712176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a2179b640 1 -- 172.21.15.103:0/2946712176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 msgr2=0x7f8a1c0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a2179b640 1 --2- 172.21.15.103:0/2946712176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a2179b640 1 -- 172.21.15.103:0/2946712176 >> v2:172.21.15.190:3300/0 conn(0x7f8a1c072900 msgr2=0x7f8a1c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a2179b640 1 --2- 172.21.15.103:0/2946712176 >> v2:172.21.15.190:3300/0 conn(0x7f8a1c072900 0x7f8a1c0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a2179b640 1 -- 172.21.15.103:0/2946712176 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1c06fd40 con 0x7f8a1c15aa90 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a21f9c640 1 --2- 172.21.15.103:0/2946712176 >> v2:172.21.15.190:3300/0 conn(0x7f8a1c072900 0x7f8a1c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a20f9a640 1 --2- 172.21.15.103:0/2946712176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.740+0000 7f8a2179b640 1 --2- 172.21.15.103:0/2946712176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c06f2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c070aa0 tx=0x7f8a1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90f76d4e84b2a2e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a0ffff640 1 -- 172.21.15.103:0/2946712176 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18037070 con 0x7f8a1c15aa90 2024-08-18T23:56:47.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a0ffff640 1 -- 172.21.15.103:0/2946712176 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a18032440 con 0x7f8a1c15aa90 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a0ffff640 1 -- 172.21.15.103:0/2946712176 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18032810 con 0x7f8a1c15aa90 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 -- 172.21.15.103:0/2946712176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 msgr2=0x7f8a1c06f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 --2- 172.21.15.103:0/2946712176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c06f2d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c070aa0 tx=0x7f8a1802a1e0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 -- 172.21.15.103:0/2946712176 shutdown_connections 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 --2- 172.21.15.103:0/2946712176 >> v2:172.21.15.190:3300/0 conn(0x7f8a1c072900 0x7f8a1c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 --2- 172.21.15.103:0/2946712176 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 --2- 172.21.15.103:0/2946712176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c06f2d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 -- 172.21.15.103:0/2946712176 >> 172.21.15.103:0/2946712176 conn(0x7f8a1c0d0bd0 msgr2=0x7f8a1c0d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 -- 172.21.15.103:0/2946712176 shutdown_connections 2024-08-18T23:56:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.741+0000 7f8a2279d640 1 -- 172.21.15.103:0/2946712176 wait complete. 2024-08-18T23:56:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.742+0000 7f8a2279d640 1 Processor -- start 2024-08-18T23:56:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.742+0000 7f8a2279d640 1 -- start start 2024-08-18T23:56:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a2279d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a1c072900 0x7f8a1c141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a2279d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c0b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a2279d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a2279d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c15bfe0 con 0x7f8a1c15aa90 2024-08-18T23:56:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a2279d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1c070300 con 0x7f8a1c072900 2024-08-18T23:56:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a2279d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a1c15ae70 con 0x7f8a1c15bba0 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a20f9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c0b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a2179b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a1c072900 0x7f8a1c141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a20f9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c0b5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43496/0 (socket says 172.21.15.103:43496) 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a20f9a640 1 -- 172.21.15.103:0/1350499918 learned_addr learned my addr 172.21.15.103:0/1350499918 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.743+0000 7f8a21f9c640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a20f9a640 1 -- 172.21.15.103:0/1350499918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 msgr2=0x7f8a1c0b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a20f9a640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0b5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a20f9a640 1 -- 172.21.15.103:0/1350499918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a1c072900 msgr2=0x7f8a1c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a20f9a640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a1c072900 0x7f8a1c141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a20f9a640 1 -- 172.21.15.103:0/1350499918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a1c0b4da0 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a2179b640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a1c072900 0x7f8a1c141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a20f9a640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c0b5940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000c7f0 tx=0x7f8a1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a0dffb640 1 -- 172.21.15.103:0/1350499918 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a10015070 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a0dffb640 1 -- 172.21.15.103:0/1350499918 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a10007820 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1c151930 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a0dffb640 1 -- 172.21.15.103:0/1350499918 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a10007bd0 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.744+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1c151ef0 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.745+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a1c06f2d0 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.746+0000 7f8a0dffb640 1 -- 172.21.15.103:0/1350499918 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a10018070 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.746+0000 7f8a0dffb640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a0006be30 0x7f8a0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.746+0000 7f8a0dffb640 1 -- 172.21.15.103:0/1350499918 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f8a1008aba0 con 0x7f8a1c15aa90 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.746+0000 7f8a2179b640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a0006be30 0x7f8a0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:47.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.747+0000 7f8a2179b640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a0006be30 0x7f8a0006e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a18034000 tx=0x7f8a1802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:47.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.750+0000 7f8a0dffb640 1 -- 172.21.15.103:0/1350499918 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8a10059250 con 0x7f8a1c15aa90 2024-08-18T23:56:47.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.948+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a1c1535b0 con 0x7f8a1c15aa90 2024-08-18T23:56:47.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.948+0000 7f8a0dffb640 1 -- 172.21.15.103:0/1350499918 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f8a1005d550 con 0x7f8a1c15aa90 2024-08-18T23:56:47.950 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:56:47.950 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"btime":"2024-08-18T23:56:47:709069+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-18T23:56:47.950 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 2 2024-08-18T23:56:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a0006be30 msgr2=0x7f8a0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a0006be30 0x7f8a0006e2f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a18034000 tx=0x7f8a1802e000 comp rx=0 tx=0).stop 2024-08-18T23:56:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 msgr2=0x7f8a1c0b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c0b5940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000c7f0 tx=0x7f8a1000ccb0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 shutdown_connections 2024-08-18T23:56:47.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a0006be30 0x7f8a0006e2f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a1c15bba0 0x7f8a1c0b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a1c15aa90 0x7f8a1c0b5940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 --2- 172.21.15.103:0/1350499918 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a1c072900 0x7f8a1c141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:47.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.950+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 >> 172.21.15.103:0/1350499918 conn(0x7f8a1c0d0bd0 msgr2=0x7f8a1c15c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:47.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.951+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 shutdown_connections 2024-08-18T23:56:47.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:47.951+0000 7f8a2279d640 1 -- 172.21.15.103:0/1350499918 wait complete. 2024-08-18T23:56:49.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:56:50.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.073+0000 7f39c7944640 1 Processor -- start 2024-08-18T23:56:50.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.073+0000 7f39c7944640 1 -- start start 2024-08-18T23:56:50.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c7944640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f39c015e380 0x7f39c00cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c7944640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c006d650 0x7f39c00d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c7944640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39c00d1580 0x7f39c00d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c7944640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f39c00b3500 con 0x7f39c00d1580 2024-08-18T23:56:50.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c7944640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f39c00b6a50 con 0x7f39c015e380 2024-08-18T23:56:50.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c7944640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39c00d19b0 con 0x7f39c006d650 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c5ee1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39c00d1580 0x7f39c00d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c5ee1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39c00d1580 0x7f39c00d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43498/0 (socket says 172.21.15.103:43498) 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c5ee1640 1 -- 172.21.15.103:0/1858266887 learned_addr learned my addr 172.21.15.103:0/1858266887 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c56e0640 1 --2- 172.21.15.103:0/1858266887 >> v2:172.21.15.190:3300/0 conn(0x7f39c015e380 0x7f39c00cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.074+0000 7f39c4edf640 1 --2- 172.21.15.103:0/1858266887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c006d650 0x7f39c00d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39c5ee1640 1 -- 172.21.15.103:0/1858266887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c006d650 msgr2=0x7f39c00d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39c5ee1640 1 --2- 172.21.15.103:0/1858266887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c006d650 0x7f39c00d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39c5ee1640 1 -- 172.21.15.103:0/1858266887 >> v2:172.21.15.190:3300/0 conn(0x7f39c015e380 msgr2=0x7f39c00cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39c5ee1640 1 --2- 172.21.15.103:0/1858266887 >> v2:172.21.15.190:3300/0 conn(0x7f39c015e380 0x7f39c00cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39c5ee1640 1 -- 172.21.15.103:0/1858266887 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c006da70 con 0x7f39c00d1580 2024-08-18T23:56:50.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39c56e0640 1 --2- 172.21.15.103:0/1858266887 >> v2:172.21.15.190:3300/0 conn(0x7f39c015e380 0x7f39c00cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39c5ee1640 1 --2- 172.21.15.103:0/1858266887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c00d2640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f39c00d52f0 tx=0x7f39b802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364cf35b92c6e5f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39b3fff640 1 -- 172.21.15.103:0/1858266887 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8036070 con 0x7f39c00d1580 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39b3fff640 1 -- 172.21.15.103:0/1858266887 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8031600 con 0x7f39c00d1580 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.075+0000 7f39b3fff640 1 -- 172.21.15.103:0/1858266887 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80319d0 con 0x7f39c00d1580 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 -- 172.21.15.103:0/1858266887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 msgr2=0x7f39c00d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 --2- 172.21.15.103:0/1858266887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c00d2640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f39c00d52f0 tx=0x7f39b802a6c0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 -- 172.21.15.103:0/1858266887 shutdown_connections 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 --2- 172.21.15.103:0/1858266887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c00d2640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 --2- 172.21.15.103:0/1858266887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c006d650 0x7f39c00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 --2- 172.21.15.103:0/1858266887 >> v2:172.21.15.190:3300/0 conn(0x7f39c015e380 0x7f39c00cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 -- 172.21.15.103:0/1858266887 >> 172.21.15.103:0/1858266887 conn(0x7f39c0073210 msgr2=0x7f39c00735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:50.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 -- 172.21.15.103:0/1858266887 shutdown_connections 2024-08-18T23:56:50.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.076+0000 7f39c7944640 1 -- 172.21.15.103:0/1858266887 wait complete. 2024-08-18T23:56:50.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.077+0000 7f39c7944640 1 Processor -- start 2024-08-18T23:56:50.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.077+0000 7f39c7944640 1 -- start start 2024-08-18T23:56:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c7944640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c006d650 0x7f39c015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c7944640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c0157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c7944640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c015e380 0x7f39c00c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c7944640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00b6400 con 0x7f39c00d1580 2024-08-18T23:56:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c7944640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00b6120 con 0x7f39c006d650 2024-08-18T23:56:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c7944640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39c00b66e0 con 0x7f39c015e380 2024-08-18T23:56:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c4edf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c0157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c4edf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c0157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43502/0 (socket says 172.21.15.103:43502) 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c4edf640 1 -- 172.21.15.103:0/1260055686 learned_addr learned my addr 172.21.15.103:0/1260055686 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c56e0640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c006d650 0x7f39c015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c5ee1640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c015e380 0x7f39c00c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c4edf640 1 -- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c015e380 msgr2=0x7f39c00c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.078+0000 7f39c4edf640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c015e380 0x7f39c00c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39c4edf640 1 -- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c006d650 msgr2=0x7f39c015b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39c4edf640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c006d650 0x7f39c015b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39c4edf640 1 -- 172.21.15.103:0/1260055686 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c00c9fa0 con 0x7f39c00d1580 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39c5ee1640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c015e380 0x7f39c00c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39c4edf640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c0157980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00d800 tx=0x7f39bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39b1ffb640 1 -- 172.21.15.103:0/1260055686 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc018020 con 0x7f39c00d1580 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39b1ffb640 1 -- 172.21.15.103:0/1260055686 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc0096a0 con 0x7f39c00d1580 2024-08-18T23:56:50.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c00ca240 con 0x7f39c00d1580 2024-08-18T23:56:50.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39b1ffb640 1 -- 172.21.15.103:0/1260055686 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc009a70 con 0x7f39c00d1580 2024-08-18T23:56:50.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.079+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c015e9b0 con 0x7f39c00d1580 2024-08-18T23:56:50.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.080+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c0075440 con 0x7f39c00d1580 2024-08-18T23:56:50.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.081+0000 7f39b1ffb640 1 -- 172.21.15.103:0/1260055686 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39bc01b020 con 0x7f39c00d1580 2024-08-18T23:56:50.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.081+0000 7f39b1ffb640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39a406be30 0x7f39a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.081+0000 7f39b1ffb640 1 -- 172.21.15.103:0/1260055686 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f39bc08ac10 con 0x7f39c00d1580 2024-08-18T23:56:50.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.081+0000 7f39c56e0640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39a406be30 0x7f39a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.082+0000 7f39c56e0640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39a406be30 0x7f39a406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39c00b2f60 tx=0x7f39b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.086+0000 7f39b1ffb640 1 -- 172.21.15.103:0/1260055686 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f39c0075440 con 0x7f39c00d1580 2024-08-18T23:56:50.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.285+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39c00d1040 con 0x7f39c00d1580 2024-08-18T23:56:50.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.286+0000 7f39b1ffb640 1 -- 172.21.15.103:0/1260055686 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3915 (secure 0 0 0) 0x7f39bc022030 con 0x7f39c00d1580 2024-08-18T23:56:50.287 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:56:50.288 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":3,"btime":"2024-08-18T23:56:48:712727+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-18T23:56:50.288 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 3 2024-08-18T23:56:50.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39a406be30 msgr2=0x7f39a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39a406be30 0x7f39a406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39c00b2f60 tx=0x7f39b4008040 comp rx=0 tx=0).stop 2024-08-18T23:56:50.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 msgr2=0x7f39c0157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c0157980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00d800 tx=0x7f39bc00dcc0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 shutdown_connections 2024-08-18T23:56:50.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39a406be30 0x7f39a406e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39c015e380 0x7f39c00c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39c00d1580 0x7f39c0157980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 --2- 172.21.15.103:0/1260055686 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39c006d650 0x7f39c015b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 >> 172.21.15.103:0/1260055686 conn(0x7f39c0073210 msgr2=0x7f39c00b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:50.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 shutdown_connections 2024-08-18T23:56:50.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.288+0000 7f39c7944640 1 -- 172.21.15.103:0/1260055686 wait complete. 2024-08-18T23:56:50.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T23:56:50.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.398+0000 7fd1f1225640 1 Processor -- start 2024-08-18T23:56:50.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.398+0000 7fd1f1225640 1 -- start start 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1f1225640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0d1600 0x7fd1ec0d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1f1225640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ec0d4b30 con 0x7fd1ec15e1a0 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1f1225640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1ec162be0 con 0x7fd1ec0d11a0 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1f1225640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd1ec0b5020 con 0x7fd1ec0d1600 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1ead9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd1ec15e1a0 0x7fd1ec0d0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:36800/0 (socket says 172.21.15.103:36800) 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1ead9d640 1 -- 172.21.15.103:0/1007336609 learned_addr learned my addr 172.21.15.103:0/1007336609 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357837815 0 0) 0x7fd1ec0d4b30 con 0x7fd1ec15e1a0 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1eb59e640 1 --2- 172.21.15.103:0/1007336609 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0d1600 0x7fd1ec0d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1d4003520 con 0x7fd1ec15e1a0 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1959030736 0 0) 0x7fd1d4003520 con 0x7fd1ec15e1a0 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0d1600 msgr2=0x7fd1ec0d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 --2- 172.21.15.103:0/1007336609 >> v2:172.21.15.190:3300/0 conn(0x7fd1ec0d1600 0x7fd1ec0d2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 >> v1:172.21.15.190:6789/0 conn(0x7fd1ec0d11a0 legacy=0x7fd1ec0d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec162060 con 0x7fd1ec15e1a0 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fd1dc001670 con 0x7fd1ec15e1a0 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 >> v1:172.21.15.103:6789/0 conn(0x7fd1ec15e1a0 legacy=0x7fd1ec0d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d40039b0 0x7fd1d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d4004800 0x7fd1d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec0b5020 con 0x7fd1d40051c0 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d400c060 con 0x7fd1d40039b0 2024-08-18T23:56:50.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.399+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d400c260 con 0x7fd1d4004800 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1eb59e640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1ead9d640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d40039b0 0x7fd1d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1ea59c640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d4004800 0x7fd1d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1eb59e640 1 -- 172.21.15.103:0/1007336609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d4004800 msgr2=0x7fd1d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1eb59e640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1d4004800 0x7fd1d4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1eb59e640 1 -- 172.21.15.103:0/1007336609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d40039b0 msgr2=0x7fd1d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1eb59e640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1d40039b0 0x7fd1d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1eb59e640 1 -- 172.21.15.103:0/1007336609 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d4003520 con 0x7fd1d40051c0 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1eb59e640 1 -- 172.21.15.103:0/1007336609 reap_dead start 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.400+0000 7fd1eb59e640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1d400b9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009fc0 tx=0x7fd1d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13911a49e865cd1d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4035020 con 0x7fd1d40051c0 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1e4003bd0 con 0x7fd1d40051c0 2024-08-18T23:56:50.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1e9d9b640 1 -- 172.21.15.103:0/1007336609 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4009c10 con 0x7fd1d40051c0 2024-08-18T23:56:50.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1f1225640 1 -- 172.21.15.103:0/1007336609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 msgr2=0x7fd1d400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1f1225640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1d400b9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009fc0 tx=0x7fd1d4005830 comp rx=0 tx=0).stop 2024-08-18T23:56:50.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1f1225640 1 -- 172.21.15.103:0/1007336609 shutdown_connections 2024-08-18T23:56:50.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1f1225640 1 --2- 172.21.15.103:0/1007336609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1d400b9c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1f1225640 1 -- 172.21.15.103:0/1007336609 >> 172.21.15.103:0/1007336609 conn(0x7fd1ec08bfd0 msgr2=0x7fd1ec09d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:50.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1f1225640 1 -- 172.21.15.103:0/1007336609 shutdown_connections 2024-08-18T23:56:50.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.401+0000 7fd1f1225640 1 -- 172.21.15.103:0/1007336609 wait complete. 2024-08-18T23:56:50.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.403+0000 7fd1f1225640 1 Processor -- start 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.403+0000 7fd1f1225640 1 -- start start 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.403+0000 7fd1f1225640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1ec1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.403+0000 7fd1f1225640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1ec15e7f0 0x7fd1ec0c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.403+0000 7fd1f1225640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1ec0c8b30 0x7fd1ec0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.403+0000 7fd1f1225640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec162900 con 0x7fd1d40051c0 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.403+0000 7fd1f1225640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec162620 con 0x7fd1ec15e7f0 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.403+0000 7fd1f1225640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd1ec15e580 con 0x7fd1ec0c8b30 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1ec1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1ec1597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43516/0 (socket says 172.21.15.103:43516) 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 -- 172.21.15.103:0/958301676 learned_addr learned my addr 172.21.15.103:0/958301676 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:50.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ea59c640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1ec15e7f0 0x7fd1ec0c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1eb59e640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1ec0c8b30 0x7fd1ec0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 -- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1ec0c8b30 msgr2=0x7fd1ec0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1ec0c8b30 0x7fd1ec0b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 -- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1ec15e7f0 msgr2=0x7fd1ec0c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1ec15e7f0 0x7fd1ec0c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 -- 172.21.15.103:0/958301676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec0b7030 con 0x7fd1d40051c0 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1eb59e640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1ec0c8b30 0x7fd1ec0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1ead9d640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1ec1597c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0072c0 tx=0x7fd1dc007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1d37fe640 1 -- 172.21.15.103:0/958301676 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00f960 con 0x7fd1d40051c0 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1d37fe640 1 -- 172.21.15.103:0/958301676 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1dc018070 con 0x7fd1d40051c0 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1d37fe640 1 -- 172.21.15.103:0/958301676 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00fd80 con 0x7fd1d40051c0 2024-08-18T23:56:50.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ec0b7310 con 0x7fd1d40051c0 2024-08-18T23:56:50.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.404+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ec0b78d0 con 0x7fd1d40051c0 2024-08-18T23:56:50.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.405+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ec161d10 con 0x7fd1d40051c0 2024-08-18T23:56:50.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.406+0000 7fd1d37fe640 1 -- 172.21.15.103:0/958301676 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd1dc01d460 con 0x7fd1d40051c0 2024-08-18T23:56:50.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.406+0000 7fd1d37fe640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd1d806be60 0x7fd1d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.406+0000 7fd1ea59c640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd1d806be60 0x7fd1d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.406+0000 7fd1d37fe640 1 -- 172.21.15.103:0/958301676 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd1dc08aac0 con 0x7fd1d40051c0 2024-08-18T23:56:50.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.407+0000 7fd1ea59c640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd1d806be60 0x7fd1d806e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.411+0000 7fd1d37fe640 1 -- 172.21.15.103:0/958301676 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd1dc059850 con 0x7fd1d40051c0 2024-08-18T23:56:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.576+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd1ec0c7980 con 0x7fd1d40051c0 2024-08-18T23:56:50.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.577+0000 7fd1d37fe640 1 -- 172.21.15.103:0/958301676 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fd1dc059150 con 0x7fd1d40051c0 2024-08-18T23:56:50.578 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:56:50.579 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-08-18T23:56:50.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:56:50.579 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-08-18T23:56:50.579 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-08-18T23:56:50.579 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:56:50.579 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-08-18T23:56:50.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd1d806be60 msgr2=0x7fd1d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd1d806be60 0x7fd1d806e320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0000c00 tx=0x7fd1e0009040 comp rx=0 tx=0).stop 2024-08-18T23:56:50.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 msgr2=0x7fd1ec1597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1ec1597c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0072c0 tx=0x7fd1dc007780 comp rx=0 tx=0).stop 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 shutdown_connections 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd1d806be60 0x7fd1d806e320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1ec0c8b30 0x7fd1ec0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1ec15e7f0 0x7fd1ec0c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 --2- 172.21.15.103:0/958301676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1d40051c0 0x7fd1ec1597c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 >> 172.21.15.103:0/958301676 conn(0x7fd1ec08bfd0 msgr2=0x7fd1ec06c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 shutdown_connections 2024-08-18T23:56:50.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.579+0000 7fd1f1225640 1 -- 172.21.15.103:0/958301676 wait complete. 2024-08-18T23:56:50.591 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T23:56:50.591 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T23:56:50.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.693+0000 7f64f7e79640 1 Processor -- start 2024-08-18T23:56:50.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.693+0000 7f64f7e79640 1 -- start start 2024-08-18T23:56:50.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f7e79640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64f015df30 0x7f64f00b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f7e79640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f64f00b11c0 0x7f64f00b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f7e79640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f00d3340 con 0x7f64f00b5580 2024-08-18T23:56:50.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f7e79640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f64f00d3080 con 0x7f64f015df30 2024-08-18T23:56:50.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f7e79640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f64f00b4560 con 0x7f64f00b11c0 2024-08-18T23:56:50.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f5c15640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64f015df30 0x7f64f00b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f5c15640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f64f015df30 0x7f64f00b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43532/0 (socket says 172.21.15.103:43532) 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f5c15640 1 -- 172.21.15.103:0/2774733100 learned_addr learned my addr 172.21.15.103:0/2774733100 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f5414640 1 --2- 172.21.15.103:0/2774733100 >> v2:172.21.15.190:3300/0 conn(0x7f64f00b11c0 0x7f64f00b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f5c15640 1 -- 172.21.15.103:0/2774733100 >> v2:172.21.15.190:3300/0 conn(0x7f64f00b11c0 msgr2=0x7f64f00b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f5c15640 1 --2- 172.21.15.103:0/2774733100 >> v2:172.21.15.190:3300/0 conn(0x7f64f00b11c0 0x7f64f00b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f5c15640 1 -- 172.21.15.103:0/2774733100 >> v1:172.21.15.190:6789/0 conn(0x7f64f00b5580 legacy=0x7f64f0161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.694+0000 7f64f5c15640 1 -- 172.21.15.103:0/2774733100 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f00b4840 con 0x7f64f015df30 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.695+0000 7f64f5c15640 1 --2- 172.21.15.103:0/2774733100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f00b0c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009870 tx=0x7f64ec02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449461ddc0f9ef78 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.695+0000 7f64f4c13640 1 -- 172.21.15.103:0/2774733100 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec037070 con 0x7f64f015df30 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.695+0000 7f64f4c13640 1 -- 172.21.15.103:0/2774733100 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ec032440 con 0x7f64f015df30 2024-08-18T23:56:50.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.695+0000 7f64f4c13640 1 -- 172.21.15.103:0/2774733100 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ec032810 con 0x7f64f015df30 2024-08-18T23:56:50.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.696+0000 7f64f7e79640 1 -- 172.21.15.103:0/2774733100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 msgr2=0x7f64f00b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.696+0000 7f64f7e79640 1 --2- 172.21.15.103:0/2774733100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f00b0c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009870 tx=0x7f64ec02a2a0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.696+0000 7f64f7e79640 1 -- 172.21.15.103:0/2774733100 shutdown_connections 2024-08-18T23:56:50.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.696+0000 7f64f7e79640 1 --2- 172.21.15.103:0/2774733100 >> v2:172.21.15.190:3300/0 conn(0x7f64f00b11c0 0x7f64f00b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.696+0000 7f64f7e79640 1 --2- 172.21.15.103:0/2774733100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f00b0c80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.696+0000 7f64f7e79640 1 -- 172.21.15.103:0/2774733100 >> 172.21.15.103:0/2774733100 conn(0x7f64f009d420 msgr2=0x7f64f00d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:50.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.696+0000 7f64f7e79640 1 -- 172.21.15.103:0/2774733100 shutdown_connections 2024-08-18T23:56:50.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.696+0000 7f64f7e79640 1 -- 172.21.15.103:0/2774733100 wait complete. 2024-08-18T23:56:50.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.697+0000 7f64f7e79640 1 Processor -- start 2024-08-18T23:56:50.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.697+0000 7f64f7e79640 1 -- start start 2024-08-18T23:56:50.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.697+0000 7f64f7e79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64f00b11c0 0x7f64f00a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f7e79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64f00b5580 0x7f64f00cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f7e79640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f7e79640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f64f00b33c0 con 0x7f64f015df30 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f7e79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f64f00b3240 con 0x7f64f00b11c0 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f7e79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f64f00d2c50 con 0x7f64f00b5580 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f015cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43540/0 (socket says 172.21.15.103:43540) 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 -- 172.21.15.103:0/1640478626 learned_addr learned my addr 172.21.15.103:0/1640478626 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f5c15640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64f00b11c0 0x7f64f00a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f5414640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64f00b5580 0x7f64f00cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 -- 172.21.15.103:0/1640478626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64f00b5580 msgr2=0x7f64f00cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64f00b5580 0x7f64f00cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 -- 172.21.15.103:0/1640478626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64f00b11c0 msgr2=0x7f64f00a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64f00b11c0 0x7f64f00a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 -- 172.21.15.103:0/1640478626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f00a1d00 con 0x7f64f015df30 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f6416640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f015cf60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64e800c7a0 tx=0x7f64e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64e67fc640 1 -- 172.21.15.103:0/1640478626 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e8003b70 con 0x7f64f015df30 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64e67fc640 1 -- 172.21.15.103:0/1640478626 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e8003d30 con 0x7f64f015df30 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f00ce0f0 con 0x7f64f015df30 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64e67fc640 1 -- 172.21.15.103:0/1640478626 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e800aa90 con 0x7f64f015df30 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.698+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f01f4840 con 0x7f64f015df30 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.699+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f015e310 con 0x7f64f015df30 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.700+0000 7f64e67fc640 1 -- 172.21.15.103:0/1640478626 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64e800ac30 con 0x7f64f015df30 2024-08-18T23:56:50.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.700+0000 7f64e67fc640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f64d406be30 0x7f64d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:50.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.700+0000 7f64e67fc640 1 -- 172.21.15.103:0/1640478626 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f64e808a940 con 0x7f64f015df30 2024-08-18T23:56:50.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.700+0000 7f64f5c15640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f64d406be30 0x7f64d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:50.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.701+0000 7f64f5c15640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f64d406be30 0x7f64d406e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64ec034000 tx=0x7f64ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:50.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.704+0000 7f64e67fc640 1 -- 172.21.15.103:0/1640478626 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f64e8058ff0 con 0x7f64f015df30 2024-08-18T23:56:50.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:50.871+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f64f008dec0 con 0x7f64f015df30 2024-08-18T23:56:51.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.729+0000 7f64e67fc640 1 -- 172.21.15.103:0/1640478626 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f64e805d2f0 con 0x7f64f015df30 2024-08-18T23:56:51.731 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f64d406be30 msgr2=0x7f64d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f64d406be30 0x7f64d406e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64ec034000 tx=0x7f64ec02e000 comp rx=0 tx=0).stop 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 msgr2=0x7f64f015cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f015cf60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64e800c7a0 tx=0x7f64e800cc60 comp rx=0 tx=0).stop 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 shutdown_connections 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f64d406be30 0x7f64d406e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f64f015df30 0x7f64f015cf60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64f00b5580 0x7f64f00cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 --2- 172.21.15.103:0/1640478626 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64f00b11c0 0x7f64f00a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 >> 172.21.15.103:0/1640478626 conn(0x7f64f009d420 msgr2=0x7f64f006c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 shutdown_connections 2024-08-18T23:56:51.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.733+0000 7f64f7e79640 1 -- 172.21.15.103:0/1640478626 wait complete. 2024-08-18T23:56:51.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-18T23:56:51.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.860+0000 7f45ff265640 1 Processor -- start 2024-08-18T23:56:51.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.861+0000 7f45ff265640 1 -- start start 2024-08-18T23:56:51.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45ff265640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45f806c010 0x7f45f80cb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45ff265640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f45f80d19d0 0x7f45f80cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45ff265640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f8145d40 con 0x7f45f81455e0 2024-08-18T23:56:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45ff265640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f45f8072760 con 0x7f45f806c010 2024-08-18T23:56:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45ff265640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f45f8072a40 con 0x7f45f80d19d0 2024-08-18T23:56:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fc800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45f806c010 0x7f45f80cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fc800640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f45f806c010 0x7f45f80cb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43552/0 (socket says 172.21.15.103:43552) 2024-08-18T23:56:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fc800640 1 -- 172.21.15.103:0/726801301 learned_addr learned my addr 172.21.15.103:0/726801301 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:51.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fc800640 1 -- 172.21.15.103:0/726801301 >> v2:172.21.15.190:3300/0 conn(0x7f45f80d19d0 msgr2=0x7f45f80cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fd802640 1 --2- 172.21.15.103:0/726801301 >> v2:172.21.15.190:3300/0 conn(0x7f45f80d19d0 0x7f45f80cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fc800640 1 --2- 172.21.15.103:0/726801301 >> v2:172.21.15.190:3300/0 conn(0x7f45f80d19d0 0x7f45f80cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fc800640 1 -- 172.21.15.103:0/726801301 >> v1:172.21.15.190:6789/0 conn(0x7f45f81455e0 legacy=0x7f45f806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fc800640 1 -- 172.21.15.103:0/726801301 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f8072d20 con 0x7f45f806c010 2024-08-18T23:56:51.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.862+0000 7f45fd802640 1 --2- 172.21.15.103:0/726801301 >> v2:172.21.15.190:3300/0 conn(0x7f45f80d19d0 0x7f45f80cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:51.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.863+0000 7f45fc800640 1 --2- 172.21.15.103:0/726801301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f806c010 0x7f45f80cb500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f45f80745a0 tx=0x7f45e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbaac52d22603d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:51.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.863+0000 7f45effff640 1 -- 172.21.15.103:0/726801301 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8037070 con 0x7f45f806c010 2024-08-18T23:56:51.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.863+0000 7f45effff640 1 -- 172.21.15.103:0/726801301 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e8032440 con 0x7f45f806c010 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.863+0000 7f45effff640 1 -- 172.21.15.103:0/726801301 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8032810 con 0x7f45f806c010 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.864+0000 7f45ff265640 1 -- 172.21.15.103:0/726801301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f806c010 msgr2=0x7f45f80cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.864+0000 7f45ff265640 1 --2- 172.21.15.103:0/726801301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f806c010 0x7f45f80cb500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f45f80745a0 tx=0x7f45e802a230 comp rx=0 tx=0).stop 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.864+0000 7f45ff265640 1 -- 172.21.15.103:0/726801301 shutdown_connections 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.864+0000 7f45ff265640 1 --2- 172.21.15.103:0/726801301 >> v2:172.21.15.190:3300/0 conn(0x7f45f80d19d0 0x7f45f80cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.864+0000 7f45ff265640 1 --2- 172.21.15.103:0/726801301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f806c010 0x7f45f80cb500 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.864+0000 7f45ff265640 1 -- 172.21.15.103:0/726801301 >> 172.21.15.103:0/726801301 conn(0x7f45f80d0eb0 msgr2=0x7f45f80d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.864+0000 7f45ff265640 1 -- 172.21.15.103:0/726801301 shutdown_connections 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.864+0000 7f45ff265640 1 -- 172.21.15.103:0/726801301 wait complete. 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.865+0000 7f45ff265640 1 Processor -- start 2024-08-18T23:56:51.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.865+0000 7f45ff265640 1 -- start start 2024-08-18T23:56:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45ff265640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f806c010 0x7f45f81f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:51.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45ff265640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f80d19d0 0x7f45f813f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45ff265640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f81455e0 0x7f45f813f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45ff265640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f45f80cefc0 con 0x7f45f81455e0 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45ff265640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f45f80732e0 con 0x7f45f80d19d0 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45ff265640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f45f80cf140 con 0x7f45f806c010 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f81455e0 0x7f45f813f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f81455e0 0x7f45f813f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43568/0 (socket says 172.21.15.103:43568) 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 -- 172.21.15.103:0/1460809416 learned_addr learned my addr 172.21.15.103:0/1460809416 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fc800640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f80d19d0 0x7f45f813f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd001640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f806c010 0x7f45f81f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 -- 172.21.15.103:0/1460809416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f806c010 msgr2=0x7f45f81f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f806c010 0x7f45f81f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 -- 172.21.15.103:0/1460809416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f80d19d0 msgr2=0x7f45f813f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f80d19d0 0x7f45f813f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 -- 172.21.15.103:0/1460809416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f80b4890 con 0x7f45f81455e0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45fd802640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f81455e0 0x7f45f813f550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45f000c7f0 tx=0x7f45f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45edffb640 1 -- 172.21.15.103:0/1460809416 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0015070 con 0x7f45f81455e0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45edffb640 1 -- 172.21.15.103:0/1460809416 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f0007820 con 0x7f45f81455e0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f80b4b70 con 0x7f45f81455e0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.866+0000 7f45edffb640 1 -- 172.21.15.103:0/1460809416 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f0007c50 con 0x7f45f81455e0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.867+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f80b5130 con 0x7f45f81455e0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.868+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f80cea80 con 0x7f45f81455e0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.868+0000 7f45edffb640 1 -- 172.21.15.103:0/1460809416 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f45f0018070 con 0x7f45f81455e0 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.868+0000 7f45edffb640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f45dc06be30 0x7f45dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:51.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.868+0000 7f45fd001640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f45dc06be30 0x7f45dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:51.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.868+0000 7f45edffb640 1 -- 172.21.15.103:0/1460809416 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f45f008ad10 con 0x7f45f81455e0 2024-08-18T23:56:51.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.869+0000 7f45fd001640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f45dc06be30 0x7f45dc06e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45f400b450 tx=0x7f45f400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:51.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:51.873+0000 7f45edffb640 1 -- 172.21.15.103:0/1460809416 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f45f00592e0 con 0x7f45f81455e0 2024-08-18T23:56:52.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.038+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f45f806c630 con 0x7f45f81455e0 2024-08-18T23:56:52.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.731+0000 7f45edffb640 1 -- 172.21.15.103:0/1460809416 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f45f005d5e0 con 0x7f45f81455e0 2024-08-18T23:56:52.733 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-08-18T23:56:52.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f45dc06be30 msgr2=0x7f45dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:52.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f45dc06be30 0x7f45dc06e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f45f400b450 tx=0x7f45f400d040 comp rx=0 tx=0).stop 2024-08-18T23:56:52.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f81455e0 msgr2=0x7f45f813f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f81455e0 0x7f45f813f550 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f45f000c7f0 tx=0x7f45f000ccb0 comp rx=0 tx=0).stop 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 shutdown_connections 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f45dc06be30 0x7f45dc06e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45f81455e0 0x7f45f813f550 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45f80d19d0 0x7f45f813f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 --2- 172.21.15.103:0/1460809416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45f806c010 0x7f45f81f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 >> 172.21.15.103:0/1460809416 conn(0x7f45f80d0eb0 msgr2=0x7f45f80b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 shutdown_connections 2024-08-18T23:56:52.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.734+0000 7f45ff265640 1 -- 172.21.15.103:0/1460809416 wait complete. 2024-08-18T23:56:52.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T23:56:52.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.863+0000 7f8e14b9d640 1 Processor -- start 2024-08-18T23:56:52.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.863+0000 7f8e14b9d640 1 -- start start 2024-08-18T23:56:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.864+0000 7f8e14b9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100d4b30 0x7f8e100d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.864+0000 7f8e14b9d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e100cee90 con 0x7f8e100cfc50 2024-08-18T23:56:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.864+0000 7f8e14b9d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e100cf170 con 0x7f8e1015e020 2024-08-18T23:56:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.864+0000 7f8e14b9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e100cf7c0 con 0x7f8e100d4b30 2024-08-18T23:56:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.864+0000 7f8e0ffff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8e100cfc50 0x7f8e100b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:36816/0 (socket says 172.21.15.103:36816) 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.864+0000 7f8e0ffff640 1 -- 172.21.15.103:0/2709155531 learned_addr learned my addr 172.21.15.103:0/2709155531 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.864+0000 7f8e0effd640 1 --2- 172.21.15.103:0/2709155531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100d4b30 0x7f8e100d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.865+0000 7f8e0e7fc640 1 -- 172.21.15.103:0/2709155531 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469563671 0 0) 0x7f8e100cee90 con 0x7f8e100cfc50 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.865+0000 7f8e0e7fc640 1 -- 172.21.15.103:0/2709155531 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df8003520 con 0x7f8e100cfc50 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.865+0000 7f8e0e7fc640 1 -- 172.21.15.103:0/2709155531 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985947820 0 0) 0x7f8e100cf170 con 0x7f8e1015e020 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.865+0000 7f8e0e7fc640 1 -- 172.21.15.103:0/2709155531 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e100cee90 con 0x7f8e1015e020 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.865+0000 7f8e0effd640 1 -- 172.21.15.103:0/2709155531 >> v1:172.21.15.190:6789/0 conn(0x7f8e1015e020 legacy=0x7f8e100d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.865+0000 7f8e0effd640 1 -- 172.21.15.103:0/2709155531 >> v1:172.21.15.103:6789/0 conn(0x7f8e100cfc50 legacy=0x7f8e100b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.865+0000 7f8e0effd640 1 -- 172.21.15.103:0/2709155531 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e100cf450 con 0x7f8e100d4b30 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e0effd640 1 --2- 172.21.15.103:0/2709155531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100d4b30 0x7f8e100d2510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e040097d0 tx=0x7f8e0402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57ca1bffccf6cf9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e0e7fc640 1 -- 172.21.15.103:0/2709155531 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04037070 con 0x7f8e100d4b30 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e0e7fc640 1 -- 172.21.15.103:0/2709155531 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e04032440 con 0x7f8e100d4b30 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e0e7fc640 1 -- 172.21.15.103:0/2709155531 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e040327f0 con 0x7f8e100d4b30 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e14b9d640 1 -- 172.21.15.103:0/2709155531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100d4b30 msgr2=0x7f8e100d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e14b9d640 1 --2- 172.21.15.103:0/2709155531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100d4b30 0x7f8e100d2510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8e040097d0 tx=0x7f8e0402a210 comp rx=0 tx=0).stop 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e14b9d640 1 -- 172.21.15.103:0/2709155531 shutdown_connections 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e14b9d640 1 --2- 172.21.15.103:0/2709155531 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100d4b30 0x7f8e100d2510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e14b9d640 1 -- 172.21.15.103:0/2709155531 >> 172.21.15.103:0/2709155531 conn(0x7f8e100d3f30 msgr2=0x7f8e100d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e14b9d640 1 -- 172.21.15.103:0/2709155531 shutdown_connections 2024-08-18T23:56:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.866+0000 7f8e14b9d640 1 -- 172.21.15.103:0/2709155531 wait complete. 2024-08-18T23:56:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.867+0000 7f8e14b9d640 1 Processor -- start 2024-08-18T23:56:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.868+0000 7f8e14b9d640 1 -- start start 2024-08-18T23:56:52.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.868+0000 7f8e14b9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100cfc50 0x7f8e101571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:52.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.868+0000 7f8e14b9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e100d4b30 0x7f8e100ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:52.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.868+0000 7f8e14b9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e1015e020 0x7f8e100b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.868+0000 7f8e14b9d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1015e400 con 0x7f8e1015e020 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.868+0000 7f8e14b9d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e100d2210 con 0x7f8e100d4b30 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.868+0000 7f8e14b9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e1015e580 con 0x7f8e100cfc50 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e1015e020 0x7f8e100b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e1015e020 0x7f8e100b8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43570/0 (socket says 172.21.15.103:43570) 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 -- 172.21.15.103:0/4250428077 learned_addr learned my addr 172.21.15.103:0/4250428077 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0f7fe640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100cfc50 0x7f8e101571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0effd640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e100d4b30 0x7f8e100ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 -- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100cfc50 msgr2=0x7f8e101571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100cfc50 0x7f8e101571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 -- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e100d4b30 msgr2=0x7f8e100ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e100d4b30 0x7f8e100ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 -- 172.21.15.103:0/4250428077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e10157e70 con 0x7f8e1015e020 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0f7fe640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100cfc50 0x7f8e101571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0effd640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e100d4b30 0x7f8e100ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e0ffff640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e1015e020 0x7f8e100b8080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800cbd0 tx=0x7f8e0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8df7fff640 1 -- 172.21.15.103:0/4250428077 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08017070 con 0x7f8e1015e020 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8df7fff640 1 -- 172.21.15.103:0/4250428077 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0800ace0 con 0x7f8e1015e020 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e10158150 con 0x7f8e1015e020 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8df7fff640 1 -- 172.21.15.103:0/4250428077 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e08012620 con 0x7f8e1015e020 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.869+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e10158710 con 0x7f8e1015e020 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.870+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e100d1b00 con 0x7f8e1015e020 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.871+0000 7f8df7fff640 1 -- 172.21.15.103:0/4250428077 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e0801a070 con 0x7f8e1015e020 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.871+0000 7f8df7fff640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8dfc06be60 0x7f8dfc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.871+0000 7f8df7fff640 1 -- 172.21.15.103:0/4250428077 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f8e0808aec0 con 0x7f8e1015e020 2024-08-18T23:56:52.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.871+0000 7f8e0f7fe640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8dfc06be60 0x7f8dfc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:52.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.872+0000 7f8e0f7fe640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8dfc06be60 0x7f8dfc06e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e000011e0 tx=0x7f8e00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:52.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:52.876+0000 7f8df7fff640 1 -- 172.21.15.103:0/4250428077 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8e08059840 con 0x7f8e1015e020 2024-08-18T23:56:53.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.076+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8e1006cc20 con 0x7f8e1015e020 2024-08-18T23:56:53.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.742+0000 7f8df7fff640 1 -- 172.21.15.103:0/4250428077 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f8e08059140 con 0x7f8e1015e020 2024-08-18T23:56:53.744 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 2 and data pool 3 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8dfc06be60 msgr2=0x7f8dfc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8dfc06be60 0x7f8dfc06e320 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e000011e0 tx=0x7f8e00009040 comp rx=0 tx=0).stop 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e1015e020 msgr2=0x7f8e100b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e1015e020 0x7f8e100b8080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800cbd0 tx=0x7f8e0800a430 comp rx=0 tx=0).stop 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 shutdown_connections 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8dfc06be60 0x7f8dfc06e320 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e1015e020 0x7f8e100b8080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e100d4b30 0x7f8e100ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 --2- 172.21.15.103:0/4250428077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e100cfc50 0x7f8e101571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.745+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 >> 172.21.15.103:0/4250428077 conn(0x7f8e100d3f30 msgr2=0x7f8e1015f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:53.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.746+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 shutdown_connections 2024-08-18T23:56:53.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.746+0000 7f8e14b9d640 1 -- 172.21.15.103:0/4250428077 wait complete. 2024-08-18T23:56:53.772 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-18T23:56:53.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-18T23:56:53.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.879+0000 7ff5a471a640 1 Processor -- start 2024-08-18T23:56:53.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.879+0000 7ff5a471a640 1 -- start start 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a471a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff59c0cf890 0x7ff59c0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a471a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff59c0d01e0 con 0x7ff59c15e2f0 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a471a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff59c15e6d0 con 0x7ff59c06c330 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a471a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff59c0d1370 con 0x7ff59c0cf890 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a24b6640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff59c15e2f0 0x7ff59c06ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49804/0 (socket says 172.21.15.103:49804) 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a24b6640 1 -- 172.21.15.103:0/383555776 learned_addr learned my addr 172.21.15.103:0/383555776 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a2cb7640 1 --2- 172.21.15.103:0/383555776 >> v2:172.21.15.190:3300/0 conn(0x7ff59c0cf890 0x7ff59c0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851728 0 0) 0x7ff598001110 con 0x7ff59c15e2f0 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff588003520 con 0x7ff59c15e2f0 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4155699238 0 0) 0x7ff588003520 con 0x7ff59c15e2f0 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 >> v2:172.21.15.190:3300/0 conn(0x7ff59c0cf890 msgr2=0x7ff59c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:53.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 --2- 172.21.15.103:0/383555776 >> v2:172.21.15.190:3300/0 conn(0x7ff59c0cf890 0x7ff59c0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 >> v1:172.21.15.190:6789/0 conn(0x7ff59c06c330 legacy=0x7ff59c0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c0d1650 con 0x7ff59c15e2f0 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7ff598001840 con 0x7ff59c15e2f0 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a2cb7640 1 --2- 172.21.15.103:0/383555776 >> v2:172.21.15.190:3300/0 conn(0x7ff59c0cf890 0x7ff59c0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 >> v1:172.21.15.103:6789/0 conn(0x7ff59c15e2f0 legacy=0x7ff59c06ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff588003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff588004800 0x7ff588004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5880051c0 0x7ff58800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0d1370 con 0x7ff588004800 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff58800c110 con 0x7ff5880039b0 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.880+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff58800c310 con 0x7ff5880051c0 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a24b6640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff588003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a1cb5640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff588004800 0x7ff588004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:53.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a2cb7640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5880051c0 0x7ff58800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a24b6640 1 -- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5880051c0 msgr2=0x7ff58800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a24b6640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff5880051c0 0x7ff58800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a24b6640 1 -- 172.21.15.103:0/383555776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff588004800 msgr2=0x7ff588004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a24b6640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff588004800 0x7ff588004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a24b6640 1 -- 172.21.15.103:0/383555776 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff588003520 con 0x7ff5880039b0 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a2cb7640 1 -- 172.21.15.103:0/383555776 reap_dead start 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.881+0000 7ff5a1cb5640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff588004800 0x7ff588004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a24b6640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff588003d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff59800c4c0 tx=0x7ff588005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4f8bf3b19c53ee0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800c0e0 con 0x7ff5880039b0 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff598034070 con 0x7ff5880039b0 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a14b4640 1 -- 172.21.15.103:0/383555776 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598005d50 con 0x7ff5880039b0 2024-08-18T23:56:53.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a471a640 1 -- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 msgr2=0x7ff588003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:53.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a471a640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff588003d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff59800c4c0 tx=0x7ff588005830 comp rx=0 tx=0).stop 2024-08-18T23:56:53.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a471a640 1 -- 172.21.15.103:0/383555776 shutdown_connections 2024-08-18T23:56:53.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a471a640 1 --2- 172.21.15.103:0/383555776 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff588003d90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a471a640 1 -- 172.21.15.103:0/383555776 >> 172.21.15.103:0/383555776 conn(0x7ff59c0b2b80 msgr2=0x7ff59c0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:53.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a471a640 1 -- 172.21.15.103:0/383555776 shutdown_connections 2024-08-18T23:56:53.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.882+0000 7ff5a471a640 1 -- 172.21.15.103:0/383555776 wait complete. 2024-08-18T23:56:53.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.883+0000 7ff5a471a640 1 Processor -- start 2024-08-18T23:56:53.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a471a640 1 -- start start 2024-08-18T23:56:53.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a471a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff59c145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:53.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a471a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff59c15acb0 0x7ff59c1f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:53.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a471a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff59c153b10 0x7ff59c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a471a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0cfca0 con 0x7ff59c153b10 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a471a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff59c0d1c10 con 0x7ff5880039b0 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a471a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff59c0cfe20 con 0x7ff59c15acb0 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a2cb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff59c153b10 0x7ff59c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a2cb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff59c153b10 0x7ff59c0aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51134/0 (socket says 172.21.15.103:51134) 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a2cb7640 1 -- 172.21.15.103:0/1989040987 learned_addr learned my addr 172.21.15.103:0/1989040987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a24b6640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff59c145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.884+0000 7ff5a1cb5640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff59c15acb0 0x7ff59c1f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a2cb7640 1 -- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff59c15acb0 msgr2=0x7ff59c1f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a2cb7640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff59c15acb0 0x7ff59c1f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a2cb7640 1 -- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 msgr2=0x7ff59c145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a2cb7640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff59c145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:53.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a2cb7640 1 -- 172.21.15.103:0/1989040987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c145dd0 con 0x7ff59c153b10 2024-08-18T23:56:53.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a24b6640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff59c145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:53.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a2cb7640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff59c153b10 0x7ff59c0aef50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06c7a0 tx=0x7ff59400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:53.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff592ffd640 1 -- 172.21.15.103:0/1989040987 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594003990 con 0x7ff59c153b10 2024-08-18T23:56:53.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff592ffd640 1 -- 172.21.15.103:0/1989040987 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff594003b30 con 0x7ff59c153b10 2024-08-18T23:56:53.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff592ffd640 1 -- 172.21.15.103:0/1989040987 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff594004020 con 0x7ff59c153b10 2024-08-18T23:56:53.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59c157fd0 con 0x7ff59c153b10 2024-08-18T23:56:53.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.885+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff59c160800 con 0x7ff59c153b10 2024-08-18T23:56:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.886+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59c06ef40 con 0x7ff59c153b10 2024-08-18T23:56:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.886+0000 7ff592ffd640 1 -- 172.21.15.103:0/1989040987 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff5940041c0 con 0x7ff59c153b10 2024-08-18T23:56:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.887+0000 7ff592ffd640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff58006be30 0x7ff58006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.887+0000 7ff592ffd640 1 -- 172.21.15.103:0/1989040987 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7ff59408bb30 con 0x7ff59c153b10 2024-08-18T23:56:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.887+0000 7ff5a24b6640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff58006be30 0x7ff58006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:53.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.887+0000 7ff5a24b6640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff58006be30 0x7ff58006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff598033000 tx=0x7ff59802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:53.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:53.891+0000 7ff592ffd640 1 -- 172.21.15.103:0/1989040987 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff594019030 con 0x7ff59c153b10 2024-08-18T23:56:54.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.063+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ff59c0cf260 con 0x7ff59c153b10 2024-08-18T23:56:54.140 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:56:54.143 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:56:54.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.759+0000 7ff592ffd640 1 -- 172.21.15.103:0/1989040987 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7ff594010040 con 0x7ff59c153b10 2024-08-18T23:56:54.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff58006be30 msgr2=0x7ff58006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:54.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff58006be30 0x7ff58006e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff598033000 tx=0x7ff59802e000 comp rx=0 tx=0).stop 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff59c153b10 msgr2=0x7ff59c0aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff59c153b10 0x7ff59c0aef50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff59c06c7a0 tx=0x7ff59400f580 comp rx=0 tx=0).stop 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 shutdown_connections 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff58006be30 0x7ff58006e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff59c153b10 0x7ff59c0aef50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff59c15acb0 0x7ff59c1f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 --2- 172.21.15.103:0/1989040987 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff5880039b0 0x7ff59c145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 >> 172.21.15.103:0/1989040987 conn(0x7ff59c0b2b80 msgr2=0x7ff59c0b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 shutdown_connections 2024-08-18T23:56:54.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.762+0000 7ff5a471a640 1 -- 172.21.15.103:0/1989040987 wait complete. 2024-08-18T23:56:54.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T23:56:54.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.886+0000 7fe37fa30640 1 Processor -- start 2024-08-18T23:56:54.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.886+0000 7fe37fa30640 1 -- start start 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37fa30640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe37815a700 0x7fe37815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37fa30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 0x7fe3780ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37fa30640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe37815aae0 con 0x7fe3780cf380 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37fa30640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe37806ecb0 con 0x7fe37815a700 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37fa30640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe37806e0a0 con 0x7fe3780ca540 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37d7cc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe37815a700 0x7fe37815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37cfcb640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe3780cf380 0x7fe37806f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49806/0 (socket says 172.21.15.103:49806) 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37cfcb640 1 -- 172.21.15.103:0/4167882449 learned_addr learned my addr 172.21.15.103:0/4167882449 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37dfcd640 1 --2- 172.21.15.103:0/4167882449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 0x7fe3780ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:54.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37d7cc640 1 -- 172.21.15.103:0/4167882449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 msgr2=0x7fe3780ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37d7cc640 1 --2- 172.21.15.103:0/4167882449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 0x7fe3780ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37d7cc640 1 -- 172.21.15.103:0/4167882449 >> v1:172.21.15.103:6789/0 conn(0x7fe3780cf380 legacy=0x7fe37806f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe36ffff640 1 -- 172.21.15.103:0/4167882449 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125320990 0 0) 0x7fe37815aae0 con 0x7fe3780cf380 2024-08-18T23:56:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.887+0000 7fe37d7cc640 1 -- 172.21.15.103:0/4167882449 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe37806e380 con 0x7fe37815a700 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.888+0000 7fe37d7cc640 1 --2- 172.21.15.103:0/4167882449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37815ebe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3740097a0 tx=0x7fe37402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf28fd18db605936 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.888+0000 7fe36ffff640 1 -- 172.21.15.103:0/4167882449 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374037070 con 0x7fe37815a700 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.888+0000 7fe36ffff640 1 -- 172.21.15.103:0/4167882449 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe37402ae50 con 0x7fe37815a700 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.888+0000 7fe36ffff640 1 -- 172.21.15.103:0/4167882449 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374032660 con 0x7fe37815a700 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.889+0000 7fe37fa30640 1 -- 172.21.15.103:0/4167882449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 msgr2=0x7fe37815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.889+0000 7fe37fa30640 1 --2- 172.21.15.103:0/4167882449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37815ebe0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe3740097a0 tx=0x7fe37402a100 comp rx=0 tx=0).stop 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.889+0000 7fe37fa30640 1 -- 172.21.15.103:0/4167882449 shutdown_connections 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.889+0000 7fe37fa30640 1 --2- 172.21.15.103:0/4167882449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 0x7fe3780ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.889+0000 7fe37fa30640 1 --2- 172.21.15.103:0/4167882449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37815ebe0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.889+0000 7fe37fa30640 1 -- 172.21.15.103:0/4167882449 >> 172.21.15.103:0/4167882449 conn(0x7fe3780cc760 msgr2=0x7fe3780ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.889+0000 7fe37fa30640 1 -- 172.21.15.103:0/4167882449 shutdown_connections 2024-08-18T23:56:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.889+0000 7fe37fa30640 1 -- 172.21.15.103:0/4167882449 wait complete. 2024-08-18T23:56:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.890+0000 7fe37fa30640 1 Processor -- start 2024-08-18T23:56:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.890+0000 7fe37fa30640 1 -- start start 2024-08-18T23:56:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37fa30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 0x7fe37814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37fa30640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3780cf380 0x7fe378149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:54.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37fa30640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37809bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37fa30640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe37806f850 con 0x7fe37815a700 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37fa30640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe37806e940 con 0x7fe3780cf380 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37fa30640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe37806d6e0 con 0x7fe3780ca540 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37809bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37809bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51138/0 (socket says 172.21.15.103:51138) 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 -- 172.21.15.103:0/1032624334 learned_addr learned my addr 172.21.15.103:0/1032624334 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37d7cc640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 0x7fe37814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37cfcb640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3780cf380 0x7fe378149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 -- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 msgr2=0x7fe37814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 0x7fe37814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 -- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3780cf380 msgr2=0x7fe378149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3780cf380 0x7fe378149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:54.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 -- 172.21.15.103:0/1032624334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe378150150 con 0x7fe37815a700 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37cfcb640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3780cf380 0x7fe378149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe37dfcd640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37809bc30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe370007e40 tx=0x7fe37000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.891+0000 7fe36dffb640 1 -- 172.21.15.103:0/1032624334 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370014620 con 0x7fe37815a700 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.892+0000 7fe36dffb640 1 -- 172.21.15.103:0/1032624334 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe370019070 con 0x7fe37815a700 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.892+0000 7fe36dffb640 1 -- 172.21.15.103:0/1032624334 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe370014a20 con 0x7fe37815a700 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.892+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe378153f80 con 0x7fe37815a700 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.892+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37814fd30 con 0x7fe37815a700 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.893+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37806da70 con 0x7fe37815a700 2024-08-18T23:56:54.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.893+0000 7fe36dffb640 1 -- 172.21.15.103:0/1032624334 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe370014bc0 con 0x7fe37815a700 2024-08-18T23:56:54.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.893+0000 7fe36dffb640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe35c06be30 0x7fe35c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:54.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.894+0000 7fe36dffb640 1 -- 172.21.15.103:0/1032624334 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fe37008b800 con 0x7fe37815a700 2024-08-18T23:56:54.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.894+0000 7fe37d7cc640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe35c06be30 0x7fe35c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:54.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.894+0000 7fe37d7cc640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe35c06be30 0x7fe35c06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe374034000 tx=0x7fe37402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:54.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:54.898+0000 7fe36dffb640 1 -- 172.21.15.103:0/1032624334 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe37005a080 con 0x7fe37815a700 2024-08-18T23:56:55.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:55.066+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe37815f050 con 0x7fe37815a700 2024-08-18T23:56:56.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.773+0000 7fe36dffb640 1 -- 172.21.15.103:0/1032624334 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fe370059980 con 0x7fe37815a700 2024-08-18T23:56:56.775 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' created 2024-08-18T23:56:56.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.777+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe35c06be30 msgr2=0x7fe35c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:56.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.777+0000 7fe37fa30640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe35c06be30 0x7fe35c06e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe374034000 tx=0x7fe37402e000 comp rx=0 tx=0).stop 2024-08-18T23:56:56.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.777+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 msgr2=0x7fe37809bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:56.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.778+0000 7fe37fa30640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37809bc30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe370007e40 tx=0x7fe37000e4b0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.778+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 shutdown_connections 2024-08-18T23:56:56.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.778+0000 7fe37fa30640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe35c06be30 0x7fe35c06e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.778+0000 7fe37fa30640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe37815a700 0x7fe37809bc30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.778+0000 7fe37fa30640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3780cf380 0x7fe378149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.778+0000 7fe37fa30640 1 --2- 172.21.15.103:0/1032624334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3780ca540 0x7fe37814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.778+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 >> 172.21.15.103:0/1032624334 conn(0x7fe3780cc760 msgr2=0x7fe3780732b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:56.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.780+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 shutdown_connections 2024-08-18T23:56:56.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.781+0000 7fe37fa30640 1 -- 172.21.15.103:0/1032624334 wait complete. 2024-08-18T23:56:56.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-18T23:56:56.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.906+0000 7f1d5299a640 1 Processor -- start 2024-08-18T23:56:56.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.906+0000 7f1d5299a640 1 -- start start 2024-08-18T23:56:56.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.906+0000 7f1d5299a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d4c15e330 0x7f1d4c0ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.906+0000 7f1d5299a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4c06b900 con 0x7f1d4c06f8d0 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.906+0000 7f1d5299a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4c06f080 con 0x7f1d4c0b3f80 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.906+0000 7f1d5299a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4c06bba0 con 0x7f1d4c15e330 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.907+0000 7f1d4bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d4c15e330 0x7f1d4c0ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.907+0000 7f1d4b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f1d4c06f8d0 0x7f1d4c0b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49820/0 (socket says 172.21.15.103:49820) 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.907+0000 7f1d4b7fe640 1 -- 172.21.15.103:0/3623056409 learned_addr learned my addr 172.21.15.103:0/3623056409 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.907+0000 7f1d4bfff640 1 -- 172.21.15.103:0/3623056409 >> v1:172.21.15.190:6789/0 conn(0x7f1d4c0b3f80 legacy=0x7f1d4c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.907+0000 7f1d4bfff640 1 -- 172.21.15.103:0/3623056409 >> v1:172.21.15.103:6789/0 conn(0x7f1d4c06f8d0 legacy=0x7f1d4c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.907+0000 7f1d4bfff640 1 -- 172.21.15.103:0/3623056409 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c06be80 con 0x7f1d4c15e330 2024-08-18T23:56:56.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.907+0000 7f1d4affd640 1 -- 172.21.15.103:0/3623056409 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093893075 0 0) 0x7f1d4c06b900 con 0x7f1d4c06f8d0 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d4bfff640 1 --2- 172.21.15.103:0/3623056409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0ad8b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0097a0 tx=0x7f1d3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5b4014b82e1585 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d4affd640 1 -- 172.21.15.103:0/3623056409 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c037070 con 0x7f1d4c15e330 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d4affd640 1 -- 172.21.15.103:0/3623056409 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c032440 con 0x7f1d4c15e330 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d4affd640 1 -- 172.21.15.103:0/3623056409 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c032810 con 0x7f1d4c15e330 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d5299a640 1 -- 172.21.15.103:0/3623056409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 msgr2=0x7f1d4c0ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d5299a640 1 --2- 172.21.15.103:0/3623056409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0ad8b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0097a0 tx=0x7f1d3c02a1e0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d5299a640 1 -- 172.21.15.103:0/3623056409 shutdown_connections 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d5299a640 1 --2- 172.21.15.103:0/3623056409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0ad8b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d5299a640 1 -- 172.21.15.103:0/3623056409 >> 172.21.15.103:0/3623056409 conn(0x7f1d4c0d0650 msgr2=0x7f1d4c0d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:56.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d5299a640 1 -- 172.21.15.103:0/3623056409 shutdown_connections 2024-08-18T23:56:56.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.908+0000 7f1d5299a640 1 -- 172.21.15.103:0/3623056409 wait complete. 2024-08-18T23:56:56.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.909+0000 7f1d5299a640 1 Processor -- start 2024-08-18T23:56:56.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.910+0000 7f1d5299a640 1 -- start start 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.910+0000 7f1d5299a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c06f8d0 0x7f1d4c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.910+0000 7f1d5299a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4c0b3f80 0x7f1d4c155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.910+0000 7f1d5299a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.910+0000 7f1d5299a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c06de80 con 0x7f1d4c15e330 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.910+0000 7f1d5299a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c06ed70 con 0x7f1d4c06f8d0 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.910+0000 7f1d5299a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c06e000 con 0x7f1d4c0b3f80 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.910+0000 7f1d50f37640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d50f37640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51158/0 (socket says 172.21.15.103:51158) 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d50f37640 1 -- 172.21.15.103:0/4265781103 learned_addr learned my addr 172.21.15.103:0/4265781103 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:56.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d4bfff640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c06f8d0 0x7f1d4c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d4b7fe640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4c0b3f80 0x7f1d4c155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d50f37640 1 -- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4c0b3f80 msgr2=0x7f1d4c155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d50f37640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4c0b3f80 0x7f1d4c155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d50f37640 1 -- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c06f8d0 msgr2=0x7f1d4c1543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d50f37640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c06f8d0 0x7f1d4c1543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d50f37640 1 -- 172.21.15.103:0/4265781103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c156180 con 0x7f1d4c15e330 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d4b7fe640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4c0b3f80 0x7f1d4c155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d4bfff640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c06f8d0 0x7f1d4c1543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d50f37640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0cf600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c780 tx=0x7f1d4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d48ff9640 1 -- 172.21.15.103:0/4265781103 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44004b60 con 0x7f1d4c15e330 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d48ff9640 1 -- 172.21.15.103:0/4265781103 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d44004d00 con 0x7f1d4c15e330 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4c160b90 con 0x7f1d4c15e330 2024-08-18T23:56:56.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d48ff9640 1 -- 172.21.15.103:0/4265781103 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4400aa90 con 0x7f1d4c15e330 2024-08-18T23:56:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.911+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4c161150 con 0x7f1d4c15e330 2024-08-18T23:56:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.912+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d4c0746c0 con 0x7f1d4c15e330 2024-08-18T23:56:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.913+0000 7f1d48ff9640 1 -- 172.21.15.103:0/4265781103 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d4400ac30 con 0x7f1d4c15e330 2024-08-18T23:56:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.913+0000 7f1d48ff9640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.913+0000 7f1d4bfff640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.913+0000 7f1d48ff9640 1 -- 172.21.15.103:0/4265781103 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f1d4408b380 con 0x7f1d4c15e330 2024-08-18T23:56:56.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.913+0000 7f1d4bfff640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c034000 tx=0x7f1d3c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:56.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:56.918+0000 7f1d48ff9640 1 -- 172.21.15.103:0/4265781103 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1d44020070 con 0x7f1d4c15e330 2024-08-18T23:56:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.082+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f1d4c0d03c0 con 0x7f1d4c15e330 2024-08-18T23:56:57.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.775+0000 7f1d48ff9640 1 -- 172.21.15.103:0/4265781103 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f1d44059aa0 con 0x7f1d4c15e330 2024-08-18T23:56:57.777 INFO:teuthology.orchestra.run.smithi103.stderr:set pool 4 allow_ec_overwrites to true 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1d2c06be30 msgr2=0x7f1d2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c034000 tx=0x7f1d3c02e000 comp rx=0 tx=0).stop 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 msgr2=0x7f1d4c0cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0cf600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c780 tx=0x7f1d4400cc40 comp rx=0 tx=0).stop 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 shutdown_connections 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1d2c06be30 0x7f1d2c06e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d4c15e330 0x7f1d4c0cf600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4c0b3f80 0x7f1d4c155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 --2- 172.21.15.103:0/4265781103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d4c06f8d0 0x7f1d4c1543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 >> 172.21.15.103:0/4265781103 conn(0x7f1d4c0d0650 msgr2=0x7f1d4c06c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:57.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.781+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 shutdown_connections 2024-08-18T23:56:57.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.782+0000 7f1d5299a640 1 -- 172.21.15.103:0/4265781103 wait complete. 2024-08-18T23:56:57.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-18T23:56:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.916+0000 7fa7cae6e640 1 Processor -- start 2024-08-18T23:56:57.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.916+0000 7fa7cae6e640 1 -- start start 2024-08-18T23:56:57.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7cae6e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa7c40d1770 0x7fa7c4070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7cae6e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7c406db30 0x7fa7c40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7cae6e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7c4071000 con 0x7fa7c406cc20 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7cae6e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c406c760 con 0x7fa7c406db30 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7cae6e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c40ccce0 con 0x7fa7c40d1770 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7c940b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7c406db30 0x7fa7c40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7c940b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa7c406db30 0x7fa7c40cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51164/0 (socket says 172.21.15.103:51164) 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7c940b640 1 -- 172.21.15.103:0/32702456 learned_addr learned my addr 172.21.15.103:0/32702456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7c8c0a640 1 --2- 172.21.15.103:0/32702456 >> v2:172.21.15.190:3300/0 conn(0x7fa7c40d1770 0x7fa7c4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7c940b640 1 -- 172.21.15.103:0/32702456 >> v2:172.21.15.190:3300/0 conn(0x7fa7c40d1770 msgr2=0x7fa7c4070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7c940b640 1 --2- 172.21.15.103:0/32702456 >> v2:172.21.15.190:3300/0 conn(0x7fa7c40d1770 0x7fa7c4070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7c940b640 1 -- 172.21.15.103:0/32702456 >> v1:172.21.15.190:6789/0 conn(0x7fa7c406cc20 legacy=0x7fa7c406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:57.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.917+0000 7fa7c940b640 1 -- 172.21.15.103:0/32702456 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c40cc690 con 0x7fa7c406db30 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7c940b640 1 --2- 172.21.15.103:0/32702456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c406db30 0x7fa7c40cd170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40726a0 tx=0x7fa7bc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8788981a15f1b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7c37fe640 1 -- 172.21.15.103:0/32702456 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc036070 con 0x7fa7c406db30 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7c37fe640 1 -- 172.21.15.103:0/32702456 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc031600 con 0x7fa7c406db30 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7c37fe640 1 -- 172.21.15.103:0/32702456 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0319d0 con 0x7fa7c406db30 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7cae6e640 1 -- 172.21.15.103:0/32702456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c406db30 msgr2=0x7fa7c40cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/32702456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c406db30 0x7fa7c40cd170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7c40726a0 tx=0x7fa7bc02a6a0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7cae6e640 1 -- 172.21.15.103:0/32702456 shutdown_connections 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/32702456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c406db30 0x7fa7c40cd170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/32702456 >> v2:172.21.15.190:3300/0 conn(0x7fa7c40d1770 0x7fa7c4070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7cae6e640 1 -- 172.21.15.103:0/32702456 >> 172.21.15.103:0/32702456 conn(0x7fa7c40d1ec0 msgr2=0x7fa7c40d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7cae6e640 1 -- 172.21.15.103:0/32702456 shutdown_connections 2024-08-18T23:56:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.918+0000 7fa7cae6e640 1 -- 172.21.15.103:0/32702456 wait complete. 2024-08-18T23:56:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.920+0000 7fa7cae6e640 1 Processor -- start 2024-08-18T23:56:57.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.920+0000 7fa7cae6e640 1 -- start start 2024-08-18T23:56:57.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.920+0000 7fa7cae6e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7c406cc20 0x7fa7c41f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:57.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.920+0000 7fa7cae6e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7c406db30 0x7fa7c4158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:57.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7cae6e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c40d1770 0x7fa7c41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:57.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7cae6e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c40cd6b0 con 0x7fa7c40d1770 2024-08-18T23:56:57.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7cae6e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c40d1b50 con 0x7fa7c406cc20 2024-08-18T23:56:57.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7cae6e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c40cd830 con 0x7fa7c406db30 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c40d1770 0x7fa7c41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c40d1770 0x7fa7c41588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51178/0 (socket says 172.21.15.103:51178) 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 -- 172.21.15.103:0/2103631421 learned_addr learned my addr 172.21.15.103:0/2103631421 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c8c0a640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7c406cc20 0x7fa7c41f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c3fff640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7c406db30 0x7fa7c4158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 -- 172.21.15.103:0/2103631421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7c406db30 msgr2=0x7fa7c4158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7c406db30 0x7fa7c4158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 -- 172.21.15.103:0/2103631421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7c406cc20 msgr2=0x7fa7c41f75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7c406cc20 0x7fa7c41f75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 -- 172.21.15.103:0/2103631421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c40b6660 con 0x7fa7c40d1770 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c940b640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c40d1770 0x7fa7c41588b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009f40 tx=0x7fa7bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c17fa640 1 -- 172.21.15.103:0/2103631421 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc03f020 con 0x7fa7c40d1770 2024-08-18T23:56:57.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c17fa640 1 -- 172.21.15.103:0/2103631421 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc037040 con 0x7fa7c40d1770 2024-08-18T23:56:57.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7c17fa640 1 -- 172.21.15.103:0/2103631421 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc036070 con 0x7fa7c40d1770 2024-08-18T23:56:57.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c40c7dc0 con 0x7fa7c40d1770 2024-08-18T23:56:57.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.921+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c40b68d0 con 0x7fa7c40d1770 2024-08-18T23:56:57.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.922+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c40b6aa0 con 0x7fa7c40d1770 2024-08-18T23:56:57.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.923+0000 7fa7c17fa640 1 -- 172.21.15.103:0/2103631421 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7bc042020 con 0x7fa7c40d1770 2024-08-18T23:56:57.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.923+0000 7fa7c17fa640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa7a806be30 0x7fa7a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:57.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.923+0000 7fa7c17fa640 1 -- 172.21.15.103:0/2103631421 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fa7bc0ab540 con 0x7fa7c40d1770 2024-08-18T23:56:57.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.923+0000 7fa7c8c0a640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa7a806be30 0x7fa7a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:57.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.924+0000 7fa7c8c0a640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa7a806be30 0x7fa7a806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80079a0 tx=0x7fa7b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:57.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:57.927+0000 7fa7c17fa640 1 -- 172.21.15.103:0/2103631421 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa7bc049030 con 0x7fa7c40d1770 2024-08-18T23:56:58.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.134+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fa7c40cd170 con 0x7fa7c40d1770 2024-08-18T23:56:58.726 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-08-18T23:56:58.725+0000 7fdcfc928640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T23:56:58.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.799+0000 7fa7c17fa640 1 -- 172.21.15.103:0/2103631421 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fa7bc079580 con 0x7fa7c40d1770 2024-08-18T23:56:58.800 INFO:teuthology.orchestra.run.smithi103.stderr:added data pool 4 to fsmap 2024-08-18T23:56:58.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa7a806be30 msgr2=0x7fa7a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:58.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa7a806be30 0x7fa7a806e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80079a0 tx=0x7fa7b8008040 comp rx=0 tx=0).stop 2024-08-18T23:56:58.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c40d1770 msgr2=0x7fa7c41588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:58.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c40d1770 0x7fa7c41588b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009f40 tx=0x7fa7bc004a40 comp rx=0 tx=0).stop 2024-08-18T23:56:58.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 shutdown_connections 2024-08-18T23:56:58.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa7a806be30 0x7fa7a806e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa7c40d1770 0x7fa7c41588b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7c406db30 0x7fa7c4158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 --2- 172.21.15.103:0/2103631421 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa7c406cc20 0x7fa7c41f75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.801+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 >> 172.21.15.103:0/2103631421 conn(0x7fa7c40d1ec0 msgr2=0x7fa7c406df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:58.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.802+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 shutdown_connections 2024-08-18T23:56:58.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.802+0000 7fa7cae6e640 1 -- 172.21.15.103:0/2103631421 wait complete. 2024-08-18T23:56:58.816 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:56:58.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.919+0000 7fbbdc99a640 1 Processor -- start 2024-08-18T23:56:58.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.919+0000 7fbbdc99a640 1 -- start start 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.920+0000 7fbbdc99a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbbd815c980 0x7fbbd8072b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.920+0000 7fbbdc99a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd815cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.920+0000 7fbbdc99a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd80734a0 con 0x7fbbd8073060 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.920+0000 7fbbdc99a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbbd8072690 con 0x7fbbd815c980 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.920+0000 7fbbdc99a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd8071a80 con 0x7fbbd80af050 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.920+0000 7fbbd659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbbd815c980 0x7fbbd8072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.920+0000 7fbbd5d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbbd8073060 0x7fbbd80ae940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49826/0 (socket says 172.21.15.103:49826) 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.920+0000 7fbbd5d9b640 1 -- 172.21.15.103:0/3070804299 learned_addr learned my addr 172.21.15.103:0/3070804299 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:58.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd659c640 1 -- 172.21.15.103:0/3070804299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 msgr2=0x7fbbd815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:58.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd6d9d640 1 --2- 172.21.15.103:0/3070804299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd815cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:58.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd659c640 1 --2- 172.21.15.103:0/3070804299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd815cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd659c640 1 -- 172.21.15.103:0/3070804299 >> v1:172.21.15.103:6789/0 conn(0x7fbbd8073060 legacy=0x7fbbd80ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:58.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd559a640 1 -- 172.21.15.103:0/3070804299 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 872259650 0 0) 0x7fbbcc001110 con 0x7fbbd8073060 2024-08-18T23:56:58.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd659c640 1 -- 172.21.15.103:0/3070804299 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd8071d60 con 0x7fbbd815c980 2024-08-18T23:56:58.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd6d9d640 1 --2- 172.21.15.103:0/3070804299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd815cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:58.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd659c640 1 --2- 172.21.15.103:0/3070804299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd8072b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097a0 tx=0x7fbbc802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf8d564d5242368 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:58.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd559a640 1 -- 172.21.15.103:0/3070804299 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8037070 con 0x7fbbd815c980 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd559a640 1 -- 172.21.15.103:0/3070804299 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbc8032440 con 0x7fbbd815c980 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.921+0000 7fbbd559a640 1 -- 172.21.15.103:0/3070804299 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbc8032810 con 0x7fbbd815c980 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.922+0000 7fbbdc99a640 1 -- 172.21.15.103:0/3070804299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 msgr2=0x7fbbd8072b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.922+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/3070804299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd8072b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097a0 tx=0x7fbbc802a180 comp rx=0 tx=0).stop 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.922+0000 7fbbdc99a640 1 -- 172.21.15.103:0/3070804299 shutdown_connections 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.922+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/3070804299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd815cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.922+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/3070804299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd8072b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.922+0000 7fbbdc99a640 1 -- 172.21.15.103:0/3070804299 >> 172.21.15.103:0/3070804299 conn(0x7fbbd80cfc40 msgr2=0x7fbbd80d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.922+0000 7fbbdc99a640 1 -- 172.21.15.103:0/3070804299 shutdown_connections 2024-08-18T23:56:58.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.922+0000 7fbbdc99a640 1 -- 172.21.15.103:0/3070804299 wait complete. 2024-08-18T23:56:58.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.923+0000 7fbbdc99a640 1 Processor -- start 2024-08-18T23:56:58.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.923+0000 7fbbdc99a640 1 -- start start 2024-08-18T23:56:58.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbdc99a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd8073060 0x7fbbd8153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:58.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbdc99a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd81549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:58.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbdc99a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd809c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:58.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbdc99a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd80acf30 con 0x7fbbd815c980 2024-08-18T23:56:58.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbdc99a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd8072320 con 0x7fbbd8073060 2024-08-18T23:56:58.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbdc99a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd80ad0b0 con 0x7fbbd80af050 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd809c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd809c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51202/0 (socket says 172.21.15.103:51202) 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd6d9d640 1 -- 172.21.15.103:0/2646940040 learned_addr learned my addr 172.21.15.103:0/2646940040 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd5d9b640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd81549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd659c640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd8073060 0x7fbbd8153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd6d9d640 1 -- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 msgr2=0x7fbbd81549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd6d9d640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd81549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd6d9d640 1 -- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd8073060 msgr2=0x7fbbd8153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd6d9d640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd8073060 0x7fbbd8153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd6d9d640 1 -- 172.21.15.103:0/2646940040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd8153690 con 0x7fbbd815c980 2024-08-18T23:56:58.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.924+0000 7fbbd659c640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd8073060 0x7fbbd8153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.925+0000 7fbbd6d9d640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd809c670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000cef0 tx=0x7fbbd000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.925+0000 7fbbc6ffd640 1 -- 172.21.15.103:0/2646940040 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd001a070 con 0x7fbbd815c980 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.925+0000 7fbbc6ffd640 1 -- 172.21.15.103:0/2646940040 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd000d860 con 0x7fbbd815c980 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.925+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd8153930 con 0x7fbbd815c980 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.925+0000 7fbbc6ffd640 1 -- 172.21.15.103:0/2646940040 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000dc50 con 0x7fbbd815c980 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.925+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd8153ef0 con 0x7fbbd815c980 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.926+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd8071730 con 0x7fbbd815c980 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.926+0000 7fbbc6ffd640 1 -- 172.21.15.103:0/2646940040 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbd001d070 con 0x7fbbd815c980 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.927+0000 7fbbc6ffd640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbbb806be30 0x7fbbb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:58.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.927+0000 7fbbd659c640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbbb806be30 0x7fbbb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.927+0000 7fbbc6ffd640 1 -- 172.21.15.103:0/2646940040 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbbd008b9f0 con 0x7fbbd815c980 2024-08-18T23:56:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.927+0000 7fbbd659c640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbbb806be30 0x7fbbb806e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8034000 tx=0x7fbbc802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:58.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:58.931+0000 7fbbc6ffd640 1 -- 172.21.15.103:0/2646940040 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbbd005a1b0 con 0x7fbbd815c980 2024-08-18T23:56:59.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.129+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbd815f4f0 con 0x7fbbd815c980 2024-08-18T23:56:59.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.130+0000 7fbbc6ffd640 1 -- 172.21.15.103:0/2646940040 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5228 (secure 0 0 0) 0x7fbbd0059ab0 con 0x7fbbd815c980 2024-08-18T23:56:59.131 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:56:59.131 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"btime":"2024-08-18T23:56:58:789828+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:56:58.135592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:56:59.132 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 7 2024-08-18T23:56:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbbb806be30 msgr2=0x7fbbb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbbb806be30 0x7fbbb806e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8034000 tx=0x7fbbc802e000 comp rx=0 tx=0).stop 2024-08-18T23:56:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 msgr2=0x7fbbd809c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd809c670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000cef0 tx=0x7fbbd000a710 comp rx=0 tx=0).stop 2024-08-18T23:56:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 shutdown_connections 2024-08-18T23:56:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbbb806be30 0x7fbbb806e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbbd815c980 0x7fbbd809c670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbbd80af050 0x7fbbd81549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 --2- 172.21.15.103:0/2646940040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbbd8073060 0x7fbbd8153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 >> 172.21.15.103:0/2646940040 conn(0x7fbbd80cfc40 msgr2=0x7fbbd815d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:59.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 shutdown_connections 2024-08-18T23:56:59.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.132+0000 7fbbdc99a640 1 -- 172.21.15.103:0/2646940040 wait complete. 2024-08-18T23:56:59.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:56:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.241+0000 7f5b0eccb640 1 Processor -- start 2024-08-18T23:56:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.241+0000 7f5b0eccb640 1 -- start start 2024-08-18T23:56:59.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.241+0000 7f5b0eccb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5b080cfd10 0x7f5b0806c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0eccb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815ed20 0x7f5b0806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0eccb640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0815f340 con 0x7f5b080d00f0 2024-08-18T23:56:59.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0eccb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5b0815f920 con 0x7f5b080cfd10 2024-08-18T23:56:59.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0eccb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0815fc00 con 0x7f5b0815ed20 2024-08-18T23:56:59.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b07fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5b080d00f0 0x7f5b0815e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49838/0 (socket says 172.21.15.103:49838) 2024-08-18T23:56:59.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b07fff640 1 -- 172.21.15.103:0/852882557 learned_addr learned my addr 172.21.15.103:0/852882557 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:56:59.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0ca67640 1 --2- 172.21.15.103:0/852882557 >> v2:172.21.15.190:3300/0 conn(0x7f5b080cfd10 0x7f5b0806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0d268640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815ed20 0x7f5b0806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724070686 0 0) 0x7f5b0815f340 con 0x7f5b080d00f0 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af8003520 con 0x7f5b080d00f0 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 207589357 0 0) 0x7f5af8003520 con 0x7f5b080d00f0 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815ed20 msgr2=0x7f5b0806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815ed20 0x7f5b0806ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 >> v2:172.21.15.190:3300/0 conn(0x7f5b080cfd10 msgr2=0x7f5b0806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 --2- 172.21.15.103:0/852882557 >> v2:172.21.15.190:3300/0 conn(0x7f5b080cfd10 0x7f5b0806c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0815fee0 con 0x7f5b080d00f0 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f5af4001670 con 0x7f5b080d00f0 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0ca67640 1 --2- 172.21.15.103:0/852882557 >> v2:172.21.15.190:3300/0 conn(0x7f5b080cfd10 0x7f5b0806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:56:59.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 >> v1:172.21.15.103:6789/0 conn(0x7f5b080d00f0 legacy=0x7f5b0815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815ed20 0x7f5af80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8003f30 0x7f5af8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af8004d40 0x7f5af80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0815f920 con 0x7f5af8004d40 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0815fc00 con 0x7f5af8003f30 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5af800b9c0 con 0x7f5b0815ed20 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0d268640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af8004d40 0x7f5af80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.242+0000 7f5b0ca67640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815ed20 0x7f5af80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.243+0000 7f5b07fff640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8003f30 0x7f5af8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.243+0000 7f5b0d268640 1 -- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815ed20 msgr2=0x7f5af80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.243+0000 7f5b0d268640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815ed20 0x7f5af80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.243+0000 7f5b0d268640 1 -- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8003f30 msgr2=0x7f5af8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:59.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.243+0000 7f5b0d268640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5af8003f30 0x7f5af8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.243+0000 7f5b0d268640 1 -- 172.21.15.103:0/852882557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af8003520 con 0x7f5af8004d40 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.243+0000 7f5b0d268640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af8004d40 0x7f5af80051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009fc0 tx=0x7f5af8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4274b2b5ed2fd3ba server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.243+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00009c10 con 0x7f5af8004d40 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00036070 con 0x7f5af8004d40 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b077fe640 1 -- 172.21.15.103:0/852882557 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00031670 con 0x7f5af8004d40 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b0eccb640 1 -- 172.21.15.103:0/852882557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af8004d40 msgr2=0x7f5af80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b0eccb640 1 --2- 172.21.15.103:0/852882557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af8004d40 0x7f5af80051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009fc0 tx=0x7f5af8005830 comp rx=0 tx=0).stop 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b0d268640 1 -- 172.21.15.103:0/852882557 reap_dead start 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b0eccb640 1 -- 172.21.15.103:0/852882557 shutdown_connections 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b0eccb640 1 -- 172.21.15.103:0/852882557 >> 172.21.15.103:0/852882557 conn(0x7f5b08071f00 msgr2=0x7f5b08072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b0eccb640 1 -- 172.21.15.103:0/852882557 shutdown_connections 2024-08-18T23:56:59.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.244+0000 7f5b0eccb640 1 -- 172.21.15.103:0/852882557 wait complete. 2024-08-18T23:56:59.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.245+0000 7f5b0eccb640 1 Processor -- start 2024-08-18T23:56:59.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.245+0000 7f5b0eccb640 1 -- start start 2024-08-18T23:56:59.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0eccb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b08143020 0x7f5b08153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0eccb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b081e9180 0x7f5b0806ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0eccb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806f440 0x7f5b081e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0eccb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0806cfd0 con 0x7f5b0806f440 2024-08-18T23:56:59.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0eccb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0806ce50 con 0x7f5b081e9180 2024-08-18T23:56:59.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0eccb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0806d150 con 0x7f5b08143020 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0d268640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806f440 0x7f5b081e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0d268640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806f440 0x7f5b081e7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51220/0 (socket says 172.21.15.103:51220) 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0d268640 1 -- 172.21.15.103:0/3266115336 learned_addr learned my addr 172.21.15.103:0/3266115336 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b07fff640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b081e9180 0x7f5b0806ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.246+0000 7f5b0ca67640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b08143020 0x7f5b08153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b0d268640 1 -- 172.21.15.103:0/3266115336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b08143020 msgr2=0x7f5b08153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b0d268640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b08143020 0x7f5b08153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b0d268640 1 -- 172.21.15.103:0/3266115336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b081e9180 msgr2=0x7f5b0806ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b0d268640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b081e9180 0x7f5b0806ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b0d268640 1 -- 172.21.15.103:0/3266115336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b08153ff0 con 0x7f5b0806f440 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b0d268640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806f440 0x7f5b081e7940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b00033040 tx=0x7f5b00009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b057fa640 1 -- 172.21.15.103:0/3266115336 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00009c10 con 0x7f5b0806f440 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b057fa640 1 -- 172.21.15.103:0/3266115336 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00031dd0 con 0x7f5b0806f440 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b057fa640 1 -- 172.21.15.103:0/3266115336 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00003bb0 con 0x7f5b0806f440 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b08143a80 con 0x7f5b0806f440 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.247+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b08143400 con 0x7f5b0806f440 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.248+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0806f8c0 con 0x7f5b0806f440 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.248+0000 7f5b057fa640 1 -- 172.21.15.103:0/3266115336 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b00005d10 con 0x7f5b0806f440 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.249+0000 7f5b057fa640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5aec06be60 0x7f5aec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.249+0000 7f5b057fa640 1 -- 172.21.15.103:0/3266115336 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5b000abe60 con 0x7f5b0806f440 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.249+0000 7f5b0ca67640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5aec06be60 0x7f5aec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.249+0000 7f5b0ca67640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5aec06be60 0x7f5aec06e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009dc0 tx=0x7f5afc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.253+0000 7f5b057fa640 1 -- 172.21.15.103:0/3266115336 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5b00049060 con 0x7f5b0806f440 2024-08-18T23:56:59.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.421+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b0806c910 con 0x7f5b0806f440 2024-08-18T23:56:59.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.422+0000 7f5b057fa640 1 -- 172.21.15.103:0/3266115336 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f5b00079f10 con 0x7f5b0806f440 2024-08-18T23:56:59.424 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:56:59.424 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:56:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5aec06be60 msgr2=0x7f5aec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5aec06be60 0x7f5aec06e320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009dc0 tx=0x7f5afc009190 comp rx=0 tx=0).stop 2024-08-18T23:56:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806f440 msgr2=0x7f5b081e7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806f440 0x7f5b081e7940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b00033040 tx=0x7f5b00009750 comp rx=0 tx=0).stop 2024-08-18T23:56:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 shutdown_connections 2024-08-18T23:56:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5aec06be60 0x7f5aec06e320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806f440 0x7f5b081e7940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b081e9180 0x7f5b0806ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 --2- 172.21.15.103:0/3266115336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b08143020 0x7f5b08153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 >> 172.21.15.103:0/3266115336 conn(0x7f5b08071f00 msgr2=0x7f5b08074e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 shutdown_connections 2024-08-18T23:56:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.424+0000 7f5b0eccb640 1 -- 172.21.15.103:0/3266115336 wait complete. 2024-08-18T23:56:59.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:56:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.533+0000 7ff03b52e640 1 Processor -- start 2024-08-18T23:56:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.533+0000 7ff03b52e640 1 -- start start 2024-08-18T23:56:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff03b52e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0340d1750 0x7ff0340cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff03b52e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff03406d650 0x7ff0340b7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff03b52e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff03406da70 con 0x7ff03415e380 2024-08-18T23:56:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff03b52e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff0340b3500 con 0x7ff0340d1750 2024-08-18T23:56:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff03b52e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff0340b6a50 con 0x7ff03406d650 2024-08-18T23:56:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff038ac9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0340d1750 0x7ff0340cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff038ac9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff0340d1750 0x7ff0340cf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51236/0 (socket says 172.21.15.103:51236) 2024-08-18T23:56:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff038ac9640 1 -- 172.21.15.103:0/3247438099 learned_addr learned my addr 172.21.15.103:0/3247438099 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.534+0000 7ff039acb640 1 --2- 172.21.15.103:0/3247438099 >> v2:172.21.15.190:3300/0 conn(0x7ff03406d650 0x7ff0340b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.535+0000 7ff038ac9640 1 -- 172.21.15.103:0/3247438099 >> v2:172.21.15.190:3300/0 conn(0x7ff03406d650 msgr2=0x7ff0340b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.535+0000 7ff038ac9640 1 --2- 172.21.15.103:0/3247438099 >> v2:172.21.15.190:3300/0 conn(0x7ff03406d650 0x7ff0340b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.535+0000 7ff038ac9640 1 -- 172.21.15.103:0/3247438099 >> v1:172.21.15.190:6789/0 conn(0x7ff03415e380 legacy=0x7ff0340d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.535+0000 7ff038ac9640 1 -- 172.21.15.103:0/3247438099 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0340b5e40 con 0x7ff0340d1750 2024-08-18T23:56:59.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.535+0000 7ff038ac9640 1 --2- 172.21.15.103:0/3247438099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff0340cf500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff03406d0d0 tx=0x7ff02402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ac58070ae06140 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.535+0000 7ff02bfff640 1 -- 172.21.15.103:0/3247438099 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024037070 con 0x7ff0340d1750 2024-08-18T23:56:59.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff02bfff640 1 -- 172.21.15.103:0/3247438099 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff024032440 con 0x7ff0340d1750 2024-08-18T23:56:59.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff02bfff640 1 -- 172.21.15.103:0/3247438099 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024032810 con 0x7ff0340d1750 2024-08-18T23:56:59.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff03b52e640 1 -- 172.21.15.103:0/3247438099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 msgr2=0x7ff0340cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff03b52e640 1 --2- 172.21.15.103:0/3247438099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff0340cf500 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff03406d0d0 tx=0x7ff02402a270 comp rx=0 tx=0).stop 2024-08-18T23:56:59.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff03b52e640 1 -- 172.21.15.103:0/3247438099 shutdown_connections 2024-08-18T23:56:59.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff03b52e640 1 --2- 172.21.15.103:0/3247438099 >> v2:172.21.15.190:3300/0 conn(0x7ff03406d650 0x7ff0340b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff03b52e640 1 --2- 172.21.15.103:0/3247438099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff0340cf500 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff03b52e640 1 -- 172.21.15.103:0/3247438099 >> 172.21.15.103:0/3247438099 conn(0x7ff034073210 msgr2=0x7ff0340735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:59.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff03b52e640 1 -- 172.21.15.103:0/3247438099 shutdown_connections 2024-08-18T23:56:59.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.536+0000 7ff03b52e640 1 -- 172.21.15.103:0/3247438099 wait complete. 2024-08-18T23:56:59.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.537+0000 7ff03b52e640 1 Processor -- start 2024-08-18T23:56:59.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.537+0000 7ff03b52e640 1 -- start start 2024-08-18T23:56:59.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff03b52e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03406d650 0x7ff0341581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff03b52e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff03415b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff03b52e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03415e380 0x7ff03414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff03b52e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340b66e0 con 0x7ff0340d1750 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff03b52e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff0340b6400 con 0x7ff03415e380 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff03b52e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff0340b7990 con 0x7ff03406d650 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff038ac9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff03415b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff038ac9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff03415b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51240/0 (socket says 172.21.15.103:51240) 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff038ac9640 1 -- 172.21.15.103:0/2603856513 learned_addr learned my addr 172.21.15.103:0/2603856513 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff039acb640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03415e380 0x7ff03414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff0392ca640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03406d650 0x7ff0341581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff038ac9640 1 -- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03406d650 msgr2=0x7ff0341581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff038ac9640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03406d650 0x7ff0341581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff038ac9640 1 -- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03415e380 msgr2=0x7ff03414e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff038ac9640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03415e380 0x7ff03414e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.538+0000 7ff038ac9640 1 -- 172.21.15.103:0/2603856513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03414eae0 con 0x7ff0340d1750 2024-08-18T23:56:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.539+0000 7ff0392ca640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03406d650 0x7ff0341581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:56:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.539+0000 7ff038ac9640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff03415b040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff02402a2b0 tx=0x7ff0240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.539+0000 7ff029ffb640 1 -- 172.21.15.103:0/2603856513 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024037040 con 0x7ff0340d1750 2024-08-18T23:56:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.539+0000 7ff029ffb640 1 -- 172.21.15.103:0/2603856513 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff024042070 con 0x7ff0340d1750 2024-08-18T23:56:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.539+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03415feb0 con 0x7ff0340d1750 2024-08-18T23:56:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.539+0000 7ff029ffb640 1 -- 172.21.15.103:0/2603856513 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff024030880 con 0x7ff0340d1750 2024-08-18T23:56:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.539+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff034160470 con 0x7ff0340d1750 2024-08-18T23:56:59.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.540+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0340b7450 con 0x7ff0340d1750 2024-08-18T23:56:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.540+0000 7ff029ffb640 1 -- 172.21.15.103:0/2603856513 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff024030a20 con 0x7ff0340d1750 2024-08-18T23:56:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.541+0000 7ff029ffb640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.541+0000 7ff029ffb640 1 -- 172.21.15.103:0/2603856513 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff0240aba20 con 0x7ff0340d1750 2024-08-18T23:56:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.541+0000 7ff0392ca640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.541+0000 7ff0392ca640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff01806be30 0x7ff01806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff030001d60 tx=0x7ff030009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.545+0000 7ff029ffb640 1 -- 172.21.15.103:0/2603856513 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff02407a000 con 0x7ff0340d1750 2024-08-18T23:56:59.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.711+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0340b8480 con 0x7ff0340d1750 2024-08-18T23:56:59.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.712+0000 7ff029ffb640 1 -- 172.21.15.103:0/2603856513 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7ff024079900 con 0x7ff0340d1750 2024-08-18T23:56:59.714 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:56:59.714 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff01806be30 msgr2=0x7ff01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff01806be30 0x7ff01806e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff030001d60 tx=0x7ff030009040 comp rx=0 tx=0).stop 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 msgr2=0x7ff03415b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff03415b040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff02402a2b0 tx=0x7ff0240046c0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 shutdown_connections 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff01806be30 0x7ff01806e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff03415e380 0x7ff03414e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0340d1750 0x7ff03415b040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 --2- 172.21.15.103:0/2603856513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff03406d650 0x7ff0341581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 >> 172.21.15.103:0/2603856513 conn(0x7ff034073210 msgr2=0x7ff0340b4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:59.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 shutdown_connections 2024-08-18T23:56:59.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.715+0000 7ff03b52e640 1 -- 172.21.15.103:0/2603856513 wait complete. 2024-08-18T23:56:59.744 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:56:59.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.842+0000 7fa34c79a640 1 Processor -- start 2024-08-18T23:56:59.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.842+0000 7fa34c79a640 1 -- start start 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34c79a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3440d19c0 0x7fa3440d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34c79a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa34406df90 0x7fa3440cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34c79a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3440d22e0 con 0x7fa34406db50 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34c79a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa34406fa80 con 0x7fa34406df90 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34c79a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa34406fd60 con 0x7fa3440d19c0 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34ad37640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa34406df90 0x7fa3440cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34ad37640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa34406df90 0x7fa3440cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51244/0 (socket says 172.21.15.103:51244) 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34ad37640 1 -- 172.21.15.103:0/3743797285 learned_addr learned my addr 172.21.15.103:0/3743797285 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34a536640 1 --2- 172.21.15.103:0/3743797285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3440d19c0 0x7fa3440d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34ad37640 1 -- 172.21.15.103:0/3743797285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3440d19c0 msgr2=0x7fa3440d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:56:59.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34ad37640 1 --2- 172.21.15.103:0/3743797285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3440d19c0 0x7fa3440d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34ad37640 1 -- 172.21.15.103:0/3743797285 >> v1:172.21.15.190:6789/0 conn(0x7fa34406db50 legacy=0x7fa3440ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.843+0000 7fa34ad37640 1 -- 172.21.15.103:0/3743797285 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa344070040 con 0x7fa34406df90 2024-08-18T23:56:59.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.844+0000 7fa34ad37640 1 --2- 172.21.15.103:0/3743797285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34406df90 0x7fa3440cedc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009e50 tx=0x7fa33c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9f49538894c1e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.844+0000 7fa349534640 1 -- 172.21.15.103:0/3743797285 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c036070 con 0x7fa34406df90 2024-08-18T23:56:59.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.844+0000 7fa349534640 1 -- 172.21.15.103:0/3743797285 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c031600 con 0x7fa34406df90 2024-08-18T23:56:59.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.844+0000 7fa349534640 1 -- 172.21.15.103:0/3743797285 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0319d0 con 0x7fa34406df90 2024-08-18T23:56:59.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.845+0000 7fa34c79a640 1 -- 172.21.15.103:0/3743797285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34406df90 msgr2=0x7fa3440cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.845+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3743797285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34406df90 0x7fa3440cedc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009e50 tx=0x7fa33c02a710 comp rx=0 tx=0).stop 2024-08-18T23:56:59.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.845+0000 7fa34c79a640 1 -- 172.21.15.103:0/3743797285 shutdown_connections 2024-08-18T23:56:59.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.845+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3743797285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa34406df90 0x7fa3440cedc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.845+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3743797285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3440d19c0 0x7fa3440d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.845+0000 7fa34c79a640 1 -- 172.21.15.103:0/3743797285 >> 172.21.15.103:0/3743797285 conn(0x7fa34409aa40 msgr2=0x7fa34409ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:56:59.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.845+0000 7fa34c79a640 1 -- 172.21.15.103:0/3743797285 shutdown_connections 2024-08-18T23:56:59.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.845+0000 7fa34c79a640 1 -- 172.21.15.103:0/3743797285 wait complete. 2024-08-18T23:56:59.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.846+0000 7fa34c79a640 1 Processor -- start 2024-08-18T23:56:59.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.846+0000 7fa34c79a640 1 -- start start 2024-08-18T23:56:59.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34c79a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa34406db50 0x7fa3440c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34c79a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa34406df90 0x7fa3440b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34c79a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3440d19c0 0x7fa3440aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34c79a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa34406cc30 con 0x7fa3440d19c0 2024-08-18T23:56:59.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34c79a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa344070600 con 0x7fa34406df90 2024-08-18T23:56:59.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34c79a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa34415e510 con 0x7fa34406db50 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3440d19c0 0x7fa3440aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3440d19c0 0x7fa3440aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51256/0 (socket says 172.21.15.103:51256) 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 -- 172.21.15.103:0/3084546204 learned_addr learned my addr 172.21.15.103:0/3084546204 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa349d35640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa34406df90 0x7fa3440b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34a536640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa34406db50 0x7fa3440c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 -- 172.21.15.103:0/3084546204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa34406db50 msgr2=0x7fa3440c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa34406db50 0x7fa3440c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 -- 172.21.15.103:0/3084546204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa34406df90 msgr2=0x7fa3440b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa34406df90 0x7fa3440b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 -- 172.21.15.103:0/3084546204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3440b1a30 con 0x7fa3440d19c0 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa34ad37640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3440d19c0 0x7fa3440aec20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa33c034040 tx=0x7fa33c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.847+0000 7fa33affd640 1 -- 172.21.15.103:0/3084546204 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c036050 con 0x7fa3440d19c0 2024-08-18T23:56:59.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.848+0000 7fa33affd640 1 -- 172.21.15.103:0/3084546204 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa33c042070 con 0x7fa3440d19c0 2024-08-18T23:56:59.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.848+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3440b1d10 con 0x7fa3440d19c0 2024-08-18T23:56:59.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.848+0000 7fa33affd640 1 -- 172.21.15.103:0/3084546204 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c009510 con 0x7fa3440d19c0 2024-08-18T23:56:59.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.848+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3440b22d0 con 0x7fa3440d19c0 2024-08-18T23:56:59.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.848+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3440b62b0 con 0x7fa3440d19c0 2024-08-18T23:56:59.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.849+0000 7fa33affd640 1 -- 172.21.15.103:0/3084546204 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa33c007bd0 con 0x7fa3440d19c0 2024-08-18T23:56:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.849+0000 7fa33affd640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa32806be30 0x7fa32806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:56:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.849+0000 7fa33affd640 1 -- 172.21.15.103:0/3084546204 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa33c0abff0 con 0x7fa3440d19c0 2024-08-18T23:56:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.849+0000 7fa34a536640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa32806be30 0x7fa32806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:56:59.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.850+0000 7fa34a536640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa32806be30 0x7fa32806e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa340006fd0 tx=0x7fa340008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:56:59.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:56:59.854+0000 7fa33affd640 1 -- 172.21.15.103:0/3084546204 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa3440b62b0 con 0x7fa3440d19c0 2024-08-18T23:57:00.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.053+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3440d1da0 con 0x7fa3440d19c0 2024-08-18T23:57:00.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.054+0000 7fa33affd640 1 -- 172.21.15.103:0/3084546204 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5228 (secure 0 0 0) 0x7fa33c07a660 con 0x7fa3440d19c0 2024-08-18T23:57:00.055 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:00.055 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"btime":"2024-08-18T23:56:58:789828+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:56:58.135592+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:00.056 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 7 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa32806be30 msgr2=0x7fa32806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa32806be30 0x7fa32806e2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa340006fd0 tx=0x7fa340008040 comp rx=0 tx=0).stop 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3440d19c0 msgr2=0x7fa3440aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3440d19c0 0x7fa3440aec20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa33c034040 tx=0x7fa33c004a40 comp rx=0 tx=0).stop 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 shutdown_connections 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa32806be30 0x7fa32806e2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3440d19c0 0x7fa3440aec20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa34406df90 0x7fa3440b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 --2- 172.21.15.103:0/3084546204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa34406db50 0x7fa3440c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 >> 172.21.15.103:0/3084546204 conn(0x7fa34409aa40 msgr2=0x7fa3440b5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 shutdown_connections 2024-08-18T23:57:00.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.056+0000 7fa34c79a640 1 -- 172.21.15.103:0/3084546204 wait complete. 2024-08-18T23:57:00.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:00.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.166+0000 7f50c5855640 1 Processor -- start 2024-08-18T23:57:00.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.166+0000 7f50c5855640 1 -- start start 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.167+0000 7f50c5855640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f50c006c910 0x7f50c00b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.167+0000 7f50c5855640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 0x7f50c006ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.167+0000 7f50c5855640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c00b56b0 con 0x7f50c015b0e0 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.167+0000 7f50c5855640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f50c00afef0 con 0x7f50c006c910 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.167+0000 7f50c5855640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50c006d230 con 0x7f50c015c390 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.167+0000 7f50beffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f50c006c910 0x7f50c00b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.167+0000 7f50bf7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f50c015b0e0 0x7f50c015c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49850/0 (socket says 172.21.15.103:49850) 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.167+0000 7f50bf7fe640 1 -- 172.21.15.103:0/1617582778 learned_addr learned my addr 172.21.15.103:0/1617582778 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.168+0000 7f50beffd640 1 -- 172.21.15.103:0/1617582778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 msgr2=0x7f50c006ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.168+0000 7f50beffd640 1 --2- 172.21.15.103:0/1617582778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 0x7f50c006ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.168+0000 7f50beffd640 1 -- 172.21.15.103:0/1617582778 >> v1:172.21.15.103:6789/0 conn(0x7f50c015b0e0 legacy=0x7f50c015c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.168+0000 7f50bdffb640 1 -- 172.21.15.103:0/1617582778 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3936380847 0 0) 0x7f50c00b56b0 con 0x7f50c015b0e0 2024-08-18T23:57:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.168+0000 7f50beffd640 1 -- 172.21.15.103:0/1617582778 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c015b5d0 con 0x7f50c006c910 2024-08-18T23:57:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.168+0000 7f50beffd640 1 --2- 172.21.15.103:0/1617582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c00b5170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50b80097a0 tx=0x7f50b802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ed1317dd4e2aa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.168+0000 7f50bdffb640 1 -- 172.21.15.103:0/1617582778 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8037070 con 0x7f50c006c910 2024-08-18T23:57:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50bdffb640 1 -- 172.21.15.103:0/1617582778 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b802ae50 con 0x7f50c006c910 2024-08-18T23:57:00.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50bdffb640 1 -- 172.21.15.103:0/1617582778 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8032660 con 0x7f50c006c910 2024-08-18T23:57:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50c5855640 1 -- 172.21.15.103:0/1617582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 msgr2=0x7f50c00b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50c5855640 1 --2- 172.21.15.103:0/1617582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c00b5170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50b80097a0 tx=0x7f50b802a100 comp rx=0 tx=0).stop 2024-08-18T23:57:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50c5855640 1 -- 172.21.15.103:0/1617582778 shutdown_connections 2024-08-18T23:57:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50c5855640 1 --2- 172.21.15.103:0/1617582778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 0x7f50c006ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50c5855640 1 --2- 172.21.15.103:0/1617582778 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c00b5170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50c5855640 1 -- 172.21.15.103:0/1617582778 >> 172.21.15.103:0/1617582778 conn(0x7f50c0071d90 msgr2=0x7f50c00721a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50c5855640 1 -- 172.21.15.103:0/1617582778 shutdown_connections 2024-08-18T23:57:00.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.169+0000 7f50c5855640 1 -- 172.21.15.103:0/1617582778 wait complete. 2024-08-18T23:57:00.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.170+0000 7f50c5855640 1 Processor -- start 2024-08-18T23:57:00.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50c5855640 1 -- start start 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50c5855640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c01f5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50c5855640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50c015b0e0 0x7f50c01f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50c5855640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 0x7f50c01595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50c5855640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50c015be70 con 0x7f50c006c910 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50c5855640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50c015bb90 con 0x7f50c015b0e0 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50c5855640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50c00af930 con 0x7f50c015c390 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50beffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c01f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50beffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c01f5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51280/0 (socket says 172.21.15.103:51280) 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50beffd640 1 -- 172.21.15.103:0/4039440247 learned_addr learned my addr 172.21.15.103:0/4039440247 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50bf7fe640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 0x7f50c01595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.171+0000 7f50be7fc640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50c015b0e0 0x7f50c01f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50beffd640 1 -- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 msgr2=0x7f50c01595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50beffd640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 0x7f50c01595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50beffd640 1 -- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50c015b0e0 msgr2=0x7f50c01f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50beffd640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50c015b0e0 0x7f50c01f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50beffd640 1 -- 172.21.15.103:0/4039440247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c01f5b90 con 0x7f50c006c910 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50bf7fe640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 0x7f50c01595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50be7fc640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50c015b0e0 0x7f50c01f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50beffd640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c01f5650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50b80098c0 tx=0x7f50b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50a7fff640 1 -- 172.21.15.103:0/4039440247 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8042070 con 0x7f50c006c910 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50a7fff640 1 -- 172.21.15.103:0/4039440247 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b803e670 con 0x7f50c006c910 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50a7fff640 1 -- 172.21.15.103:0/4039440247 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8037040 con 0x7f50c006c910 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c01f5450 con 0x7f50c006c910 2024-08-18T23:57:00.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.172+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c0151f10 con 0x7f50c006c910 2024-08-18T23:57:00.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.173+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c006ccf0 con 0x7f50c006c910 2024-08-18T23:57:00.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.173+0000 7f50a7fff640 1 -- 172.21.15.103:0/4039440247 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50b8045070 con 0x7f50c006c910 2024-08-18T23:57:00.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.174+0000 7f50a7fff640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50ac06be30 0x7f50ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.174+0000 7f50a7fff640 1 -- 172.21.15.103:0/4039440247 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f50b80abc20 con 0x7f50c006c910 2024-08-18T23:57:00.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.174+0000 7f50be7fc640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50ac06be30 0x7f50ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.174+0000 7f50be7fc640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50ac06be30 0x7f50ac06e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50c00ae2f0 tx=0x7f50b4009570 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.178+0000 7f50a7fff640 1 -- 172.21.15.103:0/4039440247 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f50c01f5450 con 0x7f50c006c910 2024-08-18T23:57:00.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.349+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50c015e710 con 0x7f50c006c910 2024-08-18T23:57:00.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.350+0000 7f50a7fff640 1 -- 172.21.15.103:0/4039440247 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f50b807a3b0 con 0x7f50c006c910 2024-08-18T23:57:00.352 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:00.352 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:00.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.352+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50ac06be30 msgr2=0x7f50ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50ac06be30 0x7f50ac06e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50c00ae2f0 tx=0x7f50b4009570 comp rx=0 tx=0).stop 2024-08-18T23:57:00.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 msgr2=0x7f50c01f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c01f5650 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50b80098c0 tx=0x7f50b80046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 shutdown_connections 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50ac06be30 0x7f50ac06e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50c015c390 0x7f50c01595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50c015b0e0 0x7f50c01f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 --2- 172.21.15.103:0/4039440247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c006c910 0x7f50c01f5650 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 >> 172.21.15.103:0/4039440247 conn(0x7f50c0071d90 msgr2=0x7f50c006f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 shutdown_connections 2024-08-18T23:57:00.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.353+0000 7f50c5855640 1 -- 172.21.15.103:0/4039440247 wait complete. 2024-08-18T23:57:00.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T23:56:53.078789+0000', 'modified': '2024-08-18T23:56:58.135592+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6837/1034727243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6835', 'nonce': 1034727243}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 1034727243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-08-18T23:57:00.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T23:57:00.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T23:57:00.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.867+0000 7f35c4554640 1 Processor -- start 2024-08-18T23:57:00.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.867+0000 7f35c4554640 1 -- start start 2024-08-18T23:57:00.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.868+0000 7f35c4554640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f35bc0cd720 0x7f35bc06f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.868+0000 7f35c4554640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35bc072760 con 0x7f35bc0ce640 2024-08-18T23:57:00.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.868+0000 7f35c4554640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35bc072a40 con 0x7f35bc0cf7d0 2024-08-18T23:57:00.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.868+0000 7f35c4554640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f35bc072d20 con 0x7f35bc0cd720 2024-08-18T23:57:00.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c1aef640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f35bc0ce640 0x7f35bc06edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:49852/0 (socket says 172.21.15.103:49852) 2024-08-18T23:57:00.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c1aef640 1 -- 172.21.15.103:0/1804695514 learned_addr learned my addr 172.21.15.103:0/1804695514 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c2af1640 1 --2- 172.21.15.103:0/1804695514 >> v2:172.21.15.190:3300/0 conn(0x7f35bc0cd720 0x7f35bc06f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325831386 0 0) 0x7f35bc072760 con 0x7f35bc0ce640 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35a8003520 con 0x7f35bc0ce640 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 383505212 0 0) 0x7f35a8003520 con 0x7f35bc0ce640 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 >> v2:172.21.15.190:3300/0 conn(0x7f35bc0cd720 msgr2=0x7f35bc06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 --2- 172.21.15.103:0/1804695514 >> v2:172.21.15.190:3300/0 conn(0x7f35bc0cd720 0x7f35bc06f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 >> v1:172.21.15.190:6789/0 conn(0x7f35bc0cf7d0 legacy=0x7f35bc0cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc073000 con 0x7f35bc0ce640 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f35ac001670 con 0x7f35bc0ce640 2024-08-18T23:57:00.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 >> v1:172.21.15.103:6789/0 conn(0x7f35bc0ce640 legacy=0x7f35bc06edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80039b0 0x7f35a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35a8004800 0x7f35a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80051c0 0x7f35a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc072d20 con 0x7f35a80051c0 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35a800c160 con 0x7f35a80039b0 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35a800c360 con 0x7f35a8004800 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c2af1640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80051c0 0x7f35a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c22f0640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80039b0 0x7f35a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.869+0000 7f35c1aef640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35a8004800 0x7f35a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c2af1640 1 -- 172.21.15.103:0/1804695514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35a8004800 msgr2=0x7f35a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c2af1640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35a8004800 0x7f35a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c2af1640 1 -- 172.21.15.103:0/1804695514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80039b0 msgr2=0x7f35a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c2af1640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80039b0 0x7f35a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c2af1640 1 -- 172.21.15.103:0/1804695514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a8003520 con 0x7f35a80051c0 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c2af1640 1 -- 172.21.15.103:0/1804695514 reap_dead start 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c2af1640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80051c0 0x7f35a800b9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0b2b30 tx=0x7f35a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2547619b4d953157 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4009c10 con 0x7f35a80051c0 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b4031410 con 0x7f35a80051c0 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.870+0000 7f35c12ee640 1 -- 172.21.15.103:0/1804695514 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b40317e0 con 0x7f35a80051c0 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.871+0000 7f35c4554640 1 -- 172.21.15.103:0/1804695514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80051c0 msgr2=0x7f35a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.871+0000 7f35c4554640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80051c0 0x7f35a800b9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0b2b30 tx=0x7f35a8005830 comp rx=0 tx=0).stop 2024-08-18T23:57:00.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.871+0000 7f35c4554640 1 -- 172.21.15.103:0/1804695514 shutdown_connections 2024-08-18T23:57:00.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.871+0000 7f35c4554640 1 --2- 172.21.15.103:0/1804695514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35a80051c0 0x7f35a800b9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.871+0000 7f35c4554640 1 -- 172.21.15.103:0/1804695514 >> 172.21.15.103:0/1804695514 conn(0x7f35bc0b2b80 msgr2=0x7f35bc0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.871+0000 7f35c4554640 1 -- 172.21.15.103:0/1804695514 shutdown_connections 2024-08-18T23:57:00.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.871+0000 7f35c4554640 1 -- 172.21.15.103:0/1804695514 wait complete. 2024-08-18T23:57:00.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.872+0000 7f35c4554640 1 Processor -- start 2024-08-18T23:57:00.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.872+0000 7f35c4554640 1 -- start start 2024-08-18T23:57:00.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c4554640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80051c0 0x7f35bc1e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c4554640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc1e8d60 0x7f35bc160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c4554640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35bc14a4f0 0x7f35bc14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c4554640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc15e520 con 0x7f35bc1e8d60 2024-08-18T23:57:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c4554640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc15e3a0 con 0x7f35a80051c0 2024-08-18T23:57:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c4554640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc09ee50 con 0x7f35bc14a4f0 2024-08-18T23:57:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc1e8d60 0x7f35bc160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc1e8d60 0x7f35bc160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51300/0 (socket says 172.21.15.103:51300) 2024-08-18T23:57:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 -- 172.21.15.103:0/3739685123 learned_addr learned my addr 172.21.15.103:0/3739685123 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c22f0640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80051c0 0x7f35bc1e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c2af1640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35bc14a4f0 0x7f35bc14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 -- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35bc14a4f0 msgr2=0x7f35bc14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35bc14a4f0 0x7f35bc14a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 -- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80051c0 msgr2=0x7f35bc1e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80051c0 0x7f35bc1e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 -- 172.21.15.103:0/3739685123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc15e740 con 0x7f35bc1e8d60 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c2af1640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35bc14a4f0 0x7f35bc14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.873+0000 7f35c1aef640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc1e8d60 0x7f35bc160f50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35ac007320 tx=0x7f35ac0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.874+0000 7f35b2ffd640 1 -- 172.21.15.103:0/3739685123 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac01a070 con 0x7f35bc1e8d60 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.874+0000 7f35b2ffd640 1 -- 172.21.15.103:0/3739685123 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ac00f8e0 con 0x7f35bc1e8d60 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.874+0000 7f35c4554640 1 -- 172.21.15.103:0/3739685123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35bc1e79b0 con 0x7f35bc1e8d60 2024-08-18T23:57:00.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.874+0000 7f35b2ffd640 1 -- 172.21.15.103:0/3739685123 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ac00fcb0 con 0x7f35bc1e8d60 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.874+0000 7f35c4554640 1 -- 172.21.15.103:0/3739685123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35bc1e91e0 con 0x7f35bc1e8d60 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.876+0000 7f35b2ffd640 1 -- 172.21.15.103:0/3739685123 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f35ac01d070 con 0x7f35bc1e8d60 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.876+0000 7f35b2ffd640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f35a006be30 0x7f35a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.876+0000 7f35b2ffd640 1 -- 172.21.15.103:0/3739685123 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f35ac08aa50 con 0x7f35bc1e8d60 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.876+0000 7f35c22f0640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f35a006be30 0x7f35a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.876+0000 7f35c22f0640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f35a006be30 0x7f35a006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35b8000c00 tx=0x7f35b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.877+0000 7f35c73e3740 1 Processor -- start 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.877+0000 7f35c73e3740 1 -- start start 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b184550 0x562e5b1c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b181d10 0x562e5b184930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b17eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c73e3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562e5b0e7c90 con 0x562e5b184550 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c73e3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562e5b08f990 con 0x562e5b185ce0 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c73e3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562e5b0e3c50 con 0x562e5b181d10 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b184550 0x562e5b1c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b184550 0x562e5b1c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51312/0 (socket says 172.21.15.103:51312) 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 -- 172.21.15.103:0/1686201026 learned_addr learned my addr 172.21.15.103:0/1686201026 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c2af1640 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b17eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c1aef640 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b181d10 0x562e5b184930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 -- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b181d10 msgr2=0x562e5b184930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b181d10 0x562e5b184930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 -- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 msgr2=0x562e5b17eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b17eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 -- 172.21.15.103:0/1686201026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e5b0a0440 con 0x562e5b184550 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c1aef640 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b181d10 0x562e5b184930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.878+0000 7f35c22f0640 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b184550 0x562e5b1c9cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f35b8012c10 tx=0x7f35b8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86377ba1b04fb666 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f359ffff640 1 -- 172.21.15.103:0/1686201026 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8028070 con 0x562e5b184550 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f359ffff640 1 -- 172.21.15.103:0/1686201026 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8007670 con 0x562e5b184550 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f359ffff640 1 -- 172.21.15.103:0/1686201026 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b80069d0 con 0x562e5b184550 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 -- 172.21.15.103:0/1686201026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b184550 msgr2=0x562e5b1c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b184550 0x562e5b1c9cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f35b8012c10 tx=0x7f35b8015000 comp rx=0 tx=0).stop 2024-08-18T23:57:00.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 -- 172.21.15.103:0/1686201026 shutdown_connections 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b17eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b181d10 0x562e5b184930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 --2- 172.21.15.103:0/1686201026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b184550 0x562e5b1c9cf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 -- 172.21.15.103:0/1686201026 >> 172.21.15.103:0/1686201026 conn(0x562e5b180d10 msgr2=0x562e5b1c91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 -- 172.21.15.103:0/1686201026 shutdown_connections 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.879+0000 7f35c73e3740 1 -- 172.21.15.103:0/1686201026 wait complete. 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.880+0000 7f35c73e3740 1 -- start start 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.880+0000 7f35c73e3740 1 Processor -- start 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 0x562e5b1a5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b1d9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c73e3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562e5b1801b0 con 0x562e5b17d930 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c73e3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562e5b0a3690 con 0x562e5b185ce0 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c73e3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562e5b1ca520 con 0x562e5b184550 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c73e3740 10 client.0 _ll_register_callbacks cb 0x562e5b097080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1a40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51324/0 (socket says 172.21.15.103:51324) 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 -- 172.21.15.103:0/2056969556 learned_addr learned my addr 172.21.15.103:0/2056969556 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c22f0640 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 0x562e5b1a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c1aef640 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b1d9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 -- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 msgr2=0x562e5b1a5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 0x562e5b1a5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 -- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 msgr2=0x562e5b1d9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b1d9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 -- 172.21.15.103:0/2056969556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e5adfb2d0 con 0x562e5b17d930 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c1aef640 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b1d9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f35c2af1640 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1a40f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f35b402aeb0 tx=0x7f35b4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4500f8ad7189f808 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.881+0000 7f359d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f359d7fa640 1 -- 172.21.15.103:0/2056969556 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4042070 con 0x562e5b17d930 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f359d7fa640 1 -- 172.21.15.103:0/2056969556 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f35b40319d0 con 0x562e5b17d930 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 1 -- 172.21.15.103:0/2056969556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35b8007670 con 0x562e5b17d930 2024-08-18T23:57:00.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f359d7fa640 1 -- 172.21.15.103:0/2056969556 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f35b404d050 con 0x562e5b17d930 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 10 client.4404 fetch_fsmap learned FSMap version 7 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 1 -- 172.21.15.103:0/2056969556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562e5aec56b0 con 0x562e5b17d930 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f359d7fa640 1 -- 172.21.15.103:0/2056969556 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8007670 con 0x562e5b17d930 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f359d7fa640 1 -- 172.21.15.103:0/2056969556 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f35b4050020 con 0x562e5b17d930 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 10 client.4404 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 20 client.4404 populate_metadata read hostname 'smithi103' 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x562e5b1dd190 0x562e5b1dd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 4 client.4404 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c73e3740 1 -- 172.21.15.103:0/2056969556 --> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e5b0f53c0 con 0x562e5b1dd190 2024-08-18T23:57:00.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.882+0000 7f35c22f0640 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x562e5b1dd190 0x562e5b1dd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c22f0640 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x562e5b1dd190 0x562e5b1dd570 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f477e023025c8004 server_cookie=6aa283f9fc84c9e4 in_seq=0 out_seq=0 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f359d7fa640 10 client.4404 ms_handle_connect on v2:172.21.15.103:6835/1034727243 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f359d7fa640 1 -- 172.21.15.103:0/2056969556 <== mds.0 v2:172.21.15.103:6835/1034727243 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e5b0f53c0 con 0x562e5b1dd190 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f359d7fa640 10 client.4404 handle_command_reply: tid=0 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 client.4404 shutdown 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 -- 172.21.15.103:0/2056969556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 msgr2=0x562e5b1a40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1a40f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f35b402aeb0 tx=0x7f35b4004ab0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 -- 172.21.15.103:0/2056969556 shutdown_connections 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x562e5b1dd190 0x562e5b1dd570 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1a40f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b185ce0 0x562e5b1d9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2056969556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 0x562e5b1a5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f359d7fa640 0 client.4404 ms_handle_reset on v2:172.21.15.103:6835/1034727243 2024-08-18T23:57:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 -- 172.21.15.103:0/2056969556 >> 172.21.15.103:0/2056969556 conn(0x562e5b181d10 msgr2=0x562e5b1c8890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 -- 172.21.15.103:0/2056969556 shutdown_connections 2024-08-18T23:57:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.883+0000 7f35c73e3740 1 -- 172.21.15.103:0/2056969556 wait complete. 2024-08-18T23:57:00.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.884+0000 7f35c73e3740 20 client.4404 trim_cache size 0 max 16384 2024-08-18T23:57:00.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.901+0000 7f35c73e3740 1 Processor -- start 2024-08-18T23:57:00.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c73e3740 1 -- start start 2024-08-18T23:57:00.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1c7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b184550 0x562e5b1d86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b185ce0 0x562e5b1d8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c73e3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc201200 con 0x562e5b17d930 2024-08-18T23:57:00.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c73e3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc200560 con 0x562e5b184550 2024-08-18T23:57:00.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c73e3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc200bb0 con 0x562e5b185ce0 2024-08-18T23:57:00.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c22f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c22f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51328/0 (socket says 172.21.15.103:51328) 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.902+0000 7f35c22f0640 1 -- 172.21.15.103:0/3378254871 learned_addr learned my addr 172.21.15.103:0/3378254871 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c22f0640 1 -- 172.21.15.103:0/3378254871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b185ce0 msgr2=0x562e5b1d8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c22f0640 1 --2- 172.21.15.103:0/3378254871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b185ce0 0x562e5b1d8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c22f0640 1 -- 172.21.15.103:0/3378254871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b184550 msgr2=0x562e5b1d86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c22f0640 1 --2- 172.21.15.103:0/3378254871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b184550 0x562e5b1d86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c22f0640 1 -- 172.21.15.103:0/3378254871 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e5b1a4450 con 0x562e5b17d930 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c22f0640 1 --2- 172.21.15.103:0/3378254871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1c7430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f35b8022000 tx=0x7f35b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3703ed24697cf5c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f359f7fe640 1 -- 172.21.15.103:0/3378254871 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8028030 con 0x562e5b17d930 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f359f7fe640 1 -- 172.21.15.103:0/3378254871 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8029040 con 0x562e5b17d930 2024-08-18T23:57:00.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f359f7fe640 1 -- 172.21.15.103:0/3378254871 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b8006d70 con 0x562e5b17d930 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c73e3740 1 -- 172.21.15.103:0/3378254871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 msgr2=0x562e5b1c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c73e3740 1 --2- 172.21.15.103:0/3378254871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1c7430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f35b8022000 tx=0x7f35b8017000 comp rx=0 tx=0).stop 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c73e3740 1 -- 172.21.15.103:0/3378254871 shutdown_connections 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c73e3740 1 --2- 172.21.15.103:0/3378254871 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b185ce0 0x562e5b1d8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c73e3740 1 --2- 172.21.15.103:0/3378254871 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b184550 0x562e5b1d86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c73e3740 1 --2- 172.21.15.103:0/3378254871 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b17d930 0x562e5b1c7430 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.903+0000 7f35c73e3740 1 -- 172.21.15.103:0/3378254871 >> 172.21.15.103:0/3378254871 conn(0x562e5b181d10 msgr2=0x562e5b1a8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.904+0000 7f35c73e3740 1 -- 172.21.15.103:0/3378254871 shutdown_connections 2024-08-18T23:57:00.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.904+0000 7f35c73e3740 1 -- 172.21.15.103:0/3378254871 wait complete. 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.904+0000 7f35c73e3740 1 -- start start 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.904+0000 7f35c73e3740 1 Processor -- start 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b17d930 0x562e5b247400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 0x562e5b1a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c73e3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b185ce0 0x562e5b1a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c73e3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562e5b1d9550 con 0x562e5b185ce0 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c73e3740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562e5b17fc20 con 0x562e5b17d930 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c73e3740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562e5b1cc8f0 con 0x562e5b184550 2024-08-18T23:57:00.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c73e3740 10 client.0 _ll_register_callbacks cb 0x7f35b4009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c2af1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b185ce0 0x562e5b1a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c2af1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b185ce0 0x562e5b1a29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51338/0 (socket says 172.21.15.103:51338) 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c2af1640 1 -- 172.21.15.103:0/2082325049 learned_addr learned my addr 172.21.15.103:0/2082325049 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c22f0640 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b17d930 0x562e5b247400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c1aef640 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 0x562e5b1a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c2af1640 1 -- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 msgr2=0x562e5b1a24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c2af1640 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 0x562e5b1a24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c2af1640 1 -- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b17d930 msgr2=0x562e5b247400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c2af1640 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b17d930 0x562e5b247400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c2af1640 1 -- 172.21.15.103:0/2082325049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e5b1c6e90 con 0x562e5b185ce0 2024-08-18T23:57:00.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.905+0000 7f35c22f0640 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b17d930 0x562e5b247400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c2af1640 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b185ce0 0x562e5b1a29f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f35b4007090 tx=0x7f35b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c0a47d35dcdd96 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f359d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f359d7fa640 1 -- 172.21.15.103:0/2082325049 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b4056060 con 0x562e5b185ce0 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f359d7fa640 1 -- 172.21.15.103:0/2082325049 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f35b4036040 con 0x562e5b185ce0 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 1 -- 172.21.15.103:0/2082325049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35b8029040 con 0x562e5b185ce0 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f359d7fa640 1 -- 172.21.15.103:0/2082325049 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f35b405c050 con 0x562e5b185ce0 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 10 client.4410 fetch_fsmap learned FSMap version 7 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 1 -- 172.21.15.103:0/2082325049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x562e5b1a9270 con 0x562e5b185ce0 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f359d7fa640 1 -- 172.21.15.103:0/2082325049 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b8029040 con 0x562e5b185ce0 2024-08-18T23:57:00.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f359d7fa640 1 -- 172.21.15.103:0/2082325049 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f35b405f020 con 0x562e5b185ce0 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 10 client.4410 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 20 client.4410 populate_metadata read hostname 'smithi103' 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x562e5b1d8320 0x562e5b1adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 4 client.4410 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c73e3740 1 -- 172.21.15.103:0/2082325049 --> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] -- command(tid 0: {"prefix": "status"}) -- 0x562e5b0ef710 con 0x562e5b1d8320 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f35c22f0640 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x562e5b1d8320 0x562e5b1adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.906+0000 7f359d7fa640 10 client.4410 ms_handle_connect on v2:172.21.15.103:6835/1034727243 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c22f0640 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x562e5b1d8320 0x562e5b1adb00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5099a8d5edd1a93 server_cookie=ae81ee58ee8930eb in_seq=0 out_seq=0 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f359d7fa640 1 -- 172.21.15.103:0/2082325049 <== mds.0 v2:172.21.15.103:6835/1034727243 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x562e5b0ef710 con 0x562e5b1d8320 2024-08-18T23:57:00.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f359d7fa640 10 client.4410 handle_command_reply: tid=0 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 client.4410 shutdown 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 -- 172.21.15.103:0/2082325049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b185ce0 msgr2=0x562e5b1a29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b185ce0 0x562e5b1a29f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f35b4007090 tx=0x7f35b4009750 comp rx=0 tx=0).stop 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 -- 172.21.15.103:0/2082325049 shutdown_connections 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x562e5b1d8320 0x562e5b1adb00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562e5b185ce0 0x562e5b1a29f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562e5b184550 0x562e5b1a24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 --2- 172.21.15.103:0/2082325049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562e5b17d930 0x562e5b247400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f359d7fa640 0 client.4410 ms_handle_reset on v2:172.21.15.103:6835/1034727243 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 -- 172.21.15.103:0/2082325049 >> 172.21.15.103:0/2082325049 conn(0x562e5b181d10 msgr2=0x562e5b1d96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 -- 172.21.15.103:0/2082325049 shutdown_connections 2024-08-18T23:57:00.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 1 -- 172.21.15.103:0/2082325049 wait complete. 2024-08-18T23:57:00.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c73e3740 20 client.4410 trim_cache size 0 max 16384 2024-08-18T23:57:00.917 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:57:00.917 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "c396ba9f-4334-441d-8e0e-0892ec29262b", 2024-08-18T23:57:00.917 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-08-18T23:57:00.917 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4284, 2024-08-18T23:57:00.917 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-18T23:57:00.917 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-18T23:57:00.918 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-18T23:57:00.918 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 7.1637903530000004, 2024-08-18T23:57:00.918 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 7, 2024-08-18T23:57:00.918 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 24, 2024-08-18T23:57:00.918 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 24, 2024-08-18T23:57:00.918 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 13.204948309000001 2024-08-18T23:57:00.918 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:57:00.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c4554640 1 -- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f35a006be30 msgr2=0x7f35a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.907+0000 7f35c4554640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f35a006be30 0x7f35a006e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f35b8000c00 tx=0x7f35b8009040 comp rx=0 tx=0).stop 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 -- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc1e8d60 msgr2=0x7f35bc160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc1e8d60 0x7f35bc160f50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35ac007320 tx=0x7f35ac0077e0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 -- 172.21.15.103:0/3739685123 shutdown_connections 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f35a006be30 0x7f35a006e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35bc14a4f0 0x7f35bc14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc1e8d60 0x7f35bc160f50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 --2- 172.21.15.103:0/3739685123 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35a80051c0 0x7f35bc1e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 -- 172.21.15.103:0/3739685123 >> 172.21.15.103:0/3739685123 conn(0x7f35bc0b2b80 msgr2=0x7f35bc0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 -- 172.21.15.103:0/3739685123 shutdown_connections 2024-08-18T23:57:00.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:00.908+0000 7f35c4554640 1 -- 172.21.15.103:0/3739685123 wait complete. 2024-08-18T23:57:00.921 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T23:57:00.921 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-18T23:57:00.921 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T23:57:01.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.018+0000 7f78f2817640 1 Processor -- start 2024-08-18T23:57:01.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.018+0000 7f78f2817640 1 -- start start 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f2817640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f78ec15f5c0 0x7f78ec0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f2817640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec0cdbb0 0x7f78ec09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f2817640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78ec09af80 0x7f78ec0cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f2817640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f78ec0b4990 con 0x7f78ec09af80 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f2817640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f78ec0ce000 con 0x7f78ec15f5c0 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f2817640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f78ec0ce7f0 con 0x7f78ec0cdbb0 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f0db4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78ec09af80 0x7f78ec0cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f0db4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f78ec09af80 0x7f78ec0cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51352/0 (socket says 172.21.15.103:51352) 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f0db4640 1 -- 172.21.15.103:0/653612846 learned_addr learned my addr 172.21.15.103:0/653612846 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78ebfff640 1 --2- 172.21.15.103:0/653612846 >> v2:172.21.15.190:3300/0 conn(0x7f78ec15f5c0 0x7f78ec0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:01.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f0db4640 1 -- 172.21.15.103:0/653612846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec0cdbb0 msgr2=0x7f78ec09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78eb7fe640 1 --2- 172.21.15.103:0/653612846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec0cdbb0 0x7f78ec09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.019+0000 7f78f0db4640 1 --2- 172.21.15.103:0/653612846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec0cdbb0 0x7f78ec09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.020+0000 7f78f0db4640 1 -- 172.21.15.103:0/653612846 >> v2:172.21.15.190:3300/0 conn(0x7f78ec15f5c0 msgr2=0x7f78ec0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.020+0000 7f78f0db4640 1 --2- 172.21.15.103:0/653612846 >> v2:172.21.15.190:3300/0 conn(0x7f78ec15f5c0 0x7f78ec0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.020+0000 7f78f0db4640 1 -- 172.21.15.103:0/653612846 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec0ce230 con 0x7f78ec09af80 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.020+0000 7f78eb7fe640 1 --2- 172.21.15.103:0/653612846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec0cdbb0 0x7f78ec09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.020+0000 7f78f0db4640 1 --2- 172.21.15.103:0/653612846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0cfe50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f78ec073da0 tx=0x7f78e402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7044665f77ffd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.020+0000 7f78eaffd640 1 -- 172.21.15.103:0/653612846 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e4036070 con 0x7f78ec09af80 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.020+0000 7f78eaffd640 1 -- 172.21.15.103:0/653612846 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e4031600 con 0x7f78ec09af80 2024-08-18T23:57:01.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.020+0000 7f78eaffd640 1 -- 172.21.15.103:0/653612846 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e40319d0 con 0x7f78ec09af80 2024-08-18T23:57:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 -- 172.21.15.103:0/653612846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 msgr2=0x7f78ec0cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 --2- 172.21.15.103:0/653612846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0cfe50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f78ec073da0 tx=0x7f78e402a570 comp rx=0 tx=0).stop 2024-08-18T23:57:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 -- 172.21.15.103:0/653612846 shutdown_connections 2024-08-18T23:57:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 --2- 172.21.15.103:0/653612846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0cfe50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 --2- 172.21.15.103:0/653612846 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec0cdbb0 0x7f78ec09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 --2- 172.21.15.103:0/653612846 >> v2:172.21.15.190:3300/0 conn(0x7f78ec15f5c0 0x7f78ec0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 -- 172.21.15.103:0/653612846 >> 172.21.15.103:0/653612846 conn(0x7f78ec0b3b20 msgr2=0x7f78ec0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:01.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 -- 172.21.15.103:0/653612846 shutdown_connections 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.021+0000 7f78f2817640 1 -- 172.21.15.103:0/653612846 wait complete. 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.022+0000 7f78f2817640 1 Processor -- start 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.022+0000 7f78f2817640 1 -- start start 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78f2817640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78f2817640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78ec0cdbb0 0x7f78ec1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78f2817640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec15f5c0 0x7f78ec06e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78f2817640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec0b16a0 con 0x7f78ec09af80 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78f2817640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec09b3b0 con 0x7f78ec0cdbb0 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78f2817640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f78ec0b1980 con 0x7f78ec15f5c0 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78ebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78ebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0c67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51362/0 (socket says 172.21.15.103:51362) 2024-08-18T23:57:01.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78ebfff640 1 -- 172.21.15.103:0/1200466354 learned_addr learned my addr 172.21.15.103:0/1200466354 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78eb7fe640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78ec0cdbb0 0x7f78ec1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78f0db4640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec15f5c0 0x7f78ec06e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78ebfff640 1 -- 172.21.15.103:0/1200466354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec15f5c0 msgr2=0x7f78ec06e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78ebfff640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec15f5c0 0x7f78ec06e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78ebfff640 1 -- 172.21.15.103:0/1200466354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78ec0cdbb0 msgr2=0x7f78ec1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78ebfff640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78ec0cdbb0 0x7f78ec1566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.023+0000 7f78ebfff640 1 -- 172.21.15.103:0/1200466354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec1f7770 con 0x7f78ec09af80 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.024+0000 7f78ebfff640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0c67a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00d830 tx=0x7f78dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.024+0000 7f78e8ff9640 1 -- 172.21.15.103:0/1200466354 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00b6c0 con 0x7f78ec09af80 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.024+0000 7f78e8ff9640 1 -- 172.21.15.103:0/1200466354 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78dc019070 con 0x7f78ec09af80 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.024+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec1f7a50 con 0x7f78ec09af80 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.024+0000 7f78e8ff9640 1 -- 172.21.15.103:0/1200466354 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00ba80 con 0x7f78ec09af80 2024-08-18T23:57:01.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.024+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec1f8010 con 0x7f78ec09af80 2024-08-18T23:57:01.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.025+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ec15fa30 con 0x7f78ec09af80 2024-08-18T23:57:01.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.025+0000 7f78e8ff9640 1 -- 172.21.15.103:0/1200466354 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78dc01e460 con 0x7f78ec09af80 2024-08-18T23:57:01.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.026+0000 7f78e8ff9640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f78d806be30 0x7f78d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:01.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.026+0000 7f78e8ff9640 1 -- 172.21.15.103:0/1200466354 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f78dc08b700 con 0x7f78ec09af80 2024-08-18T23:57:01.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.026+0000 7f78eb7fe640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f78d806be30 0x7f78d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:01.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.026+0000 7f78eb7fe640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f78d806be30 0x7f78d806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78ec071210 tx=0x7f78e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:01.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.030+0000 7f78e8ff9640 1 -- 172.21.15.103:0/1200466354 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f78dc059720 con 0x7f78ec09af80 2024-08-18T23:57:01.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.233+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f78ec0b4610 con 0x7f78ec09af80 2024-08-18T23:57:01.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.234+0000 7f78e8ff9640 1 -- 172.21.15.103:0/1200466354 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f78dc05da20 con 0x7f78ec09af80 2024-08-18T23:57:01.235 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T23:57:01.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.235+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f78d806be30 msgr2=0x7f78d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:01.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.235+0000 7f78f2817640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f78d806be30 0x7f78d806e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f78ec071210 tx=0x7f78e0008040 comp rx=0 tx=0).stop 2024-08-18T23:57:01.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.235+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 msgr2=0x7f78ec0c67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:01.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.235+0000 7f78f2817640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0c67a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00d830 tx=0x7f78dc00dcf0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.236+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 shutdown_connections 2024-08-18T23:57:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.236+0000 7f78f2817640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f78d806be30 0x7f78d806e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.236+0000 7f78f2817640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78ec15f5c0 0x7f78ec06e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.236+0000 7f78f2817640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78ec0cdbb0 0x7f78ec1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.236+0000 7f78f2817640 1 --2- 172.21.15.103:0/1200466354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78ec09af80 0x7f78ec0c67a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.236+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 >> 172.21.15.103:0/1200466354 conn(0x7f78ec0b3b20 msgr2=0x7f78ec0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.236+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 shutdown_connections 2024-08-18T23:57:01.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01.236+0000 7f78f2817640 1 -- 172.21.15.103:0/1200466354 wait complete. 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T23:57:01.248 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-18T23:57:01.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:01.249 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-08-18T23:57:01.264 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:01.264 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:01.264 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:01.264 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:01.264 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:01.264 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42871sec preferred_lft 42871sec 2024-08-18T23:57:01.265 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-08-18T23:57:01.266 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:01.266 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T23:57:01.266 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:01.266 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:01.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-08-18T23:57:01.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-08-18T23:57:01.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-08-18T23:57:01.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T23:57:01.267 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:01.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:01.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:01.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:01.471 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T23:57:01.497 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-08-18T23:57:01.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:01.498 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-08-18T23:57:01.566 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-08-18T23:57:01.566 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T23:57:01.566 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T23:57:01.566 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T23:57:01.566 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T23:57:01.567 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:01.567 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:01.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T23:57:01.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T23:57:01.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T23:57:01.567 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:01.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:01.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:01.842 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-18T23:57:01.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:01.858 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-08-18T23:57:01.913 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:01.913 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:01.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T23:57:01.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-18T23:57:01.913 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:02.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:02.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:02.033 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-18T23:57:02.033 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:02.033 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:02.033 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-18T23:57:02.034 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T23:57:02.034 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-18T23:57:02.034 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-18T23:57:02.034 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-18T23:57:02.034 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:02.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:02.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:02.164 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:02.164 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:02.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-08-18T23:57:02.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T23:57:02.164 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:02.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:02.242 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-18T23:57:02.242 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:02.242 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-18T23:57:02.258 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-18T23:57:02.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:02.259 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-18T23:57:02.314 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-18T23:57:02.379 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-18T23:57:02.435 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:02.436 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T23:57:02.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:02.437 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-18T23:57:02.490 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-18T23:57:02.491 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-18T23:57:02.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-18T23:57:02.557 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:02.614 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-18T23:57:02.614 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-18T23:57:02.614 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-18T23:57:02.614 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-18T23:57:02.614 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-18T23:57:02.614 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:02.615 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T23:57:02.616 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T23:57:02.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:02.617 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-18T23:57:02.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:2024-08-18T23:57:02.621+0000 7fc925d29480 -1 init, newargv = 0x55bc78a74d40 newargc=15 2024-08-18T23:57:02.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[31704]: starting ceph client 2024-08-18T23:57:02.628 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[31704]: starting fuse 2024-08-18T23:57:02.638 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-08-18T23:57:02.638 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-08-18T23:57:02.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-08-18T23:57:02.638 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-08-18T23:57:02.638 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-08-18T23:57:02.638 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-08-18T23:57:02.638 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-08-18T23:57:02.638 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:02.638 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T23:57:02.639 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-08-18T23:57:02.640 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-08-18T23:57:02.640 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-08-18T23:57:02.640 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T23:57:02.640 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:02.640 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.admin")) 2024-08-18T23:57:02.640 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-08-18T23:57:02.758 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.admin.31704.asok 2024-08-18T23:57:02.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:02.768 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31704.asok 2024-08-18T23:57:02.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:02.769 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31704.asok status 2024-08-18T23:57:02.904 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:57:02.904 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-08-18T23:57:02.904 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T23:57:02.904 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T23:57:02.904 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "admin", 2024-08-18T23:57:02.905 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-08-18T23:57:02.905 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-18T23:57:02.905 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "31704", 2024-08-18T23:57:02.905 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-08-18T23:57:02.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:02.906 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-08-18T23:57:02.906 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-08-18T23:57:02.906 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4422, 2024-08-18T23:57:02.906 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-08-18T23:57:02.906 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-08-18T23:57:02.906 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-08-18T23:57:02.906 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4422 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1765242236 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1765242236 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:02.907 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4422 192.168.0.1:0/1765242236", 2024-08-18T23:57:02.908 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1765242236", 2024-08-18T23:57:02.908 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-08-18T23:57:02.908 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 7, 2024-08-18T23:57:02.908 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 24, 2024-08-18T23:57:02.908 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-08-18T23:57:02.909 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-08-18T23:57:02.909 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-08-18T23:57:02.909 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:57:02.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:02.912 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-08-18T23:57:02.912 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-18T23:57:02.928 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-08-18T23:57:02.929 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-18T23:57:02.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:02.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-18T23:57:02.994 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-18T23:57:03.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-18T23:57:03.098 INFO:teuthology.orchestra.run.smithi103.stdout:# file: . 2024-08-18T23:57:03.098 INFO:teuthology.orchestra.run.smithi103.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-18T23:57:03.098 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:03.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:03.103 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:57:03.104 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:03.120 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:03.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.259+0000 7f763a0ae640 1 Processor -- start 2024-08-18T23:57:03.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.259+0000 7f763a0ae640 1 -- start start 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f763a0ae640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f763406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f763a0ae640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f76340c5520 0x7f7634071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f763a0ae640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f763406c220 con 0x7f76340c50e0 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f763a0ae640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f76340c4c50 con 0x7f76340c5520 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f763a0ae640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7634159e80 con 0x7f763406b900 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f7633fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f76340c5520 0x7f7634071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f7632ffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f76340c50e0 0x7f763415fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45144/0 (socket says 172.21.15.103:45144) 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f7633fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f76340c5520 0x7f7634071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:52492/0 (socket says 172.21.15.103:52492) 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f7632ffd640 1 -- 172.21.15.103:0/2935478970 learned_addr learned my addr 172.21.15.103:0/2935478970 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:03.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f76337fe640 1 --2- 172.21.15.103:0/2935478970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f763406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f76337fe640 1 -- 172.21.15.103:0/2935478970 >> v2:172.21.15.190:3300/0 conn(0x7f76340c5520 msgr2=0x7f7634071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.260+0000 7f76337fe640 1 --2- 172.21.15.103:0/2935478970 >> v2:172.21.15.190:3300/0 conn(0x7f76340c5520 0x7f7634071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.261+0000 7f76337fe640 1 -- 172.21.15.103:0/2935478970 >> v1:172.21.15.190:6789/0 conn(0x7f76340c50e0 legacy=0x7f763415fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.261+0000 7f76337fe640 1 -- 172.21.15.103:0/2935478970 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76340cb5e0 con 0x7f763406b900 2024-08-18T23:57:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.261+0000 7f7633fff640 1 --2- 172.21.15.103:0/2935478970 >> v2:172.21.15.190:3300/0 conn(0x7f76340c5520 0x7f7634071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.261+0000 7f76337fe640 1 --2- 172.21.15.103:0/2935478970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f763406bce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f76240097a0 tx=0x7f762402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=149b2b91dc26a4fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.261+0000 7f76327fc640 1 -- 172.21.15.103:0/2935478970 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7624037070 con 0x7f763406b900 2024-08-18T23:57:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f76327fc640 1 -- 172.21.15.103:0/2935478970 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7624032440 con 0x7f763406b900 2024-08-18T23:57:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f76327fc640 1 -- 172.21.15.103:0/2935478970 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7624032810 con 0x7f763406b900 2024-08-18T23:57:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f763a0ae640 1 -- 172.21.15.103:0/2935478970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 msgr2=0x7f763406bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f763a0ae640 1 --2- 172.21.15.103:0/2935478970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f763406bce0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f76240097a0 tx=0x7f762402a180 comp rx=0 tx=0).stop 2024-08-18T23:57:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f763a0ae640 1 -- 172.21.15.103:0/2935478970 shutdown_connections 2024-08-18T23:57:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f763a0ae640 1 --2- 172.21.15.103:0/2935478970 >> v2:172.21.15.190:3300/0 conn(0x7f76340c5520 0x7f7634071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f763a0ae640 1 --2- 172.21.15.103:0/2935478970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f763406bce0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f763a0ae640 1 -- 172.21.15.103:0/2935478970 >> 172.21.15.103:0/2935478970 conn(0x7f76340cc6e0 msgr2=0x7f76340ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f763a0ae640 1 -- 172.21.15.103:0/2935478970 shutdown_connections 2024-08-18T23:57:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.262+0000 7f763a0ae640 1 -- 172.21.15.103:0/2935478970 wait complete. 2024-08-18T23:57:03.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.263+0000 7f763a0ae640 1 Processor -- start 2024-08-18T23:57:03.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.263+0000 7f763a0ae640 1 -- start start 2024-08-18T23:57:03.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f763a0ae640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f76340c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f763a0ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76340c50e0 0x7f76341f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f763a0ae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76340c5520 0x7f76340b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f763a0ae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f76340cbe80 con 0x7f76340c50e0 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f763a0ae640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f76340cbba0 con 0x7f76340c5520 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f763a0ae640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7634160120 con 0x7f763406b900 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f7632ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76340c50e0 0x7f76341f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f7632ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76340c50e0 0x7f76341f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38986/0 (socket says 172.21.15.103:38986) 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f7632ffd640 1 -- 172.21.15.103:0/1567917020 learned_addr learned my addr 172.21.15.103:0/1567917020 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f7633fff640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76340c5520 0x7f76340b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.264+0000 7f76337fe640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f76340c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f7632ffd640 1 -- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 msgr2=0x7f76340c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f7632ffd640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f76340c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f7632ffd640 1 -- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76340c5520 msgr2=0x7f76340b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f7632ffd640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76340c5520 0x7f76340b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f7632ffd640 1 -- 172.21.15.103:0/1567917020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76340c8d70 con 0x7f76340c50e0 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f7633fff640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76340c5520 0x7f76340b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f7632ffd640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76340c50e0 0x7f76341f1eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f762800c440 tx=0x7f7628001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f761bfff640 1 -- 172.21.15.103:0/1567917020 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628017070 con 0x7f76340c50e0 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f761bfff640 1 -- 172.21.15.103:0/1567917020 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7628005ce0 con 0x7f76340c50e0 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76340c9050 con 0x7f76340c50e0 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f761bfff640 1 -- 172.21.15.103:0/1567917020 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76280072f0 con 0x7f76340c50e0 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.265+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76340c9610 con 0x7f76340c50e0 2024-08-18T23:57:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.266+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763406bce0 con 0x7f76340c50e0 2024-08-18T23:57:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.266+0000 7f761bfff640 1 -- 172.21.15.103:0/1567917020 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f762801a070 con 0x7f76340c50e0 2024-08-18T23:57:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.267+0000 7f761bfff640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f762006be30 0x7f762006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.267+0000 7f76337fe640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f762006be30 0x7f762006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.267+0000 7f761bfff640 1 -- 172.21.15.103:0/1567917020 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f762808a4c0 con 0x7f76340c50e0 2024-08-18T23:57:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.267+0000 7f76337fe640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f762006be30 0x7f762006e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7624034000 tx=0x7f762402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:03.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.271+0000 7f761bfff640 1 -- 172.21.15.103:0/1567917020 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7628058bc0 con 0x7f76340c50e0 2024-08-18T23:57:03.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.452+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f763406f950 con 0x7f76340c50e0 2024-08-18T23:57:03.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.452+0000 7f761bfff640 1 -- 172.21.15.103:0/1567917020 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f76280584c0 con 0x7f76340c50e0 2024-08-18T23:57:03.454 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:03.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f762006be30 msgr2=0x7f762006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f762006be30 0x7f762006e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7624034000 tx=0x7f762402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:03.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76340c50e0 msgr2=0x7f76341f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76340c50e0 0x7f76341f1eb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f762800c440 tx=0x7f7628001e70 comp rx=0 tx=0).stop 2024-08-18T23:57:03.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 shutdown_connections 2024-08-18T23:57:03.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f762006be30 0x7f762006e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76340c5520 0x7f76340b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76340c50e0 0x7f76341f1eb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 --2- 172.21.15.103:0/1567917020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f763406b900 0x7f76340c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 >> 172.21.15.103:0/1567917020 conn(0x7f76340cc6e0 msgr2=0x7f76340c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:03.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 shutdown_connections 2024-08-18T23:57:03.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.454+0000 7f763a0ae640 1 -- 172.21.15.103:0/1567917020 wait complete. 2024-08-18T23:57:03.466 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:57:03.466 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:03.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:03.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.621+0000 7f1889505640 1 Processor -- start 2024-08-18T23:57:03.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.621+0000 7f1889505640 1 -- start start 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f1889505640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415e3b0 0x7f18840d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f1889505640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18840b4a10 0x7f18840d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f1889505640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18840d4e10 con 0x7f18840d21b0 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f1889505640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f18840d4bc0 con 0x7f18840b4a10 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f1889505640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f18840cf960 con 0x7f188415e3b0 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f18837fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f18840b4a10 0x7f18840d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f18827fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f18840d21b0 0x7f18840d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54614/0 (socket says 172.21.15.103:54614) 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f18827fc640 1 -- 172.21.15.103:0/1433028027 learned_addr learned my addr 172.21.15.103:0/1433028027 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f1882ffd640 1 --2- 172.21.15.103:0/1433028027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415e3b0 0x7f18840d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f18837fe640 1 -- 172.21.15.103:0/1433028027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415e3b0 msgr2=0x7f18840d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f18837fe640 1 --2- 172.21.15.103:0/1433028027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415e3b0 0x7f18840d2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f18837fe640 1 -- 172.21.15.103:0/1433028027 >> v1:172.21.15.103:6789/0 conn(0x7f18840d21b0 legacy=0x7f18840d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f18837fe640 1 -- 172.21.15.103:0/1433028027 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18840cfbb0 con 0x7f18840b4a10 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.622+0000 7f1881ffb640 1 -- 172.21.15.103:0/1433028027 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276353606 0 0) 0x7f18840d4e10 con 0x7f18840d21b0 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.623+0000 7f18837fe640 1 --2- 172.21.15.103:0/1433028027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18840b4a10 0x7f18840d2c40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f187c0097a0 tx=0x7f187c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c4539eb98bf3d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.623+0000 7f1881ffb640 1 -- 172.21.15.103:0/1433028027 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c037070 con 0x7f18840b4a10 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.623+0000 7f1881ffb640 1 -- 172.21.15.103:0/1433028027 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c032440 con 0x7f18840b4a10 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.623+0000 7f1881ffb640 1 -- 172.21.15.103:0/1433028027 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c032810 con 0x7f18840b4a10 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.624+0000 7f1889505640 1 -- 172.21.15.103:0/1433028027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18840b4a10 msgr2=0x7f18840d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.624+0000 7f1889505640 1 --2- 172.21.15.103:0/1433028027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18840b4a10 0x7f18840d2c40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f187c0097a0 tx=0x7f187c02a180 comp rx=0 tx=0).stop 2024-08-18T23:57:03.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.624+0000 7f1889505640 1 -- 172.21.15.103:0/1433028027 shutdown_connections 2024-08-18T23:57:03.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.624+0000 7f1889505640 1 --2- 172.21.15.103:0/1433028027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18840b4a10 0x7f18840d2c40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.624+0000 7f1889505640 1 --2- 172.21.15.103:0/1433028027 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415e3b0 0x7f18840d2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.624+0000 7f1889505640 1 -- 172.21.15.103:0/1433028027 >> 172.21.15.103:0/1433028027 conn(0x7f18840d40a0 msgr2=0x7f18840d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:03.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.624+0000 7f1889505640 1 -- 172.21.15.103:0/1433028027 shutdown_connections 2024-08-18T23:57:03.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.624+0000 7f1889505640 1 -- 172.21.15.103:0/1433028027 wait complete. 2024-08-18T23:57:03.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.625+0000 7f1889505640 1 Processor -- start 2024-08-18T23:57:03.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.625+0000 7f1889505640 1 -- start start 2024-08-18T23:57:03.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f1889505640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18840b4a10 0x7f188409e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f1889505640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18840d21b0 0x7f188415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f1889505640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f188415e3b0 0x7f18840b9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f1889505640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f188415e790 con 0x7f188415e3b0 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f1889505640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f18840d0200 con 0x7f18840d21b0 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f1889505640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f188415e910 con 0x7f18840b4a10 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18837fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f188415e3b0 0x7f18840b9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18837fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f188415e3b0 0x7f18840b9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39002/0 (socket says 172.21.15.103:39002) 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18837fe640 1 -- 172.21.15.103:0/1025151280 learned_addr learned my addr 172.21.15.103:0/1025151280 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18827fc640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18840d21b0 0x7f188415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f1882ffd640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18840b4a10 0x7f188409e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18837fe640 1 -- 172.21.15.103:0/1025151280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18840b4a10 msgr2=0x7f188409e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18837fe640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18840b4a10 0x7f188409e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18837fe640 1 -- 172.21.15.103:0/1025151280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18840d21b0 msgr2=0x7f188415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18837fe640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18840d21b0 0x7f188415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.626+0000 7f18837fe640 1 -- 172.21.15.103:0/1025151280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18841f7970 con 0x7f188415e3b0 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.627+0000 7f18837fe640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f188415e3b0 0x7f18840b9160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f187c0097a0 tx=0x7f187c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.627+0000 7f186b7fe640 1 -- 172.21.15.103:0/1025151280 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c037040 con 0x7f188415e3b0 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.627+0000 7f186b7fe640 1 -- 172.21.15.103:0/1025151280 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187c042070 con 0x7f188415e3b0 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.627+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18841f7c50 con 0x7f188415e3b0 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.627+0000 7f186b7fe640 1 -- 172.21.15.103:0/1025151280 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c030b30 con 0x7f188415e3b0 2024-08-18T23:57:03.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.627+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18841f8210 con 0x7f188415e3b0 2024-08-18T23:57:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.628+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18840b3000 con 0x7f188415e3b0 2024-08-18T23:57:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.628+0000 7f186b7fe640 1 -- 172.21.15.103:0/1025151280 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f187c030cd0 con 0x7f188415e3b0 2024-08-18T23:57:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.629+0000 7f186b7fe640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f187006be30 0x7f187006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.629+0000 7f186b7fe640 1 -- 172.21.15.103:0/1025151280 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f187c0abaa0 con 0x7f188415e3b0 2024-08-18T23:57:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.629+0000 7f1882ffd640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f187006be30 0x7f187006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.629+0000 7f1882ffd640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f187006be30 0x7f187006e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1874003aa0 tx=0x7f1874009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:03.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.633+0000 7f186b7fe640 1 -- 172.21.15.103:0/1025151280 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f187c032e20 con 0x7f188415e3b0 2024-08-18T23:57:03.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.809+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1884068df0 con 0x7f188415e3b0 2024-08-18T23:57:03.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.809+0000 7f186b7fe640 1 -- 172.21.15.103:0/1025151280 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f187c079b50 con 0x7f188415e3b0 2024-08-18T23:57:03.811 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.811+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f187006be30 msgr2=0x7f187006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.811+0000 7f1889505640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f187006be30 0x7f187006e2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1874003aa0 tx=0x7f1874009830 comp rx=0 tx=0).stop 2024-08-18T23:57:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f188415e3b0 msgr2=0x7f18840b9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:03.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f188415e3b0 0x7f18840b9160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f187c0097a0 tx=0x7f187c0046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 shutdown_connections 2024-08-18T23:57:03.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f187006be30 0x7f187006e2f0 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1874003aa0 tx=0x7f1874009830 comp rx=0 tx=0).stop 2024-08-18T23:57:03.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f188415e3b0 0x7f18840b9160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18840d21b0 0x7f188415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 --2- 172.21.15.103:0/1025151280 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18840b4a10 0x7f188409e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:03.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 >> 172.21.15.103:0/1025151280 conn(0x7f18840d40a0 msgr2=0x7f188406c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:03.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 shutdown_connections 2024-08-18T23:57:03.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:03.812+0000 7f1889505640 1 -- 172.21.15.103:0/1025151280 wait complete. 2024-08-18T23:57:03.824 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-08-18T23:57:03.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:03.824 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-18T23:57:03.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[31704]: fuse finished with error 0 and tester_r 0 2024-08-18T23:57:03.849 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:09.950 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:57:09.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:09.950 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-18T23:57:10.205 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.313+0000 7f0596e0a640 1 Processor -- start 2024-08-18T23:57:10.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.314+0000 7f0596e0a640 1 -- start start 2024-08-18T23:57:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.314+0000 7f0596e0a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05900d4bc0 0x7f05900d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.314+0000 7f0596e0a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0590160090 0x7f0590160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.314+0000 7f0596e0a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05900d0860 con 0x7f059015f8a0 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.314+0000 7f0596e0a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f05900cfc00 con 0x7f0590160090 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.314+0000 7f0596e0a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f05900b32c0 con 0x7f05900d4bc0 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.315+0000 7f05953a7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0590160090 0x7f0590160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.315+0000 7f05953a7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0590160090 0x7f0590160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39004/0 (socket says 172.21.15.103:39004) 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.315+0000 7f05953a7640 1 -- 172.21.15.103:0/3766767414 learned_addr learned my addr 172.21.15.103:0/3766767414 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.315+0000 7f0587fff640 1 --2- 172.21.15.103:0/3766767414 >> v2:172.21.15.190:3300/0 conn(0x7f05900d4bc0 0x7f05900d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.315+0000 7f05953a7640 1 -- 172.21.15.103:0/3766767414 >> v2:172.21.15.190:3300/0 conn(0x7f05900d4bc0 msgr2=0x7f05900d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.315+0000 7f05953a7640 1 --2- 172.21.15.103:0/3766767414 >> v2:172.21.15.190:3300/0 conn(0x7f05900d4bc0 0x7f05900d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.315+0000 7f05953a7640 1 -- 172.21.15.103:0/3766767414 >> v1:172.21.15.190:6789/0 conn(0x7f059015f8a0 legacy=0x7f05900d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:10.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.315+0000 7f05953a7640 1 -- 172.21.15.103:0/3766767414 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05900d0090 con 0x7f0590160090 2024-08-18T23:57:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f05953a7640 1 --2- 172.21.15.103:0/3766767414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f0590160520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0590073f90 tx=0x7f058802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef2b0d562a72f45 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f05877fe640 1 -- 172.21.15.103:0/3766767414 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588036070 con 0x7f0590160090 2024-08-18T23:57:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f05877fe640 1 -- 172.21.15.103:0/3766767414 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588031600 con 0x7f0590160090 2024-08-18T23:57:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f05877fe640 1 -- 172.21.15.103:0/3766767414 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05880319d0 con 0x7f0590160090 2024-08-18T23:57:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f0596e0a640 1 -- 172.21.15.103:0/3766767414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 msgr2=0x7f0590160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3766767414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f0590160520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0590073f90 tx=0x7f058802a6f0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f0596e0a640 1 -- 172.21.15.103:0/3766767414 shutdown_connections 2024-08-18T23:57:10.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3766767414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f0590160520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3766767414 >> v2:172.21.15.190:3300/0 conn(0x7f05900d4bc0 0x7f05900d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f0596e0a640 1 -- 172.21.15.103:0/3766767414 >> 172.21.15.103:0/3766767414 conn(0x7f05900d40a0 msgr2=0x7f05900d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f0596e0a640 1 -- 172.21.15.103:0/3766767414 shutdown_connections 2024-08-18T23:57:10.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.316+0000 7f0596e0a640 1 -- 172.21.15.103:0/3766767414 wait complete. 2024-08-18T23:57:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.318+0000 7f0596e0a640 1 Processor -- start 2024-08-18T23:57:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.318+0000 7f0596e0a640 1 -- start start 2024-08-18T23:57:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.318+0000 7f0596e0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05900d4bc0 0x7f05901545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.318+0000 7f0596e0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f059015f8a0 0x7f05900b9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f0596e0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f05900d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f0596e0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f05900b2fb0 con 0x7f0590160090 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f0596e0a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f05900cf890 con 0x7f05900d4bc0 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f0596e0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f059015fc80 con 0x7f059015f8a0 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f05900d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f05900d1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39006/0 (socket says 172.21.15.103:39006) 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 -- 172.21.15.103:0/3149930789 learned_addr learned my addr 172.21.15.103:0/3149930789 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f0594ba6640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05900d4bc0 0x7f05901545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f0587fff640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f059015f8a0 0x7f05900b9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 -- 172.21.15.103:0/3149930789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f059015f8a0 msgr2=0x7f05900b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f059015f8a0 0x7f05900b9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 -- 172.21.15.103:0/3149930789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05900d4bc0 msgr2=0x7f05901545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05900d4bc0 0x7f05901545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 -- 172.21.15.103:0/3149930789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0590154af0 con 0x7f0590160090 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05953a7640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f05900d1fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0588034040 tx=0x7f0588004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05857fa640 1 -- 172.21.15.103:0/3149930789 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588036050 con 0x7f0590160090 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05857fa640 1 -- 172.21.15.103:0/3149930789 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0588042070 con 0x7f0590160090 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05900b3e70 con 0x7f0590160090 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.319+0000 7f05857fa640 1 -- 172.21.15.103:0/3149930789 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588009510 con 0x7f0590160090 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.320+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05900b4430 con 0x7f0590160090 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.320+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0590160520 con 0x7f0590160090 2024-08-18T23:57:10.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.321+0000 7f05857fa640 1 -- 172.21.15.103:0/3149930789 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0588007bd0 con 0x7f0590160090 2024-08-18T23:57:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.321+0000 7f05857fa640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f057c06be30 0x7f057c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.321+0000 7f05857fa640 1 -- 172.21.15.103:0/3149930789 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f05880abe30 con 0x7f0590160090 2024-08-18T23:57:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.321+0000 7f0594ba6640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f057c06be30 0x7f057c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.322+0000 7f0594ba6640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f057c06be30 0x7f057c06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f058c004f60 tx=0x7f058c007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.326+0000 7f05857fa640 1 -- 172.21.15.103:0/3149930789 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0590154af0 con 0x7f0590160090 2024-08-18T23:57:10.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.493+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05900d2e50 con 0x7f0590160090 2024-08-18T23:57:10.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.494+0000 7f05857fa640 1 -- 172.21.15.103:0/3149930789 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f0588079ee0 con 0x7f0590160090 2024-08-18T23:57:10.496 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:10.496 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:10.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f057c06be30 msgr2=0x7f057c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f057c06be30 0x7f057c06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f058c004f60 tx=0x7f058c007e30 comp rx=0 tx=0).stop 2024-08-18T23:57:10.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 msgr2=0x7f05900d1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f05900d1fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0588034040 tx=0x7f0588004a40 comp rx=0 tx=0).stop 2024-08-18T23:57:10.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 shutdown_connections 2024-08-18T23:57:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f057c06be30 0x7f057c06e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0590160090 0x7f05900d1fa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f059015f8a0 0x7f05900b9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 --2- 172.21.15.103:0/3149930789 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05900d4bc0 0x7f05901545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.496+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 >> 172.21.15.103:0/3149930789 conn(0x7f05900d40a0 msgr2=0x7f05900b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.497+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 shutdown_connections 2024-08-18T23:57:10.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.497+0000 7f0596e0a640 1 -- 172.21.15.103:0/3149930789 wait complete. 2024-08-18T23:57:10.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:10.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.606+0000 7efece4fc640 1 Processor -- start 2024-08-18T23:57:10.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.606+0000 7efece4fc640 1 -- start start 2024-08-18T23:57:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efece4fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec809b090 0x7efec80b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efece4fc640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec80d0900 con 0x7efec81619f0 2024-08-18T23:57:10.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efece4fc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efec80d1090 con 0x7efec809acb0 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efece4fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efec80b2bd0 con 0x7efec809b090 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efecca99640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7efec81619f0 0x7efec806d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54616/0 (socket says 172.21.15.103:54616) 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efecca99640 1 -- 172.21.15.103:0/4159061684 learned_addr learned my addr 172.21.15.103:0/4159061684 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efec77fe640 1 --2- 172.21.15.103:0/4159061684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec809b090 0x7efec80b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efec6ffd640 1 -- 172.21.15.103:0/4159061684 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969481470 0 0) 0x7efec80d0900 con 0x7efec81619f0 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.607+0000 7efec6ffd640 1 -- 172.21.15.103:0/4159061684 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efeb0003520 con 0x7efec81619f0 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.608+0000 7efec6ffd640 1 -- 172.21.15.103:0/4159061684 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932808391 0 0) 0x7efec80d1090 con 0x7efec809acb0 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.608+0000 7efec6ffd640 1 -- 172.21.15.103:0/4159061684 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efec80d0900 con 0x7efec809acb0 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.608+0000 7efec77fe640 1 -- 172.21.15.103:0/4159061684 >> v1:172.21.15.190:6789/0 conn(0x7efec809acb0 legacy=0x7efec81612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.608+0000 7efec77fe640 1 -- 172.21.15.103:0/4159061684 >> v1:172.21.15.103:6789/0 conn(0x7efec81619f0 legacy=0x7efec806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.608+0000 7efec77fe640 1 -- 172.21.15.103:0/4159061684 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec80b2eb0 con 0x7efec809b090 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.608+0000 7efec77fe640 1 --2- 172.21.15.103:0/4159061684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec809b090 0x7efec80b35d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efebc0097d0 tx=0x7efebc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aa3762258b42a73 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efec6ffd640 1 -- 172.21.15.103:0/4159061684 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc037070 con 0x7efec809b090 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efec6ffd640 1 -- 172.21.15.103:0/4159061684 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc032440 con 0x7efec809b090 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efec6ffd640 1 -- 172.21.15.103:0/4159061684 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc0327f0 con 0x7efec809b090 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efece4fc640 1 -- 172.21.15.103:0/4159061684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec809b090 msgr2=0x7efec80b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efece4fc640 1 --2- 172.21.15.103:0/4159061684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec809b090 0x7efec80b35d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efebc0097d0 tx=0x7efebc02a210 comp rx=0 tx=0).stop 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efece4fc640 1 -- 172.21.15.103:0/4159061684 shutdown_connections 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efece4fc640 1 --2- 172.21.15.103:0/4159061684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec809b090 0x7efec80b35d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efece4fc640 1 -- 172.21.15.103:0/4159061684 >> 172.21.15.103:0/4159061684 conn(0x7efec80b3b20 msgr2=0x7efec80b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:10.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efece4fc640 1 -- 172.21.15.103:0/4159061684 shutdown_connections 2024-08-18T23:57:10.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.609+0000 7efece4fc640 1 -- 172.21.15.103:0/4159061684 wait complete. 2024-08-18T23:57:10.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.610+0000 7efece4fc640 1 Processor -- start 2024-08-18T23:57:10.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efece4fc640 1 -- start start 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efece4fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec809acb0 0x7efec81e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efece4fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec809b090 0x7efec81594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efece4fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec81619f0 0x7efec815e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efece4fc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efec80b4640 con 0x7efec809b090 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efece4fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efec80b3190 con 0x7efec809acb0 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efece4fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efec80b47c0 con 0x7efec81619f0 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efec77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec809b090 0x7efec81594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efec77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec809b090 0x7efec81594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39012/0 (socket says 172.21.15.103:39012) 2024-08-18T23:57:10.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.611+0000 7efec77fe640 1 -- 172.21.15.103:0/931487446 learned_addr learned my addr 172.21.15.103:0/931487446 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec7fff640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec809acb0 0x7efec81e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efecca99640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec81619f0 0x7efec815e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec77fe640 1 -- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec81619f0 msgr2=0x7efec815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec77fe640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec81619f0 0x7efec815e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec77fe640 1 -- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec809acb0 msgr2=0x7efec81e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec77fe640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec809acb0 0x7efec81e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec77fe640 1 -- 172.21.15.103:0/931487446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec80c8ca0 con 0x7efec809b090 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efecca99640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec81619f0 0x7efec815e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec77fe640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec809b090 0x7efec81594d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efebc02a250 tx=0x7efebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec4ff9640 1 -- 172.21.15.103:0/931487446 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc041020 con 0x7efec809b090 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec4ff9640 1 -- 172.21.15.103:0/931487446 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc03d6e0 con 0x7efec809b090 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec81eaa60 con 0x7efec809b090 2024-08-18T23:57:10.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efec4ff9640 1 -- 172.21.15.103:0/931487446 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc037040 con 0x7efec809b090 2024-08-18T23:57:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.612+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec80c94a0 con 0x7efec809b090 2024-08-18T23:57:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.613+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec80b26e0 con 0x7efec809b090 2024-08-18T23:57:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.614+0000 7efec4ff9640 1 -- 172.21.15.103:0/931487446 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efebc044020 con 0x7efec809b090 2024-08-18T23:57:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.614+0000 7efec4ff9640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efeb406be30 0x7efeb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.614+0000 7efec7fff640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efeb406be30 0x7efeb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.614+0000 7efec4ff9640 1 -- 172.21.15.103:0/931487446 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efebc0ab960 con 0x7efec809b090 2024-08-18T23:57:10.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.615+0000 7efec7fff640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efeb406be30 0x7efeb406e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efeb80011e0 tx=0x7efeb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.619+0000 7efec4ff9640 1 -- 172.21.15.103:0/931487446 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efebc04b030 con 0x7efec809b090 2024-08-18T23:57:10.787 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.785+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efec80b35d0 con 0x7efec809b090 2024-08-18T23:57:10.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.787+0000 7efec4ff9640 1 -- 172.21.15.103:0/931487446 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7efebc07ee20 con 0x7efec809b090 2024-08-18T23:57:10.788 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:10.788 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efeb406be30 msgr2=0x7efeb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efeb406be30 0x7efeb406e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efeb80011e0 tx=0x7efeb8009040 comp rx=0 tx=0).stop 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec809b090 msgr2=0x7efec81594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec809b090 0x7efec81594d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efebc02a250 tx=0x7efebc0046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 shutdown_connections 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efeb406be30 0x7efeb406e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec81619f0 0x7efec815e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efec809b090 0x7efec81594d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 --2- 172.21.15.103:0/931487446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec809acb0 0x7efec81e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 >> 172.21.15.103:0/931487446 conn(0x7efec80b3b20 msgr2=0x7efec815ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 shutdown_connections 2024-08-18T23:57:10.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.789+0000 7efece4fc640 1 -- 172.21.15.103:0/931487446 wait complete. 2024-08-18T23:57:10.801 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T23:57:10.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.902+0000 7f46535df640 1 Processor -- start 2024-08-18T23:57:10.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.902+0000 7f46535df640 1 -- start start 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.903+0000 7f46535df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c0b2e80 0x7f464c0cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.903+0000 7f46535df640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f464c0b33f0 con 0x7f464c0cc710 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.903+0000 7f46535df640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f464c06d670 con 0x7f464c161770 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.903+0000 7f46535df640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f464c06d420 con 0x7f464c0b2e80 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.903+0000 7f4651b7c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f464c0cc710 0x7f464c0ccbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54620/0 (socket says 172.21.15.103:54620) 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.903+0000 7f4651b7c640 1 -- 172.21.15.103:0/2463458276 learned_addr learned my addr 172.21.15.103:0/2463458276 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.903+0000 7f4650b7a640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c0b2e80 0x7f464c0cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985805917 0 0) 0x7f464c0b33f0 con 0x7f464c0cc710 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4634003520 con 0x7f464c0cc710 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1614497976 0 0) 0x7f4634003520 con 0x7f464c0cc710 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c0b2e80 msgr2=0x7f464c0cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:10.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c0b2e80 0x7f464c0cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 >> v1:172.21.15.190:6789/0 conn(0x7f464c161770 legacy=0x7f464c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464c06d950 con 0x7f464c0cc710 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f463c0019f0 con 0x7f464c0cc710 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 >> v1:172.21.15.103:6789/0 conn(0x7f464c0cc710 legacy=0x7f464c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c0b2e80 0x7f46340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4634003f60 0x7f4634004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634004d40 0x7f46340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f464c06d420 con 0x7f4634003f60 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f463400bc00 con 0x7f4634004d40 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f463400be00 con 0x7f464c0b2e80 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f4650b7a640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4634003f60 0x7f4634004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f4651b7c640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634004d40 0x7f46340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f465137b640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c0b2e80 0x7f46340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f4650b7a640 1 -- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c0b2e80 msgr2=0x7f46340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:10.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f4650b7a640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c0b2e80 0x7f46340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f4650b7a640 1 -- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634004d40 msgr2=0x7f46340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:10.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f4650b7a640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634004d40 0x7f46340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.904+0000 7f4650b7a640 1 -- 172.21.15.103:0/2463458276 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4634003520 con 0x7f4634003f60 2024-08-18T23:57:10.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.905+0000 7f4650b7a640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4634003f60 0x7f4634004800 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4640009a90 tx=0x7f4634005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57e1f4400779d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.905+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640036070 con 0x7f4634003f60 2024-08-18T23:57:10.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.905+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4640031400 con 0x7f4634003f60 2024-08-18T23:57:10.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.905+0000 7f464bfff640 1 -- 172.21.15.103:0/2463458276 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640009690 con 0x7f4634003f60 2024-08-18T23:57:10.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.906+0000 7f46535df640 1 -- 172.21.15.103:0/2463458276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4634003f60 msgr2=0x7f4634004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.906+0000 7f46535df640 1 --2- 172.21.15.103:0/2463458276 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4634003f60 0x7f4634004800 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4640009a90 tx=0x7f4634005830 comp rx=0 tx=0).stop 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.906+0000 7f4651b7c640 1 -- 172.21.15.103:0/2463458276 reap_dead start 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.906+0000 7f46535df640 1 -- 172.21.15.103:0/2463458276 shutdown_connections 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.906+0000 7f46535df640 1 -- 172.21.15.103:0/2463458276 >> 172.21.15.103:0/2463458276 conn(0x7f464c0d1ec0 msgr2=0x7f464c0d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.906+0000 7f46535df640 1 -- 172.21.15.103:0/2463458276 shutdown_connections 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.906+0000 7f46535df640 1 -- 172.21.15.103:0/2463458276 wait complete. 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.907+0000 7f46535df640 1 Processor -- start 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.907+0000 7f46535df640 1 -- start start 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f46535df640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634003f60 0x7f464c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f46535df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f464c152940 0x7f464c0b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f46535df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c152dc0 0x7f464c0b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f46535df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f464c06dcc0 con 0x7f464c152940 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f46535df640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f464c0d12f0 con 0x7f4634003f60 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f46535df640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f464c0d1470 con 0x7f464c152dc0 2024-08-18T23:57:10.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f464c152940 0x7f464c0b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f464c152940 0x7f464c0b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39026/0 (socket says 172.21.15.103:39026) 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 -- 172.21.15.103:0/2328269825 learned_addr learned my addr 172.21.15.103:0/2328269825 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f465137b640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634003f60 0x7f464c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4651b7c640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c152dc0 0x7f464c0b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 -- 172.21.15.103:0/2328269825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c152dc0 msgr2=0x7f464c0b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c152dc0 0x7f464c0b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 -- 172.21.15.103:0/2328269825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634003f60 msgr2=0x7f464c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634003f60 0x7f464c158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 -- 172.21.15.103:0/2328269825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464c1582f0 con 0x7f464c152940 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4650b7a640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f464c152940 0x7f464c0b6890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4640000c00 tx=0x7f4640004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4649ffb640 1 -- 172.21.15.103:0/2328269825 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640040070 con 0x7f464c152940 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4649ffb640 1 -- 172.21.15.103:0/2328269825 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f464003b460 con 0x7f464c152940 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f464c1585d0 con 0x7f464c152940 2024-08-18T23:57:10.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.908+0000 7f4649ffb640 1 -- 172.21.15.103:0/2328269825 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640036040 con 0x7f464c152940 2024-08-18T23:57:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.909+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f464c15b590 con 0x7f464c152940 2024-08-18T23:57:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.910+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f464c0ce740 con 0x7f464c152940 2024-08-18T23:57:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.910+0000 7f4649ffb640 1 -- 172.21.15.103:0/2328269825 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4640043070 con 0x7f464c152940 2024-08-18T23:57:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.910+0000 7f4649ffb640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f463806be30 0x7f463806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:10.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.910+0000 7f4649ffb640 1 -- 172.21.15.103:0/2328269825 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f46400aba20 con 0x7f464c152940 2024-08-18T23:57:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.911+0000 7f465137b640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f463806be30 0x7f463806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.911+0000 7f465137b640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f463806be30 0x7f463806e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f46440017e0 tx=0x7f4644009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:10.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:10.915+0000 7f4649ffb640 1 -- 172.21.15.103:0/2328269825 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4640079a40 con 0x7f464c152940 2024-08-18T23:57:11.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.114+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f464c0d19e0 con 0x7f464c152940 2024-08-18T23:57:11.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.829+0000 7f4649ffb640 1 -- 172.21.15.103:0/2328269825 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f464007dd40 con 0x7f464c152940 2024-08-18T23:57:11.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f463806be30 msgr2=0x7f463806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f463806be30 0x7f463806e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f46440017e0 tx=0x7f4644009040 comp rx=0 tx=0).stop 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f464c152940 msgr2=0x7f464c0b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f464c152940 0x7f464c0b6890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4640000c00 tx=0x7f4640004730 comp rx=0 tx=0).stop 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 shutdown_connections 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f463806be30 0x7f463806e2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f464c152dc0 0x7f464c0b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f464c152940 0x7f464c0b6890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 --2- 172.21.15.103:0/2328269825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4634003f60 0x7f464c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 >> 172.21.15.103:0/2328269825 conn(0x7f464c0d1ec0 msgr2=0x7f464c0ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 shutdown_connections 2024-08-18T23:57:11.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.831+0000 7f46535df640 1 -- 172.21.15.103:0/2328269825 wait complete. 2024-08-18T23:57:11.844 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-08-18T23:57:11.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T23:57:11.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.945+0000 7faad292c640 1 Processor -- start 2024-08-18T23:57:11.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.945+0000 7faad292c640 1 -- start start 2024-08-18T23:57:11.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.945+0000 7faad292c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 0x7faacc0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:11.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.945+0000 7faad292c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faacc15e9c0 0x7faacc0ceda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad292c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faacc0d0b40 con 0x7faacc0b1540 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad292c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7faacc06f830 con 0x7faacc15e9c0 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad292c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faacc0d0e20 con 0x7faacc15fbe0 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad0ec9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faacc15e9c0 0x7faacc0ceda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad0ec9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faacc15e9c0 0x7faacc0ceda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39028/0 (socket says 172.21.15.103:39028) 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad0ec9640 1 -- 172.21.15.103:0/312175824 learned_addr learned my addr 172.21.15.103:0/312175824 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad0ec9640 1 -- 172.21.15.103:0/312175824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 msgr2=0x7faacc0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faacb7fe640 1 --2- 172.21.15.103:0/312175824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 0x7faacc0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad0ec9640 1 --2- 172.21.15.103:0/312175824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 0x7faacc0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad0ec9640 1 -- 172.21.15.103:0/312175824 >> v1:172.21.15.190:6789/0 conn(0x7faacc0b1540 legacy=0x7faacc0d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:11.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.946+0000 7faad0ec9640 1 -- 172.21.15.103:0/312175824 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc0d1100 con 0x7faacc15e9c0 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad0ec9640 1 --2- 172.21.15.103:0/312175824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc0ceda0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faac4009e50 tx=0x7faac402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3128f0cc2ae2f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faacaffd640 1 -- 172.21.15.103:0/312175824 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4036070 con 0x7faacc15e9c0 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faacaffd640 1 -- 172.21.15.103:0/312175824 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac4031600 con 0x7faacc15e9c0 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faacaffd640 1 -- 172.21.15.103:0/312175824 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac40319d0 con 0x7faacc15e9c0 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad292c640 1 -- 172.21.15.103:0/312175824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 msgr2=0x7faacc0ceda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad292c640 1 --2- 172.21.15.103:0/312175824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc0ceda0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faac4009e50 tx=0x7faac402a750 comp rx=0 tx=0).stop 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad292c640 1 -- 172.21.15.103:0/312175824 shutdown_connections 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad292c640 1 --2- 172.21.15.103:0/312175824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc0ceda0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad292c640 1 --2- 172.21.15.103:0/312175824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 0x7faacc0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad292c640 1 -- 172.21.15.103:0/312175824 >> 172.21.15.103:0/312175824 conn(0x7faacc0d1ee0 msgr2=0x7faacc0d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad292c640 1 -- 172.21.15.103:0/312175824 shutdown_connections 2024-08-18T23:57:11.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.947+0000 7faad292c640 1 -- 172.21.15.103:0/312175824 wait complete. 2024-08-18T23:57:11.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.949+0000 7faad292c640 1 Processor -- start 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.949+0000 7faad292c640 1 -- start start 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.949+0000 7faad292c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faacc0b1540 0x7faacc0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.949+0000 7faad292c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc1528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.949+0000 7faad292c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 0x7faacc0cec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.949+0000 7faad292c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faacc15db50 con 0x7faacc15e9c0 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faad292c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faacc0d0850 con 0x7faacc0b1540 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faad292c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faacc15dcd0 con 0x7faacc15fbe0 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc1528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc1528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39034/0 (socket says 172.21.15.103:39034) 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 -- 172.21.15.103:0/2688973373 learned_addr learned my addr 172.21.15.103:0/2688973373 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faad0ec9640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 0x7faacc0cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:11.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacbfff640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faacc0b1540 0x7faacc0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 -- 172.21.15.103:0/2688973373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 msgr2=0x7faacc0cec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 0x7faacc0cec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 -- 172.21.15.103:0/2688973373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faacc0b1540 msgr2=0x7faacc0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faacc0b1540 0x7faacc0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 -- 172.21.15.103:0/2688973373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faacc0b1e80 con 0x7faacc15e9c0 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faacb7fe640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc1528d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faac000c5f0 tx=0x7faac000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faac8ff9640 1 -- 172.21.15.103:0/2688973373 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0015070 con 0x7faacc15e9c0 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faac8ff9640 1 -- 172.21.15.103:0/2688973373 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac0004220 con 0x7faacc15e9c0 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faacc152e10 con 0x7faacc15e9c0 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faac8ff9640 1 -- 172.21.15.103:0/2688973373 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0003610 con 0x7faacc15e9c0 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.950+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faacc0b62b0 con 0x7faacc15e9c0 2024-08-18T23:57:11.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.951+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faacc0d0140 con 0x7faacc15e9c0 2024-08-18T23:57:11.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.952+0000 7faac8ff9640 1 -- 172.21.15.103:0/2688973373 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faac00037b0 con 0x7faacc15e9c0 2024-08-18T23:57:11.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.952+0000 7faac8ff9640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7faab806be30 0x7faab806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:11.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.952+0000 7faac8ff9640 1 -- 172.21.15.103:0/2688973373 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faac008ae50 con 0x7faacc15e9c0 2024-08-18T23:57:11.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.952+0000 7faacbfff640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7faab806be30 0x7faab806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:11.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.953+0000 7faacbfff640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7faab806be30 0x7faab806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faacc0b39d0 tx=0x7faabc007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:11.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:11.956+0000 7faac8ff9640 1 -- 172.21.15.103:0/2688973373 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7faacc152e10 con 0x7faacc15e9c0 2024-08-18T23:57:12.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.156+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7faacc0b7e60 con 0x7faacc15e9c0 2024-08-18T23:57:12.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.837+0000 7faac8ff9640 1 -- 172.21.15.103:0/2688973373 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7faac0058e70 con 0x7faacc15e9c0 2024-08-18T23:57:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.839+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7faab806be30 msgr2=0x7faab806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.839+0000 7faad292c640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7faab806be30 0x7faab806e2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faacc0b39d0 tx=0x7faabc007e30 comp rx=0 tx=0).stop 2024-08-18T23:57:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.839+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 msgr2=0x7faacc1528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.839+0000 7faad292c640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc1528d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faac000c5f0 tx=0x7faac000cab0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.840+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 shutdown_connections 2024-08-18T23:57:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.840+0000 7faad292c640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7faab806be30 0x7faab806e2f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.840+0000 7faad292c640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faacc15fbe0 0x7faacc0cec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.840+0000 7faad292c640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faacc15e9c0 0x7faacc1528d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.840+0000 7faad292c640 1 --2- 172.21.15.103:0/2688973373 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faacc0b1540 0x7faacc0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.840+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 >> 172.21.15.103:0/2688973373 conn(0x7faacc0d1ee0 msgr2=0x7faacc070800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:12.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.840+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 shutdown_connections 2024-08-18T23:57:12.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.840+0000 7faad292c640 1 -- 172.21.15.103:0/2688973373 wait complete. 2024-08-18T23:57:12.852 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T23:57:12.853 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:12.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.950+0000 7f3de7181640 1 Processor -- start 2024-08-18T23:57:12.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.951+0000 7f3de7181640 1 -- start start 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.951+0000 7f3de7181640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3de006b900 0x7f3de006bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.951+0000 7f3de7181640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de00cda50 con 0x7f3de015e130 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.951+0000 7f3de7181640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de00cdd30 con 0x7f3de0072710 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.951+0000 7f3de7181640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3de006c2b0 con 0x7f3de006b900 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.951+0000 7f3de4f1d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3de015e130 0x7f3de00ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:54632/0 (socket says 172.21.15.103:54632) 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.951+0000 7f3de4f1d640 1 -- 172.21.15.103:0/820905764 learned_addr learned my addr 172.21.15.103:0/820905764 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddffff640 1 --2- 172.21.15.103:0/820905764 >> v2:172.21.15.190:3300/0 conn(0x7f3de006b900 0x7f3de006bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512230063 0 0) 0x7f3de00cda50 con 0x7f3de015e130 2024-08-18T23:57:12.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dc8003520 con 0x7f3de015e130 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951004128 0 0) 0x7f3de00cdd30 con 0x7f3de0072710 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de00cda50 con 0x7f3de0072710 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3785057349 0 0) 0x7f3dc8003520 con 0x7f3de015e130 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 >> v2:172.21.15.190:3300/0 conn(0x7f3de006b900 msgr2=0x7f3de006bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 --2- 172.21.15.103:0/820905764 >> v2:172.21.15.190:3300/0 conn(0x7f3de006b900 0x7f3de006bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 >> v1:172.21.15.190:6789/0 conn(0x7f3de0072710 legacy=0x7f3de0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de00ce010 con 0x7f3de015e130 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f3dd0001670 con 0x7f3de015e130 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddffff640 1 --2- 172.21.15.103:0/820905764 >> v2:172.21.15.190:3300/0 conn(0x7f3de006b900 0x7f3de006bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 >> v1:172.21.15.103:6789/0 conn(0x7f3de015e130 legacy=0x7f3de00ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8003b90 0x7f3dc8003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc8004800 0x7f3dc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:12.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dc80051c0 0x7f3dc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3de006c2b0 con 0x7f3dc8004800 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3dc800c090 con 0x7f3dc80051c0 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3dc800c290 con 0x7f3dc8003b90 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3ddffff640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc8004800 0x7f3dc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3de4f1d640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8003b90 0x7f3dc8003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.952+0000 7f3de571e640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dc80051c0 0x7f3dc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddffff640 1 -- 172.21.15.103:0/820905764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8003b90 msgr2=0x7f3dc8003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddffff640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8003b90 0x7f3dc8003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddffff640 1 -- 172.21.15.103:0/820905764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dc80051c0 msgr2=0x7f3dc800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddffff640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3dc80051c0 0x7f3dc800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3de571e640 1 -- 172.21.15.103:0/820905764 reap_dead start 2024-08-18T23:57:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddffff640 1 -- 172.21.15.103:0/820905764 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dc8003520 con 0x7f3dc8004800 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddffff640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc8004800 0x7f3dc8004c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400e350 tx=0x7f3dc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550d771d79d9e4de server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4033070 con 0x7f3dc8004800 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd402f660 con 0x7f3dc8004800 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.953+0000 7f3ddf7fe640 1 -- 172.21.15.103:0/820905764 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4009de0 con 0x7f3dc8004800 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.954+0000 7f3de7181640 1 -- 172.21.15.103:0/820905764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc8004800 msgr2=0x7f3dc8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.954+0000 7f3de7181640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc8004800 0x7f3dc8004c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400e350 tx=0x7f3dc8005830 comp rx=0 tx=0).stop 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.954+0000 7f3de7181640 1 -- 172.21.15.103:0/820905764 shutdown_connections 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.954+0000 7f3de7181640 1 --2- 172.21.15.103:0/820905764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3dc8004800 0x7f3dc8004c80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.954+0000 7f3de7181640 1 -- 172.21.15.103:0/820905764 >> 172.21.15.103:0/820905764 conn(0x7f3de00b2aa0 msgr2=0x7f3de00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.954+0000 7f3de7181640 1 -- 172.21.15.103:0/820905764 shutdown_connections 2024-08-18T23:57:12.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.954+0000 7f3de7181640 1 -- 172.21.15.103:0/820905764 wait complete. 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.955+0000 7f3de7181640 1 Processor -- start 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.955+0000 7f3de7181640 1 -- start start 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de7181640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8004800 0x7f3de01522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de7181640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de014fa50 0x7f3de0072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de7181640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de0073030 0x7f3de0152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de7181640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3de00ce5d0 con 0x7f3de0073030 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de7181640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3de006ee80 con 0x7f3de014fa50 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de7181640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00cd700 con 0x7f3dc8004800 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de571e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de0073030 0x7f3de0152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:12.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de571e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de0073030 0x7f3de0152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39056/0 (socket says 172.21.15.103:39056) 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de571e640 1 -- 172.21.15.103:0/1643572264 learned_addr learned my addr 172.21.15.103:0/1643572264 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de4f1d640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8004800 0x7f3de01522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3ddffff640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de014fa50 0x7f3de0072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.956+0000 7f3de571e640 1 -- 172.21.15.103:0/1643572264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8004800 msgr2=0x7f3de01522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3de571e640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8004800 0x7f3de01522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3de571e640 1 -- 172.21.15.103:0/1643572264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de014fa50 msgr2=0x7f3de0072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3de571e640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de014fa50 0x7f3de0072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3de571e640 1 -- 172.21.15.103:0/1643572264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de0151240 con 0x7f3de0073030 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3de571e640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de0073030 0x7f3de0152970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3de00ccf10 tx=0x7f3dd800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3ddd7fa640 1 -- 172.21.15.103:0/1643572264 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8019070 con 0x7f3de0073030 2024-08-18T23:57:12.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3ddd7fa640 1 -- 172.21.15.103:0/1643572264 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd8005030 con 0x7f3de0073030 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de0151520 con 0x7f3de0073030 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3ddd7fa640 1 -- 172.21.15.103:0/1643572264 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8005420 con 0x7f3de0073030 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.957+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de0151ae0 con 0x7f3de0073030 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.958+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de015e510 con 0x7f3de0073030 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.958+0000 7f3ddd7fa640 1 -- 172.21.15.103:0/1643572264 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3dd80067d0 con 0x7f3de0073030 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.959+0000 7f3ddd7fa640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3dcc06be60 0x7f3dcc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.959+0000 7f3de4f1d640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3dcc06be60 0x7f3dcc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.959+0000 7f3ddd7fa640 1 -- 172.21.15.103:0/1643572264 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3dd8089f20 con 0x7f3de0073030 2024-08-18T23:57:12.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.959+0000 7f3de4f1d640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3dcc06be60 0x7f3dcc06e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3de0150f60 tx=0x7f3dd0001d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:12.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:12.963+0000 7f3ddd7fa640 1 -- 172.21.15.103:0/1643572264 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3dd8057fd0 con 0x7f3de0073030 2024-08-18T23:57:13.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.163+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3de00b2880 con 0x7f3de0073030 2024-08-18T23:57:13.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.164+0000 7f3ddd7fa640 1 -- 172.21.15.103:0/1643572264 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5228 (secure 0 0 0) 0x7f3dd805c2d0 con 0x7f3de0073030 2024-08-18T23:57:13.166 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:13.166 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-18T23:57:12:833627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:57:12.157817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:13.166 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-18T23:57:13.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3dcc06be60 msgr2=0x7f3dcc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3dcc06be60 0x7f3dcc06e320 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3de0150f60 tx=0x7f3dd0001d70 comp rx=0 tx=0).stop 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de0073030 msgr2=0x7f3de0152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de0073030 0x7f3de0152970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3de00ccf10 tx=0x7f3dd800fc00 comp rx=0 tx=0).stop 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 shutdown_connections 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3dcc06be60 0x7f3dcc06e320 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3de0073030 0x7f3de0152970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3de014fa50 0x7f3de0072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 --2- 172.21.15.103:0/1643572264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3dc8004800 0x7f3de01522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 >> 172.21.15.103:0/1643572264 conn(0x7f3de00b2aa0 msgr2=0x7f3de0074c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 shutdown_connections 2024-08-18T23:57:13.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.166+0000 7f3de7181640 1 -- 172.21.15.103:0/1643572264 wait complete. 2024-08-18T23:57:13.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.277+0000 7fb8aac47640 1 Processor -- start 2024-08-18T23:57:13.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.277+0000 7fb8aac47640 1 -- start start 2024-08-18T23:57:13.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8aac47640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb8a415ade0 0x7fb8a406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8aac47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb8a40b4370 0x7fb8a406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8aac47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a40b47b0 0x7fb8a415e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8aac47640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a406db10 con 0x7fb8a415ade0 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8aac47640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb8a415b1c0 con 0x7fb8a40b4370 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8aac47640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a4072610 con 0x7fb8a40b47b0 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a89e3640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb8a415ade0 0x7fb8a406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a89e3640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb8a415ade0 0x7fb8a406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38114/0 (socket says 172.21.15.103:38114) 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a89e3640 1 -- 172.21.15.103:0/2257119498 learned_addr learned my addr 172.21.15.103:0/2257119498 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a3fff640 1 --2- 172.21.15.103:0/2257119498 >> v2:172.21.15.190:3300/0 conn(0x7fb8a40b4370 0x7fb8a406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a91e4640 1 --2- 172.21.15.103:0/2257119498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a40b47b0 0x7fb8a415e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a89e3640 1 -- 172.21.15.103:0/2257119498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a40b47b0 msgr2=0x7fb8a415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:13.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a89e3640 1 --2- 172.21.15.103:0/2257119498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a40b47b0 0x7fb8a415e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a89e3640 1 -- 172.21.15.103:0/2257119498 >> v2:172.21.15.190:3300/0 conn(0x7fb8a40b4370 msgr2=0x7fb8a406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a89e3640 1 --2- 172.21.15.103:0/2257119498 >> v2:172.21.15.190:3300/0 conn(0x7fb8a40b4370 0x7fb8a406f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.278+0000 7fb8a89e3640 1 -- 172.21.15.103:0/2257119498 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a40728f0 con 0x7fb8a415ade0 2024-08-18T23:57:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.279+0000 7fb8a89e3640 1 --2- 172.21.15.103:0/2257119498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a415ade0 0x7fb8a406f060 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40af1c0 tx=0x7fb89802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d968ceb97a181d9e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.279+0000 7fb8a37fe640 1 -- 172.21.15.103:0/2257119498 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898037070 con 0x7fb8a415ade0 2024-08-18T23:57:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.279+0000 7fb8a37fe640 1 -- 172.21.15.103:0/2257119498 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb898032440 con 0x7fb8a415ade0 2024-08-18T23:57:13.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.279+0000 7fb8a37fe640 1 -- 172.21.15.103:0/2257119498 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898032810 con 0x7fb8a415ade0 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 -- 172.21.15.103:0/2257119498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a415ade0 msgr2=0x7fb8a406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 --2- 172.21.15.103:0/2257119498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a415ade0 0x7fb8a406f060 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40af1c0 tx=0x7fb89802a140 comp rx=0 tx=0).stop 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 -- 172.21.15.103:0/2257119498 shutdown_connections 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 --2- 172.21.15.103:0/2257119498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a40b47b0 0x7fb8a415e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 --2- 172.21.15.103:0/2257119498 >> v2:172.21.15.190:3300/0 conn(0x7fb8a40b4370 0x7fb8a406f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 --2- 172.21.15.103:0/2257119498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a415ade0 0x7fb8a406f060 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 -- 172.21.15.103:0/2257119498 >> 172.21.15.103:0/2257119498 conn(0x7fb8a40cfc40 msgr2=0x7fb8a40d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 -- 172.21.15.103:0/2257119498 shutdown_connections 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.280+0000 7fb8aac47640 1 -- 172.21.15.103:0/2257119498 wait complete. 2024-08-18T23:57:13.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.281+0000 7fb8aac47640 1 Processor -- start 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.281+0000 7fb8aac47640 1 -- start start 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8aac47640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8a40b4370 0x7fb8a4152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8aac47640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a40b47b0 0x7fb8a41e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8aac47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a415ade0 0x7fb8a406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8aac47640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a406d6c0 con 0x7fb8a40b47b0 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8aac47640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a4072eb0 con 0x7fb8a40b4370 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8aac47640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a406d840 con 0x7fb8a415ade0 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a40b47b0 0x7fb8a41e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a40b47b0 0x7fb8a41e6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38122/0 (socket says 172.21.15.103:38122) 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a3fff640 1 -- 172.21.15.103:0/1847481253 learned_addr learned my addr 172.21.15.103:0/1847481253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a89e3640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8a40b4370 0x7fb8a4152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a91e4640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a415ade0 0x7fb8a406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a3fff640 1 -- 172.21.15.103:0/1847481253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a415ade0 msgr2=0x7fb8a406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a3fff640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a415ade0 0x7fb8a406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a3fff640 1 -- 172.21.15.103:0/1847481253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8a40b4370 msgr2=0x7fb8a4152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.282+0000 7fb8a3fff640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8a40b4370 0x7fb8a4152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.283+0000 7fb8a3fff640 1 -- 172.21.15.103:0/1847481253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a41e4ac0 con 0x7fb8a40b47b0 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.283+0000 7fb8a3fff640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a40b47b0 0x7fb8a41e6910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb89000d830 tx=0x7fb89000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.283+0000 7fb8a17fa640 1 -- 172.21.15.103:0/1847481253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890018030 con 0x7fb8a40b47b0 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.283+0000 7fb8a17fa640 1 -- 172.21.15.103:0/1847481253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89000be10 con 0x7fb8a40b47b0 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.283+0000 7fb8a17fa640 1 -- 172.21.15.103:0/1847481253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8900098b0 con 0x7fb8a40b47b0 2024-08-18T23:57:13.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.283+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a415d920 con 0x7fb8a40b47b0 2024-08-18T23:57:13.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.283+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a415dee0 con 0x7fb8a40b47b0 2024-08-18T23:57:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.284+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a40b15b0 con 0x7fb8a40b47b0 2024-08-18T23:57:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.285+0000 7fb8a17fa640 1 -- 172.21.15.103:0/1847481253 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb89001b070 con 0x7fb8a40b47b0 2024-08-18T23:57:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.285+0000 7fb8a17fa640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb88806be30 0x7fb88806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.285+0000 7fb8a17fa640 1 -- 172.21.15.103:0/1847481253 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb89008b250 con 0x7fb8a40b47b0 2024-08-18T23:57:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.285+0000 7fb8a89e3640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb88806be30 0x7fb88806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.285+0000 7fb8a89e3640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb88806be30 0x7fb88806e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb898034000 tx=0x7fb89802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.294+0000 7fb8a17fa640 1 -- 172.21.15.103:0/1847481253 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb890059280 con 0x7fb8a40b47b0 2024-08-18T23:57:13.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.466+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8a40b12d0 con 0x7fb8a40b47b0 2024-08-18T23:57:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.468+0000 7fb8a17fa640 1 -- 172.21.15.103:0/1847481253 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7fb89005d580 con 0x7fb8a40b47b0 2024-08-18T23:57:13.470 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:13.470 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb88806be30 msgr2=0x7fb88806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb88806be30 0x7fb88806e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb898034000 tx=0x7fb89802e000 comp rx=0 tx=0).stop 2024-08-18T23:57:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a40b47b0 msgr2=0x7fb8a41e6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a40b47b0 0x7fb8a41e6910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb89000d830 tx=0x7fb89000dcf0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 shutdown_connections 2024-08-18T23:57:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb88806be30 0x7fb88806e2f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb8a415ade0 0x7fb8a406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a40b47b0 0x7fb8a41e6910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 --2- 172.21.15.103:0/1847481253 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8a40b4370 0x7fb8a4152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 >> 172.21.15.103:0/1847481253 conn(0x7fb8a40cfc40 msgr2=0x7fb8a40b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 shutdown_connections 2024-08-18T23:57:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.471+0000 7fb8aac47640 1 -- 172.21.15.103:0/1847481253 wait complete. 2024-08-18T23:57:13.484 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T23:57:13.484 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:13.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.584+0000 7fdea0313640 1 Processor -- start 2024-08-18T23:57:13.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.584+0000 7fdea0313640 1 -- start start 2024-08-18T23:57:13.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fdea0313640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde980d4bc0 0x7fde980d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fdea0313640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde98160090 0x7fde98160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fdea0313640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde980d0860 con 0x7fde9815f8a0 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fdea0313640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fde980cfc00 con 0x7fde980d4bc0 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fdea0313640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fde980b32c0 con 0x7fde98160090 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9d8ae640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde980d4bc0 0x7fde980d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9d8ae640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde980d4bc0 0x7fde980d11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38132/0 (socket says 172.21.15.103:38132) 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9e0af640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fde9815f8a0 0x7fde980d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56390/0 (socket says 172.21.15.103:56390) 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9d8ae640 1 -- 172.21.15.103:0/2491898915 learned_addr learned my addr 172.21.15.103:0/2491898915 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9e8b0640 1 --2- 172.21.15.103:0/2491898915 >> v2:172.21.15.190:3300/0 conn(0x7fde98160090 0x7fde98160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9d8ae640 1 -- 172.21.15.103:0/2491898915 >> v2:172.21.15.190:3300/0 conn(0x7fde98160090 msgr2=0x7fde98160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9d8ae640 1 --2- 172.21.15.103:0/2491898915 >> v2:172.21.15.190:3300/0 conn(0x7fde98160090 0x7fde98160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9d8ae640 1 -- 172.21.15.103:0/2491898915 >> v1:172.21.15.103:6789/0 conn(0x7fde9815f8a0 legacy=0x7fde980d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9d0ad640 1 -- 172.21.15.103:0/2491898915 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198868446 0 0) 0x7fde980d0860 con 0x7fde9815f8a0 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.585+0000 7fde9d8ae640 1 -- 172.21.15.103:0/2491898915 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde980d0090 con 0x7fde980d4bc0 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.586+0000 7fde9d8ae640 1 --2- 172.21.15.103:0/2491898915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde980d4bc0 0x7fde980d11c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fde980b5b40 tx=0x7fde8802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea4f4d724fa226a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.586+0000 7fde9d0ad640 1 -- 172.21.15.103:0/2491898915 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88037070 con 0x7fde980d4bc0 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.586+0000 7fde9d0ad640 1 -- 172.21.15.103:0/2491898915 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde88032440 con 0x7fde980d4bc0 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.586+0000 7fde9d0ad640 1 -- 172.21.15.103:0/2491898915 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88032810 con 0x7fde980d4bc0 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.587+0000 7fdea0313640 1 -- 172.21.15.103:0/2491898915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde980d4bc0 msgr2=0x7fde980d11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.587+0000 7fdea0313640 1 --2- 172.21.15.103:0/2491898915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde980d4bc0 0x7fde980d11c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fde980b5b40 tx=0x7fde8802a270 comp rx=0 tx=0).stop 2024-08-18T23:57:13.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.587+0000 7fdea0313640 1 -- 172.21.15.103:0/2491898915 shutdown_connections 2024-08-18T23:57:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.587+0000 7fdea0313640 1 --2- 172.21.15.103:0/2491898915 >> v2:172.21.15.190:3300/0 conn(0x7fde98160090 0x7fde98160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.587+0000 7fdea0313640 1 --2- 172.21.15.103:0/2491898915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde980d4bc0 0x7fde980d11c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.587+0000 7fdea0313640 1 -- 172.21.15.103:0/2491898915 >> 172.21.15.103:0/2491898915 conn(0x7fde980d40a0 msgr2=0x7fde980d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.587+0000 7fdea0313640 1 -- 172.21.15.103:0/2491898915 shutdown_connections 2024-08-18T23:57:13.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.587+0000 7fdea0313640 1 -- 172.21.15.103:0/2491898915 wait complete. 2024-08-18T23:57:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.588+0000 7fdea0313640 1 Processor -- start 2024-08-18T23:57:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.588+0000 7fdea0313640 1 -- start start 2024-08-18T23:57:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fdea0313640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde980d4bc0 0x7fde981540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fdea0313640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde9815f8a0 0x7fde980c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fdea0313640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde98160090 0x7fde980c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fdea0313640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde980b2fb0 con 0x7fde98160090 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fdea0313640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fde980cf890 con 0x7fde980d4bc0 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fdea0313640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fde9815fc80 con 0x7fde9815f8a0 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e8b0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde98160090 0x7fde980c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e8b0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde98160090 0x7fde980c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38136/0 (socket says 172.21.15.103:38136) 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e8b0640 1 -- 172.21.15.103:0/4225290490 learned_addr learned my addr 172.21.15.103:0/4225290490 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e0af640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde980d4bc0 0x7fde981540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9d8ae640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde9815f8a0 0x7fde980c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e8b0640 1 -- 172.21.15.103:0/4225290490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde9815f8a0 msgr2=0x7fde980c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e8b0640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde9815f8a0 0x7fde980c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e8b0640 1 -- 172.21.15.103:0/4225290490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde980d4bc0 msgr2=0x7fde981540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e8b0640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde980d4bc0 0x7fde981540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.589+0000 7fde9e8b0640 1 -- 172.21.15.103:0/4225290490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde98154630 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.590+0000 7fde9e8b0640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde98160090 0x7fde980c8400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fde90007e70 tx=0x7fde9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.590+0000 7fde8effd640 1 -- 172.21.15.103:0/4225290490 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90014620 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.590+0000 7fde8effd640 1 -- 172.21.15.103:0/4225290490 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde90019070 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.590+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde980ca290 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.590+0000 7fde8effd640 1 -- 172.21.15.103:0/4225290490 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde90014a20 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.590+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde980ca850 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.591+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde98160520 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.591+0000 7fde8effd640 1 -- 172.21.15.103:0/4225290490 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde90014bc0 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.592+0000 7fde8effd640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde7c06be30 0x7fde7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.592+0000 7fde8effd640 1 -- 172.21.15.103:0/4225290490 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fde9008b890 con 0x7fde98160090 2024-08-18T23:57:13.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.592+0000 7fde9e0af640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde7c06be30 0x7fde7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.592+0000 7fde9e0af640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde7c06be30 0x7fde7c06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde94000f60 tx=0x7fde94007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.597+0000 7fde8effd640 1 -- 172.21.15.103:0/4225290490 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fde90059940 con 0x7fde98160090 2024-08-18T23:57:13.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.768+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde9815c710 con 0x7fde7c06be30 2024-08-18T23:57:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.784+0000 7fde8effd640 1 -- 172.21.15.103:0/4225290490 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fde9815c710 con 0x7fde7c06be30 2024-08-18T23:57:13.789 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:13.790 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:13.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde7c06be30 msgr2=0x7fde7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde7c06be30 0x7fde7c06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde94000f60 tx=0x7fde94007d50 comp rx=0 tx=0).stop 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde98160090 msgr2=0x7fde980c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde98160090 0x7fde980c8400 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fde90007e70 tx=0x7fde9000e4b0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 shutdown_connections 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde7c06be30 0x7fde7c06e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde98160090 0x7fde980c8400 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde9815f8a0 0x7fde980c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 --2- 172.21.15.103:0/4225290490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde980d4bc0 0x7fde981540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 >> 172.21.15.103:0/4225290490 conn(0x7fde980d40a0 msgr2=0x7fde9815b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 shutdown_connections 2024-08-18T23:57:13.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.787+0000 7fdea0313640 1 -- 172.21.15.103:0/4225290490 wait complete. 2024-08-18T23:57:13.800 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-08-18T23:57:12.168336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003338"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796132+0000","last_change":"2024-08-18T23:56:52.756091+0000","last_active":"2024-08-18T23:56:58.796132+0000","last_peered":"2024-08-18T23:56:58.796132+0000","last_clean":"2024-08-18T23:56:58.796132+0000","last_became_active":"2024-08-18T23:56:52.755823+0000","last_became_peered":"2024-08-18T23:56:52.755823+0000","last_unstale":"2024-08-18T23:56:58.796132+0000","last_undegraded":"2024-08-18T23:56:58.796132+0000","last_fullsized":"2024-08-18T23:56:58.796132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:10:48.081149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145741+0000","last_change":"2024-08-18T23:56:53.755660+0000","last_active":"2024-08-18T23:56:59.145741+0000","last_peered":"2024-08-18T23:56:59.145741+0000","last_clean":"2024-08-18T23:56:59.145741+0000","last_became_active":"2024-08-18T23:56:53.755395+0000","last_became_peered":"2024-08-18T23:56:53.755395+0000","last_unstale":"2024-08-18T23:56:59.145741+0000","last_undegraded":"2024-08-18T23:56:59.145741+0000","last_fullsized":"2024-08-18T23:56:59.145741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:24.430755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144804+0000","last_change":"2024-08-18T23:56:57.985729+0000","last_active":"2024-08-18T23:56:59.144804+0000","last_peered":"2024-08-18T23:56:59.144804+0000","last_clean":"2024-08-18T23:56:59.144804+0000","last_became_active":"2024-08-18T23:56:57.985390+0000","last_became_peered":"2024-08-18T23:56:57.985390+0000","last_unstale":"2024-08-18T23:56:59.144804+0000","last_undegraded":"2024-08-18T23:56:59.144804+0000","last_fullsized":"2024-08-18T23:56:59.144804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:47.865044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145904+0000","last_change":"2024-08-18T23:56:52.757392+0000","last_active":"2024-08-18T23:56:59.145904+0000","last_peered":"2024-08-18T23:56:59.145904+0000","last_clean":"2024-08-18T23:56:59.145904+0000","last_became_active":"2024-08-18T23:56:52.757111+0000","last_became_peered":"2024-08-18T23:56:52.757111+0000","last_unstale":"2024-08-18T23:56:59.145904+0000","last_undegraded":"2024-08-18T23:56:59.145904+0000","last_fullsized":"2024-08-18T23:56:59.145904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795884+0000","last_change":"2024-08-18T23:56:53.773415+0000","last_active":"2024-08-18T23:56:58.795884+0000","last_peered":"2024-08-18T23:56:58.795884+0000","last_clean":"2024-08-18T23:56:58.795884+0000","last_became_active":"2024-08-18T23:56:53.769428+0000","last_became_peered":"2024-08-18T23:56:53.769428+0000","last_unstale":"2024-08-18T23:56:58.795884+0000","last_undegraded":"2024-08-18T23:56:58.795884+0000","last_fullsized":"2024-08-18T23:56:58.795884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145415+0000","last_change":"2024-08-18T23:56:57.796039+0000","last_active":"2024-08-18T23:56:59.145415+0000","last_peered":"2024-08-18T23:56:59.145415+0000","last_clean":"2024-08-18T23:56:59.145415+0000","last_became_active":"2024-08-18T23:56:57.795504+0000","last_became_peered":"2024-08-18T23:56:57.795504+0000","last_unstale":"2024-08-18T23:56:59.145415+0000","last_undegraded":"2024-08-18T23:56:59.145415+0000","last_fullsized":"2024-08-18T23:56:59.145415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:45.045215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146785+0000","last_change":"2024-08-18T23:56:52.758482+0000","last_active":"2024-08-18T23:56:59.146785+0000","last_peered":"2024-08-18T23:56:59.146785+0000","last_clean":"2024-08-18T23:56:59.146785+0000","last_became_active":"2024-08-18T23:56:52.758194+0000","last_became_peered":"2024-08-18T23:56:52.758194+0000","last_unstale":"2024-08-18T23:56:59.146785+0000","last_undegraded":"2024-08-18T23:56:59.146785+0000","last_fullsized":"2024-08-18T23:56:59.146785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:34.443678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147481+0000","last_change":"2024-08-18T23:56:53.769569+0000","last_active":"2024-08-18T23:56:59.147481+0000","last_peered":"2024-08-18T23:56:59.147481+0000","last_clean":"2024-08-18T23:56:59.147481+0000","last_became_active":"2024-08-18T23:56:53.769304+0000","last_became_peered":"2024-08-18T23:56:53.769304+0000","last_unstale":"2024-08-18T23:56:59.147481+0000","last_undegraded":"2024-08-18T23:56:59.147481+0000","last_fullsized":"2024-08-18T23:56:59.147481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:24.430755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145660+0000","last_change":"2024-08-18T23:56:57.804268+0000","last_active":"2024-08-18T23:56:59.145660+0000","last_peered":"2024-08-18T23:56:59.145660+0000","last_clean":"2024-08-18T23:56:59.145660+0000","last_became_active":"2024-08-18T23:56:57.803915+0000","last_became_peered":"2024-08-18T23:56:57.803915+0000","last_unstale":"2024-08-18T23:56:59.145660+0000","last_undegraded":"2024-08-18T23:56:59.145660+0000","last_fullsized":"2024-08-18T23:56:59.145660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:26.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146148+0000","last_change":"2024-08-18T23:56:52.758724+0000","last_active":"2024-08-18T23:56:59.146148+0000","last_peered":"2024-08-18T23:56:59.146148+0000","last_clean":"2024-08-18T23:56:59.146148+0000","last_became_active":"2024-08-18T23:56:52.758420+0000","last_became_peered":"2024-08-18T23:56:52.758420+0000","last_unstale":"2024-08-18T23:56:59.146148+0000","last_undegraded":"2024-08-18T23:56:59.146148+0000","last_fullsized":"2024-08-18T23:56:59.146148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:11.818210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147721+0000","last_change":"2024-08-18T23:56:53.769922+0000","last_active":"2024-08-18T23:56:59.147721+0000","last_peered":"2024-08-18T23:56:59.147721+0000","last_clean":"2024-08-18T23:56:59.147721+0000","last_became_active":"2024-08-18T23:56:53.769638+0000","last_became_peered":"2024-08-18T23:56:53.769638+0000","last_unstale":"2024-08-18T23:56:59.147721+0000","last_undegraded":"2024-08-18T23:56:59.147721+0000","last_fullsized":"2024-08-18T23:56:59.147721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:38.459488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145653+0000","last_change":"2024-08-18T23:56:57.794111+0000","last_active":"2024-08-18T23:56:59.145653+0000","last_peered":"2024-08-18T23:56:59.145653+0000","last_clean":"2024-08-18T23:56:59.145653+0000","last_became_active":"2024-08-18T23:56:57.793673+0000","last_became_peered":"2024-08-18T23:56:57.793673+0000","last_unstale":"2024-08-18T23:56:59.145653+0000","last_undegraded":"2024-08-18T23:56:59.145653+0000","last_fullsized":"2024-08-18T23:56:59.145653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:03.077928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793609+0000","last_change":"2024-08-18T23:56:53.766114+0000","last_active":"2024-08-18T23:56:58.793609+0000","last_peered":"2024-08-18T23:56:58.793609+0000","last_clean":"2024-08-18T23:56:58.793609+0000","last_became_active":"2024-08-18T23:56:53.765850+0000","last_became_peered":"2024-08-18T23:56:53.765850+0000","last_unstale":"2024-08-18T23:56:58.793609+0000","last_undegraded":"2024-08-18T23:56:58.793609+0000","last_fullsized":"2024-08-18T23:56:58.793609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147028+0000","last_change":"2024-08-18T23:56:52.759173+0000","last_active":"2024-08-18T23:56:59.147028+0000","last_peered":"2024-08-18T23:56:59.147028+0000","last_clean":"2024-08-18T23:56:59.147028+0000","last_became_active":"2024-08-18T23:56:52.758044+0000","last_became_peered":"2024-08-18T23:56:52.758044+0000","last_unstale":"2024-08-18T23:56:59.147028+0000","last_undegraded":"2024-08-18T23:56:59.147028+0000","last_fullsized":"2024-08-18T23:56:59.147028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:54.977859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147008+0000","last_change":"2024-08-18T23:56:57.804321+0000","last_active":"2024-08-18T23:56:59.147008+0000","last_peered":"2024-08-18T23:56:59.147008+0000","last_clean":"2024-08-18T23:56:59.147008+0000","last_became_active":"2024-08-18T23:56:57.803852+0000","last_became_peered":"2024-08-18T23:56:57.803852+0000","last_unstale":"2024-08-18T23:56:59.147008+0000","last_undegraded":"2024-08-18T23:56:59.147008+0000","last_fullsized":"2024-08-18T23:56:59.147008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145007+0000","last_change":"2024-08-18T23:56:53.768638+0000","last_active":"2024-08-18T23:56:59.145007+0000","last_peered":"2024-08-18T23:56:59.145007+0000","last_clean":"2024-08-18T23:56:59.145007+0000","last_became_active":"2024-08-18T23:56:53.768163+0000","last_became_peered":"2024-08-18T23:56:53.768163+0000","last_unstale":"2024-08-18T23:56:59.145007+0000","last_undegraded":"2024-08-18T23:56:59.145007+0000","last_fullsized":"2024-08-18T23:56:59.145007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:22.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146062+0000","last_change":"2024-08-18T23:56:52.752900+0000","last_active":"2024-08-18T23:56:59.146062+0000","last_peered":"2024-08-18T23:56:59.146062+0000","last_clean":"2024-08-18T23:56:59.146062+0000","last_became_active":"2024-08-18T23:56:52.752616+0000","last_became_peered":"2024-08-18T23:56:52.752616+0000","last_unstale":"2024-08-18T23:56:59.146062+0000","last_undegraded":"2024-08-18T23:56:59.146062+0000","last_fullsized":"2024-08-18T23:56:59.146062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146712+0000","last_change":"2024-08-18T23:56:57.795841+0000","last_active":"2024-08-18T23:56:59.146712+0000","last_peered":"2024-08-18T23:56:59.146712+0000","last_clean":"2024-08-18T23:56:59.146712+0000","last_became_active":"2024-08-18T23:56:57.795354+0000","last_became_peered":"2024-08-18T23:56:57.795354+0000","last_unstale":"2024-08-18T23:56:59.146712+0000","last_undegraded":"2024-08-18T23:56:59.146712+0000","last_fullsized":"2024-08-18T23:56:59.146712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:53.536907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145239+0000","last_change":"2024-08-18T23:56:53.771090+0000","last_active":"2024-08-18T23:56:59.145239+0000","last_peered":"2024-08-18T23:56:59.145239+0000","last_clean":"2024-08-18T23:56:59.145239+0000","last_became_active":"2024-08-18T23:56:53.770808+0000","last_became_peered":"2024-08-18T23:56:53.770808+0000","last_unstale":"2024-08-18T23:56:59.145239+0000","last_undegraded":"2024-08-18T23:56:59.145239+0000","last_fullsized":"2024-08-18T23:56:59.145239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145853+0000","last_change":"2024-08-18T23:56:52.754196+0000","last_active":"2024-08-18T23:56:59.145853+0000","last_peered":"2024-08-18T23:56:59.145853+0000","last_clean":"2024-08-18T23:56:59.145853+0000","last_became_active":"2024-08-18T23:56:52.753897+0000","last_became_peered":"2024-08-18T23:56:52.753897+0000","last_unstale":"2024-08-18T23:56:59.145853+0000","last_undegraded":"2024-08-18T23:56:59.145853+0000","last_fullsized":"2024-08-18T23:56:59.145853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:33:22.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145815+0000","last_change":"2024-08-18T23:56:57.981814+0000","last_active":"2024-08-18T23:56:59.145815+0000","last_peered":"2024-08-18T23:56:59.145815+0000","last_clean":"2024-08-18T23:56:59.145815+0000","last_became_active":"2024-08-18T23:56:57.981431+0000","last_became_peered":"2024-08-18T23:56:57.981431+0000","last_unstale":"2024-08-18T23:56:59.145815+0000","last_undegraded":"2024-08-18T23:56:59.145815+0000","last_fullsized":"2024-08-18T23:56:59.145815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145805+0000","last_change":"2024-08-18T23:56:53.767404+0000","last_active":"2024-08-18T23:56:59.145805+0000","last_peered":"2024-08-18T23:56:59.145805+0000","last_clean":"2024-08-18T23:56:59.145805+0000","last_became_active":"2024-08-18T23:56:53.764501+0000","last_became_peered":"2024-08-18T23:56:53.764501+0000","last_unstale":"2024-08-18T23:56:59.145805+0000","last_undegraded":"2024-08-18T23:56:59.145805+0000","last_fullsized":"2024-08-18T23:56:59.145805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:37.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147087+0000","last_change":"2024-08-18T23:56:52.759789+0000","last_active":"2024-08-18T23:56:59.147087+0000","last_peered":"2024-08-18T23:56:59.147087+0000","last_clean":"2024-08-18T23:56:59.147087+0000","last_became_active":"2024-08-18T23:56:52.758829+0000","last_became_peered":"2024-08-18T23:56:52.758829+0000","last_unstale":"2024-08-18T23:56:59.147087+0000","last_undegraded":"2024-08-18T23:56:59.147087+0000","last_fullsized":"2024-08-18T23:56:59.147087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:30.187935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146272+0000","last_change":"2024-08-18T23:56:57.801849+0000","last_active":"2024-08-18T23:56:59.146272+0000","last_peered":"2024-08-18T23:56:59.146272+0000","last_clean":"2024-08-18T23:56:59.146272+0000","last_became_active":"2024-08-18T23:56:57.801424+0000","last_became_peered":"2024-08-18T23:56:57.801424+0000","last_unstale":"2024-08-18T23:56:59.146272+0000","last_undegraded":"2024-08-18T23:56:59.146272+0000","last_fullsized":"2024-08-18T23:56:59.146272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:28.469431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796181+0000","last_change":"2024-08-18T23:56:53.769056+0000","last_active":"2024-08-18T23:56:58.796181+0000","last_peered":"2024-08-18T23:56:58.796181+0000","last_clean":"2024-08-18T23:56:58.796181+0000","last_became_active":"2024-08-18T23:56:53.768321+0000","last_became_peered":"2024-08-18T23:56:53.768321+0000","last_unstale":"2024-08-18T23:56:58.796181+0000","last_undegraded":"2024-08-18T23:56:58.796181+0000","last_fullsized":"2024-08-18T23:56:58.796181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794222+0000","last_change":"2024-08-18T23:56:52.755465+0000","last_active":"2024-08-18T23:56:58.794222+0000","last_peered":"2024-08-18T23:56:58.794222+0000","last_clean":"2024-08-18T23:56:58.794222+0000","last_became_active":"2024-08-18T23:56:52.755229+0000","last_became_peered":"2024-08-18T23:56:52.755229+0000","last_unstale":"2024-08-18T23:56:58.794222+0000","last_undegraded":"2024-08-18T23:56:58.794222+0000","last_fullsized":"2024-08-18T23:56:58.794222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145628+0000","last_change":"2024-08-18T23:56:57.986350+0000","last_active":"2024-08-18T23:56:59.145628+0000","last_peered":"2024-08-18T23:56:59.145628+0000","last_clean":"2024-08-18T23:56:59.145628+0000","last_became_active":"2024-08-18T23:56:57.985425+0000","last_became_peered":"2024-08-18T23:56:57.985425+0000","last_unstale":"2024-08-18T23:56:59.145628+0000","last_undegraded":"2024-08-18T23:56:59.145628+0000","last_fullsized":"2024-08-18T23:56:59.145628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:21.592416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145448+0000","last_change":"2024-08-18T23:56:53.768554+0000","last_active":"2024-08-18T23:56:59.145448+0000","last_peered":"2024-08-18T23:56:59.145448+0000","last_clean":"2024-08-18T23:56:59.145448+0000","last_became_active":"2024-08-18T23:56:53.767502+0000","last_became_peered":"2024-08-18T23:56:53.767502+0000","last_unstale":"2024-08-18T23:56:59.145448+0000","last_undegraded":"2024-08-18T23:56:59.145448+0000","last_fullsized":"2024-08-18T23:56:59.145448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145919+0000","last_change":"2024-08-18T23:56:52.742342+0000","last_active":"2024-08-18T23:56:59.145919+0000","last_peered":"2024-08-18T23:56:59.145919+0000","last_clean":"2024-08-18T23:56:59.145919+0000","last_became_active":"2024-08-18T23:56:52.741958+0000","last_became_peered":"2024-08-18T23:56:52.741958+0000","last_unstale":"2024-08-18T23:56:59.145919+0000","last_undegraded":"2024-08-18T23:56:59.145919+0000","last_fullsized":"2024-08-18T23:56:59.145919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144744+0000","last_change":"2024-08-18T23:56:57.982697+0000","last_active":"2024-08-18T23:56:59.144744+0000","last_peered":"2024-08-18T23:56:59.144744+0000","last_clean":"2024-08-18T23:56:59.144744+0000","last_became_active":"2024-08-18T23:56:57.981397+0000","last_became_peered":"2024-08-18T23:56:57.981397+0000","last_unstale":"2024-08-18T23:56:59.144744+0000","last_undegraded":"2024-08-18T23:56:59.144744+0000","last_fullsized":"2024-08-18T23:56:59.144744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:04.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145536+0000","last_change":"2024-08-18T23:56:53.764548+0000","last_active":"2024-08-18T23:56:59.145536+0000","last_peered":"2024-08-18T23:56:59.145536+0000","last_clean":"2024-08-18T23:56:59.145536+0000","last_became_active":"2024-08-18T23:56:53.764280+0000","last_became_peered":"2024-08-18T23:56:53.764280+0000","last_unstale":"2024-08-18T23:56:59.145536+0000","last_undegraded":"2024-08-18T23:56:59.145536+0000","last_fullsized":"2024-08-18T23:56:59.145536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147248+0000","last_change":"2024-08-18T23:56:52.759045+0000","last_active":"2024-08-18T23:56:59.147248+0000","last_peered":"2024-08-18T23:56:59.147248+0000","last_clean":"2024-08-18T23:56:59.147248+0000","last_became_active":"2024-08-18T23:56:52.758744+0000","last_became_peered":"2024-08-18T23:56:52.758744+0000","last_unstale":"2024-08-18T23:56:59.147248+0000","last_undegraded":"2024-08-18T23:56:59.147248+0000","last_fullsized":"2024-08-18T23:56:59.147248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:56.808416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795776+0000","last_change":"2024-08-18T23:56:57.984133+0000","last_active":"2024-08-18T23:56:58.795776+0000","last_peered":"2024-08-18T23:56:58.795776+0000","last_clean":"2024-08-18T23:56:58.795776+0000","last_became_active":"2024-08-18T23:56:57.983723+0000","last_became_peered":"2024-08-18T23:56:57.983723+0000","last_unstale":"2024-08-18T23:56:58.795776+0000","last_undegraded":"2024-08-18T23:56:58.795776+0000","last_fullsized":"2024-08-18T23:56:58.795776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147781+0000","last_change":"2024-08-18T23:56:53.771404+0000","last_active":"2024-08-18T23:56:59.147781+0000","last_peered":"2024-08-18T23:56:59.147781+0000","last_clean":"2024-08-18T23:56:59.147781+0000","last_became_active":"2024-08-18T23:56:53.771115+0000","last_became_peered":"2024-08-18T23:56:53.771115+0000","last_unstale":"2024-08-18T23:56:59.147781+0000","last_undegraded":"2024-08-18T23:56:59.147781+0000","last_fullsized":"2024-08-18T23:56:59.147781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:31.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145623+0000","last_change":"2024-08-18T23:56:52.755938+0000","last_active":"2024-08-18T23:56:59.145623+0000","last_peered":"2024-08-18T23:56:59.145623+0000","last_clean":"2024-08-18T23:56:59.145623+0000","last_became_active":"2024-08-18T23:56:52.755665+0000","last_became_peered":"2024-08-18T23:56:52.755665+0000","last_unstale":"2024-08-18T23:56:59.145623+0000","last_undegraded":"2024-08-18T23:56:59.145623+0000","last_fullsized":"2024-08-18T23:56:59.145623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:54.232884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145948+0000","last_change":"2024-08-18T23:56:57.800426+0000","last_active":"2024-08-18T23:56:59.145948+0000","last_peered":"2024-08-18T23:56:59.145948+0000","last_clean":"2024-08-18T23:56:59.145948+0000","last_became_active":"2024-08-18T23:56:57.800074+0000","last_became_peered":"2024-08-18T23:56:57.800074+0000","last_unstale":"2024-08-18T23:56:59.145948+0000","last_undegraded":"2024-08-18T23:56:59.145948+0000","last_fullsized":"2024-08-18T23:56:59.145948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:36.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146563+0000","last_change":"2024-08-18T23:56:53.766348+0000","last_active":"2024-08-18T23:56:59.146563+0000","last_peered":"2024-08-18T23:56:59.146563+0000","last_clean":"2024-08-18T23:56:59.146563+0000","last_became_active":"2024-08-18T23:56:53.765359+0000","last_became_peered":"2024-08-18T23:56:53.765359+0000","last_unstale":"2024-08-18T23:56:59.146563+0000","last_undegraded":"2024-08-18T23:56:59.146563+0000","last_fullsized":"2024-08-18T23:56:59.146563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:33:23.061905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147639+0000","last_change":"2024-08-18T23:56:52.753019+0000","last_active":"2024-08-18T23:56:59.147639+0000","last_peered":"2024-08-18T23:56:59.147639+0000","last_clean":"2024-08-18T23:56:59.147639+0000","last_became_active":"2024-08-18T23:56:52.752740+0000","last_became_peered":"2024-08-18T23:56:52.752740+0000","last_unstale":"2024-08-18T23:56:59.147639+0000","last_undegraded":"2024-08-18T23:56:59.147639+0000","last_fullsized":"2024-08-18T23:56:59.147639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145300+0000","last_change":"2024-08-18T23:56:57.798746+0000","last_active":"2024-08-18T23:56:59.145300+0000","last_peered":"2024-08-18T23:56:59.145300+0000","last_clean":"2024-08-18T23:56:59.145300+0000","last_became_active":"2024-08-18T23:56:57.798335+0000","last_became_peered":"2024-08-18T23:56:57.798335+0000","last_unstale":"2024-08-18T23:56:59.145300+0000","last_undegraded":"2024-08-18T23:56:59.145300+0000","last_fullsized":"2024-08-18T23:56:59.145300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145775+0000","last_change":"2024-08-18T23:56:53.761896+0000","last_active":"2024-08-18T23:56:59.145775+0000","last_peered":"2024-08-18T23:56:59.145775+0000","last_clean":"2024-08-18T23:56:59.145775+0000","last_became_active":"2024-08-18T23:56:53.761638+0000","last_became_peered":"2024-08-18T23:56:53.761638+0000","last_unstale":"2024-08-18T23:56:59.145775+0000","last_undegraded":"2024-08-18T23:56:59.145775+0000","last_fullsized":"2024-08-18T23:56:59.145775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794282+0000","last_change":"2024-08-18T23:56:52.761057+0000","last_active":"2024-08-18T23:56:58.794282+0000","last_peered":"2024-08-18T23:56:58.794282+0000","last_clean":"2024-08-18T23:56:58.794282+0000","last_became_active":"2024-08-18T23:56:52.760813+0000","last_became_peered":"2024-08-18T23:56:52.760813+0000","last_unstale":"2024-08-18T23:56:58.794282+0000","last_undegraded":"2024-08-18T23:56:58.794282+0000","last_fullsized":"2024-08-18T23:56:58.794282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145978+0000","last_change":"2024-08-18T23:56:57.799531+0000","last_active":"2024-08-18T23:56:59.145978+0000","last_peered":"2024-08-18T23:56:59.145978+0000","last_clean":"2024-08-18T23:56:59.145978+0000","last_became_active":"2024-08-18T23:56:57.798589+0000","last_became_peered":"2024-08-18T23:56:57.798589+0000","last_unstale":"2024-08-18T23:56:59.145978+0000","last_undegraded":"2024-08-18T23:56:59.145978+0000","last_fullsized":"2024-08-18T23:56:59.145978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:57.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795376+0000","last_change":"2024-08-18T23:56:53.773751+0000","last_active":"2024-08-18T23:56:58.795376+0000","last_peered":"2024-08-18T23:56:58.795376+0000","last_clean":"2024-08-18T23:56:58.795376+0000","last_became_active":"2024-08-18T23:56:53.769340+0000","last_became_peered":"2024-08-18T23:56:53.769340+0000","last_unstale":"2024-08-18T23:56:58.795376+0000","last_undegraded":"2024-08-18T23:56:58.795376+0000","last_fullsized":"2024-08-18T23:56:58.795376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:54.085641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147163+0000","last_change":"2024-08-18T23:56:52.759398+0000","last_active":"2024-08-18T23:56:59.147163+0000","last_peered":"2024-08-18T23:56:59.147163+0000","last_clean":"2024-08-18T23:56:59.147163+0000","last_became_active":"2024-08-18T23:56:52.758246+0000","last_became_peered":"2024-08-18T23:56:52.758246+0000","last_unstale":"2024-08-18T23:56:59.147163+0000","last_undegraded":"2024-08-18T23:56:59.147163+0000","last_fullsized":"2024-08-18T23:56:59.147163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:53.080654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796092+0000","last_change":"2024-08-18T23:56:57.985422+0000","last_active":"2024-08-18T23:56:58.796092+0000","last_peered":"2024-08-18T23:56:58.796092+0000","last_clean":"2024-08-18T23:56:58.796092+0000","last_became_active":"2024-08-18T23:56:57.984963+0000","last_became_peered":"2024-08-18T23:56:57.984963+0000","last_unstale":"2024-08-18T23:56:58.796092+0000","last_undegraded":"2024-08-18T23:56:58.796092+0000","last_fullsized":"2024-08-18T23:56:58.796092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.275461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144943+0000","last_change":"2024-08-18T23:56:53.766829+0000","last_active":"2024-08-18T23:56:59.144943+0000","last_peered":"2024-08-18T23:56:59.144943+0000","last_clean":"2024-08-18T23:56:59.144943+0000","last_became_active":"2024-08-18T23:56:53.766585+0000","last_became_peered":"2024-08-18T23:56:53.766585+0000","last_unstale":"2024-08-18T23:56:59.144943+0000","last_undegraded":"2024-08-18T23:56:59.144943+0000","last_fullsized":"2024-08-18T23:56:59.144943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146162+0000","last_change":"2024-08-18T23:56:52.749395+0000","last_active":"2024-08-18T23:56:59.146162+0000","last_peered":"2024-08-18T23:56:59.146162+0000","last_clean":"2024-08-18T23:56:59.146162+0000","last_became_active":"2024-08-18T23:56:52.749089+0000","last_became_peered":"2024-08-18T23:56:52.749089+0000","last_unstale":"2024-08-18T23:56:59.146162+0000","last_undegraded":"2024-08-18T23:56:59.146162+0000","last_fullsized":"2024-08-18T23:56:59.146162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147280+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:56:59.147280+0000","last_peered":"2024-08-18T23:56:59.147280+0000","last_clean":"2024-08-18T23:56:59.147280+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:56:59.147280+0000","last_undegraded":"2024-08-18T23:56:59.147280+0000","last_fullsized":"2024-08-18T23:56:59.147280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793760+0000","last_change":"2024-08-18T23:56:57.985242+0000","last_active":"2024-08-18T23:56:58.793760+0000","last_peered":"2024-08-18T23:56:58.793760+0000","last_clean":"2024-08-18T23:56:58.793760+0000","last_became_active":"2024-08-18T23:56:57.984868+0000","last_became_peered":"2024-08-18T23:56:57.984868+0000","last_unstale":"2024-08-18T23:56:58.793760+0000","last_undegraded":"2024-08-18T23:56:58.793760+0000","last_fullsized":"2024-08-18T23:56:58.793760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146556+0000","last_change":"2024-08-18T23:56:53.770252+0000","last_active":"2024-08-18T23:56:59.146556+0000","last_peered":"2024-08-18T23:56:59.146556+0000","last_clean":"2024-08-18T23:56:59.146556+0000","last_became_active":"2024-08-18T23:56:53.769985+0000","last_became_peered":"2024-08-18T23:56:53.769985+0000","last_unstale":"2024-08-18T23:56:59.146556+0000","last_undegraded":"2024-08-18T23:56:59.146556+0000","last_fullsized":"2024-08-18T23:56:59.146556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:53.459015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794847+0000","last_change":"2024-08-18T23:56:52.753918+0000","last_active":"2024-08-18T23:56:58.794847+0000","last_peered":"2024-08-18T23:56:58.794847+0000","last_clean":"2024-08-18T23:56:58.794847+0000","last_became_active":"2024-08-18T23:56:52.753634+0000","last_became_peered":"2024-08-18T23:56:52.753634+0000","last_unstale":"2024-08-18T23:56:58.794847+0000","last_undegraded":"2024-08-18T23:56:58.794847+0000","last_fullsized":"2024-08-18T23:56:58.794847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793607+0000","last_change":"2024-08-18T23:56:57.981987+0000","last_active":"2024-08-18T23:56:58.793607+0000","last_peered":"2024-08-18T23:56:58.793607+0000","last_clean":"2024-08-18T23:56:58.793607+0000","last_became_active":"2024-08-18T23:56:57.981487+0000","last_became_peered":"2024-08-18T23:56:57.981487+0000","last_unstale":"2024-08-18T23:56:58.793607+0000","last_undegraded":"2024-08-18T23:56:58.793607+0000","last_fullsized":"2024-08-18T23:56:58.793607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147493+0000","last_change":"2024-08-18T23:56:53.775056+0000","last_active":"2024-08-18T23:56:59.147493+0000","last_peered":"2024-08-18T23:56:59.147493+0000","last_clean":"2024-08-18T23:56:59.147493+0000","last_became_active":"2024-08-18T23:56:53.772898+0000","last_became_peered":"2024-08-18T23:56:53.772898+0000","last_unstale":"2024-08-18T23:56:59.147493+0000","last_undegraded":"2024-08-18T23:56:59.147493+0000","last_fullsized":"2024-08-18T23:56:59.147493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145727+0000","last_change":"2024-08-18T23:56:52.753178+0000","last_active":"2024-08-18T23:56:59.145727+0000","last_peered":"2024-08-18T23:56:59.145727+0000","last_clean":"2024-08-18T23:56:59.145727+0000","last_became_active":"2024-08-18T23:56:52.752810+0000","last_became_peered":"2024-08-18T23:56:52.752810+0000","last_unstale":"2024-08-18T23:56:59.145727+0000","last_undegraded":"2024-08-18T23:56:59.145727+0000","last_fullsized":"2024-08-18T23:56:59.145727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795903+0000","last_change":"2024-08-18T23:56:57.796078+0000","last_active":"2024-08-18T23:56:58.795903+0000","last_peered":"2024-08-18T23:56:58.795903+0000","last_clean":"2024-08-18T23:56:58.795903+0000","last_became_active":"2024-08-18T23:56:57.795669+0000","last_became_peered":"2024-08-18T23:56:57.795669+0000","last_unstale":"2024-08-18T23:56:58.795903+0000","last_undegraded":"2024-08-18T23:56:58.795903+0000","last_fullsized":"2024-08-18T23:56:58.795903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:36.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146826+0000","last_change":"2024-08-18T23:56:53.769692+0000","last_active":"2024-08-18T23:56:59.146826+0000","last_peered":"2024-08-18T23:56:59.146826+0000","last_clean":"2024-08-18T23:56:59.146826+0000","last_became_active":"2024-08-18T23:56:53.768418+0000","last_became_peered":"2024-08-18T23:56:53.768418+0000","last_unstale":"2024-08-18T23:56:59.146826+0000","last_undegraded":"2024-08-18T23:56:59.146826+0000","last_fullsized":"2024-08-18T23:56:59.146826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:06.397680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794421+0000","last_change":"2024-08-18T23:56:52.756405+0000","last_active":"2024-08-18T23:56:58.794421+0000","last_peered":"2024-08-18T23:56:58.794421+0000","last_clean":"2024-08-18T23:56:58.794421+0000","last_became_active":"2024-08-18T23:56:52.756101+0000","last_became_peered":"2024-08-18T23:56:52.756101+0000","last_unstale":"2024-08-18T23:56:58.794421+0000","last_undegraded":"2024-08-18T23:56:58.794421+0000","last_fullsized":"2024-08-18T23:56:58.794421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145551+0000","last_change":"2024-08-18T23:56:57.984658+0000","last_active":"2024-08-18T23:56:59.145551+0000","last_peered":"2024-08-18T23:56:59.145551+0000","last_clean":"2024-08-18T23:56:59.145551+0000","last_became_active":"2024-08-18T23:56:57.984250+0000","last_became_peered":"2024-08-18T23:56:57.984250+0000","last_unstale":"2024-08-18T23:56:59.145551+0000","last_undegraded":"2024-08-18T23:56:59.145551+0000","last_fullsized":"2024-08-18T23:56:59.145551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:45.358309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146315+0000","last_change":"2024-08-18T23:56:53.764626+0000","last_active":"2024-08-18T23:56:59.146315+0000","last_peered":"2024-08-18T23:56:59.146315+0000","last_clean":"2024-08-18T23:56:59.146315+0000","last_became_active":"2024-08-18T23:56:53.764329+0000","last_became_peered":"2024-08-18T23:56:53.764329+0000","last_unstale":"2024-08-18T23:56:59.146315+0000","last_undegraded":"2024-08-18T23:56:59.146315+0000","last_fullsized":"2024-08-18T23:56:59.146315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:16.778909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146458+0000","last_change":"2024-08-18T23:56:52.756222+0000","last_active":"2024-08-18T23:56:59.146458+0000","last_peered":"2024-08-18T23:56:59.146458+0000","last_clean":"2024-08-18T23:56:59.146458+0000","last_became_active":"2024-08-18T23:56:52.755983+0000","last_became_peered":"2024-08-18T23:56:52.755983+0000","last_unstale":"2024-08-18T23:56:59.146458+0000","last_undegraded":"2024-08-18T23:56:59.146458+0000","last_fullsized":"2024-08-18T23:56:59.146458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:43:40.687385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145369+0000","last_change":"2024-08-18T23:56:57.797013+0000","last_active":"2024-08-18T23:56:59.145369+0000","last_peered":"2024-08-18T23:56:59.145369+0000","last_clean":"2024-08-18T23:56:59.145369+0000","last_became_active":"2024-08-18T23:56:57.796588+0000","last_became_peered":"2024-08-18T23:56:57.796588+0000","last_unstale":"2024-08-18T23:56:59.145369+0000","last_undegraded":"2024-08-18T23:56:59.145369+0000","last_fullsized":"2024-08-18T23:56:59.145369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:01.094119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146228+0000","last_change":"2024-08-18T23:56:53.769197+0000","last_active":"2024-08-18T23:56:59.146228+0000","last_peered":"2024-08-18T23:56:59.146228+0000","last_clean":"2024-08-18T23:56:59.146228+0000","last_became_active":"2024-08-18T23:56:53.768715+0000","last_became_peered":"2024-08-18T23:56:53.768715+0000","last_unstale":"2024-08-18T23:56:59.146228+0000","last_undegraded":"2024-08-18T23:56:59.146228+0000","last_fullsized":"2024-08-18T23:56:59.146228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:57.104014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794086+0000","last_change":"2024-08-18T23:56:52.756491+0000","last_active":"2024-08-18T23:56:58.794086+0000","last_peered":"2024-08-18T23:56:58.794086+0000","last_clean":"2024-08-18T23:56:58.794086+0000","last_became_active":"2024-08-18T23:56:52.756158+0000","last_became_peered":"2024-08-18T23:56:52.756158+0000","last_unstale":"2024-08-18T23:56:58.794086+0000","last_undegraded":"2024-08-18T23:56:58.794086+0000","last_fullsized":"2024-08-18T23:56:58.794086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:31.503425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795726+0000","last_change":"2024-08-18T23:56:57.796919+0000","last_active":"2024-08-18T23:56:58.795726+0000","last_peered":"2024-08-18T23:56:58.795726+0000","last_clean":"2024-08-18T23:56:58.795726+0000","last_became_active":"2024-08-18T23:56:57.796482+0000","last_became_peered":"2024-08-18T23:56:57.796482+0000","last_unstale":"2024-08-18T23:56:58.795726+0000","last_undegraded":"2024-08-18T23:56:58.795726+0000","last_fullsized":"2024-08-18T23:56:58.795726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:57.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793669+0000","last_change":"2024-08-18T23:56:53.762288+0000","last_active":"2024-08-18T23:56:58.793669+0000","last_peered":"2024-08-18T23:56:58.793669+0000","last_clean":"2024-08-18T23:56:58.793669+0000","last_became_active":"2024-08-18T23:56:53.762007+0000","last_became_peered":"2024-08-18T23:56:53.762007+0000","last_unstale":"2024-08-18T23:56:58.793669+0000","last_undegraded":"2024-08-18T23:56:58.793669+0000","last_fullsized":"2024-08-18T23:56:58.793669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793757+0000","last_change":"2024-08-18T23:56:52.748797+0000","last_active":"2024-08-18T23:56:58.793757+0000","last_peered":"2024-08-18T23:56:58.793757+0000","last_clean":"2024-08-18T23:56:58.793757+0000","last_became_active":"2024-08-18T23:56:52.747807+0000","last_became_peered":"2024-08-18T23:56:52.747807+0000","last_unstale":"2024-08-18T23:56:58.793757+0000","last_undegraded":"2024-08-18T23:56:58.793757+0000","last_fullsized":"2024-08-18T23:56:58.793757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145359+0000","last_change":"2024-08-18T23:56:57.985530+0000","last_active":"2024-08-18T23:56:59.145359+0000","last_peered":"2024-08-18T23:56:59.145359+0000","last_clean":"2024-08-18T23:56:59.145359+0000","last_became_active":"2024-08-18T23:56:57.985049+0000","last_became_peered":"2024-08-18T23:56:57.985049+0000","last_unstale":"2024-08-18T23:56:59.145359+0000","last_undegraded":"2024-08-18T23:56:59.145359+0000","last_fullsized":"2024-08-18T23:56:59.145359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:31.882944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146550+0000","last_change":"2024-08-18T23:56:53.769503+0000","last_active":"2024-08-18T23:56:59.146550+0000","last_peered":"2024-08-18T23:56:59.146550+0000","last_clean":"2024-08-18T23:56:59.146550+0000","last_became_active":"2024-08-18T23:56:53.768768+0000","last_became_peered":"2024-08-18T23:56:53.768768+0000","last_unstale":"2024-08-18T23:56:59.146550+0000","last_undegraded":"2024-08-18T23:56:59.146550+0000","last_fullsized":"2024-08-18T23:56:59.146550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:31.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147504+0000","last_change":"2024-08-18T23:56:52.752031+0000","last_active":"2024-08-18T23:56:59.147504+0000","last_peered":"2024-08-18T23:56:59.147504+0000","last_clean":"2024-08-18T23:56:59.147504+0000","last_became_active":"2024-08-18T23:56:52.751751+0000","last_became_peered":"2024-08-18T23:56:52.751751+0000","last_unstale":"2024-08-18T23:56:59.147504+0000","last_undegraded":"2024-08-18T23:56:59.147504+0000","last_fullsized":"2024-08-18T23:56:59.147504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145177+0000","last_change":"2024-08-18T23:56:57.981834+0000","last_active":"2024-08-18T23:56:59.145177+0000","last_peered":"2024-08-18T23:56:59.145177+0000","last_clean":"2024-08-18T23:56:59.145177+0000","last_became_active":"2024-08-18T23:56:57.981436+0000","last_became_peered":"2024-08-18T23:56:57.981436+0000","last_unstale":"2024-08-18T23:56:59.145177+0000","last_undegraded":"2024-08-18T23:56:59.145177+0000","last_fullsized":"2024-08-18T23:56:59.145177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:26.326851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795759+0000","last_change":"2024-08-18T23:56:53.767263+0000","last_active":"2024-08-18T23:56:58.795759+0000","last_peered":"2024-08-18T23:56:58.795759+0000","last_clean":"2024-08-18T23:56:58.795759+0000","last_became_active":"2024-08-18T23:56:53.763206+0000","last_became_peered":"2024-08-18T23:56:53.763206+0000","last_unstale":"2024-08-18T23:56:58.795759+0000","last_undegraded":"2024-08-18T23:56:58.795759+0000","last_fullsized":"2024-08-18T23:56:58.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:55.982846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796033+0000","last_change":"2024-08-18T23:56:52.755349+0000","last_active":"2024-08-18T23:56:58.796033+0000","last_peered":"2024-08-18T23:56:58.796033+0000","last_clean":"2024-08-18T23:56:58.796033+0000","last_became_active":"2024-08-18T23:56:52.755083+0000","last_became_peered":"2024-08-18T23:56:52.755083+0000","last_unstale":"2024-08-18T23:56:58.796033+0000","last_undegraded":"2024-08-18T23:56:58.796033+0000","last_fullsized":"2024-08-18T23:56:58.796033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:21.056208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147710+0000","last_change":"2024-08-18T23:56:57.982048+0000","last_active":"2024-08-18T23:56:59.147710+0000","last_peered":"2024-08-18T23:56:59.147710+0000","last_clean":"2024-08-18T23:56:59.147710+0000","last_became_active":"2024-08-18T23:56:57.981629+0000","last_became_peered":"2024-08-18T23:56:57.981629+0000","last_unstale":"2024-08-18T23:56:59.147710+0000","last_undegraded":"2024-08-18T23:56:59.147710+0000","last_fullsized":"2024-08-18T23:56:59.147710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:10.436357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146447+0000","last_change":"2024-08-18T23:56:53.769453+0000","last_active":"2024-08-18T23:56:59.146447+0000","last_peered":"2024-08-18T23:56:59.146447+0000","last_clean":"2024-08-18T23:56:59.146447+0000","last_became_active":"2024-08-18T23:56:53.768971+0000","last_became_peered":"2024-08-18T23:56:53.768971+0000","last_unstale":"2024-08-18T23:56:59.146447+0000","last_undegraded":"2024-08-18T23:56:59.146447+0000","last_fullsized":"2024-08-18T23:56:59.146447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:18.236785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:57:03.095757+0000","last_change":"2024-08-18T23:56:52.742740+0000","last_active":"2024-08-18T23:57:03.095757+0000","last_peered":"2024-08-18T23:57:03.095757+0000","last_clean":"2024-08-18T23:57:03.095757+0000","last_became_active":"2024-08-18T23:56:52.742250+0000","last_became_peered":"2024-08-18T23:56:52.742250+0000","last_unstale":"2024-08-18T23:57:03.095757+0000","last_undegraded":"2024-08-18T23:57:03.095757+0000","last_fullsized":"2024-08-18T23:57:03.095757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145905+0000","last_change":"2024-08-18T23:56:57.796638+0000","last_active":"2024-08-18T23:56:59.145905+0000","last_peered":"2024-08-18T23:56:59.145905+0000","last_clean":"2024-08-18T23:56:59.145905+0000","last_became_active":"2024-08-18T23:56:57.796223+0000","last_became_peered":"2024-08-18T23:56:57.796223+0000","last_unstale":"2024-08-18T23:56:59.145905+0000","last_undegraded":"2024-08-18T23:56:59.145905+0000","last_fullsized":"2024-08-18T23:56:59.145905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146813+0000","last_change":"2024-08-18T23:56:53.766948+0000","last_active":"2024-08-18T23:56:59.146813+0000","last_peered":"2024-08-18T23:56:59.146813+0000","last_clean":"2024-08-18T23:56:59.146813+0000","last_became_active":"2024-08-18T23:56:53.766437+0000","last_became_peered":"2024-08-18T23:56:53.766437+0000","last_unstale":"2024-08-18T23:56:59.146813+0000","last_undegraded":"2024-08-18T23:56:59.146813+0000","last_fullsized":"2024-08-18T23:56:59.146813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:12.823198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145614+0000","last_change":"2024-08-18T23:56:52.752268+0000","last_active":"2024-08-18T23:56:59.145614+0000","last_peered":"2024-08-18T23:56:59.145614+0000","last_clean":"2024-08-18T23:56:59.145614+0000","last_became_active":"2024-08-18T23:56:52.751988+0000","last_became_peered":"2024-08-18T23:56:52.751988+0000","last_unstale":"2024-08-18T23:56:59.145614+0000","last_undegraded":"2024-08-18T23:56:59.145614+0000","last_fullsized":"2024-08-18T23:56:59.145614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146117+0000","last_change":"2024-08-18T23:56:57.795578+0000","last_active":"2024-08-18T23:56:59.146117+0000","last_peered":"2024-08-18T23:56:59.146117+0000","last_clean":"2024-08-18T23:56:59.146117+0000","last_became_active":"2024-08-18T23:56:57.795182+0000","last_became_peered":"2024-08-18T23:56:57.795182+0000","last_unstale":"2024-08-18T23:56:59.146117+0000","last_undegraded":"2024-08-18T23:56:59.146117+0000","last_fullsized":"2024-08-18T23:56:59.146117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:28.122472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796078+0000","last_change":"2024-08-18T23:56:53.773616+0000","last_active":"2024-08-18T23:56:58.796078+0000","last_peered":"2024-08-18T23:56:58.796078+0000","last_clean":"2024-08-18T23:56:58.796078+0000","last_became_active":"2024-08-18T23:56:53.773129+0000","last_became_peered":"2024-08-18T23:56:53.773129+0000","last_unstale":"2024-08-18T23:56:58.796078+0000","last_undegraded":"2024-08-18T23:56:58.796078+0000","last_fullsized":"2024-08-18T23:56:58.796078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146443+0000","last_change":"2024-08-18T23:56:52.744917+0000","last_active":"2024-08-18T23:56:59.146443+0000","last_peered":"2024-08-18T23:56:59.146443+0000","last_clean":"2024-08-18T23:56:59.146443+0000","last_became_active":"2024-08-18T23:56:52.744638+0000","last_became_peered":"2024-08-18T23:56:52.744638+0000","last_unstale":"2024-08-18T23:56:59.146443+0000","last_undegraded":"2024-08-18T23:56:59.146443+0000","last_fullsized":"2024-08-18T23:56:59.146443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144951+0000","last_change":"2024-08-18T23:56:57.794782+0000","last_active":"2024-08-18T23:56:59.144951+0000","last_peered":"2024-08-18T23:56:59.144951+0000","last_clean":"2024-08-18T23:56:59.144951+0000","last_became_active":"2024-08-18T23:56:57.794392+0000","last_became_peered":"2024-08-18T23:56:57.794392+0000","last_unstale":"2024-08-18T23:56:59.144951+0000","last_undegraded":"2024-08-18T23:56:59.144951+0000","last_fullsized":"2024-08-18T23:56:59.144951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:47.357886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146347+0000","last_change":"2024-08-18T23:56:53.774590+0000","last_active":"2024-08-18T23:56:59.146347+0000","last_peered":"2024-08-18T23:56:59.146347+0000","last_clean":"2024-08-18T23:56:59.146347+0000","last_became_active":"2024-08-18T23:56:53.774302+0000","last_became_peered":"2024-08-18T23:56:53.774302+0000","last_unstale":"2024-08-18T23:56:59.146347+0000","last_undegraded":"2024-08-18T23:56:59.146347+0000","last_fullsized":"2024-08-18T23:56:59.146347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793992+0000","last_change":"2024-08-18T23:56:52.750383+0000","last_active":"2024-08-18T23:56:58.793992+0000","last_peered":"2024-08-18T23:56:58.793992+0000","last_clean":"2024-08-18T23:56:58.793992+0000","last_became_active":"2024-08-18T23:56:52.750095+0000","last_became_peered":"2024-08-18T23:56:52.750095+0000","last_unstale":"2024-08-18T23:56:58.793992+0000","last_undegraded":"2024-08-18T23:56:58.793992+0000","last_fullsized":"2024-08-18T23:56:58.793992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144880+0000","last_change":"2024-08-18T23:56:57.982444+0000","last_active":"2024-08-18T23:56:59.144880+0000","last_peered":"2024-08-18T23:56:59.144880+0000","last_clean":"2024-08-18T23:56:59.144880+0000","last_became_active":"2024-08-18T23:56:57.982080+0000","last_became_peered":"2024-08-18T23:56:57.982080+0000","last_unstale":"2024-08-18T23:56:59.144880+0000","last_undegraded":"2024-08-18T23:56:59.144880+0000","last_fullsized":"2024-08-18T23:56:59.144880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:46:30.528419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795672+0000","last_change":"2024-08-18T23:56:57.984231+0000","last_active":"2024-08-18T23:56:58.795672+0000","last_peered":"2024-08-18T23:56:58.795672+0000","last_clean":"2024-08-18T23:56:58.795672+0000","last_became_active":"2024-08-18T23:56:57.983816+0000","last_became_peered":"2024-08-18T23:56:57.983816+0000","last_unstale":"2024-08-18T23:56:58.795672+0000","last_undegraded":"2024-08-18T23:56:58.795672+0000","last_fullsized":"2024-08-18T23:56:58.795672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145512+0000","last_change":"2024-08-18T23:56:53.765456+0000","last_active":"2024-08-18T23:56:59.145512+0000","last_peered":"2024-08-18T23:56:59.145512+0000","last_clean":"2024-08-18T23:56:59.145512+0000","last_became_active":"2024-08-18T23:56:53.765209+0000","last_became_peered":"2024-08-18T23:56:53.765209+0000","last_unstale":"2024-08-18T23:56:59.145512+0000","last_undegraded":"2024-08-18T23:56:59.145512+0000","last_fullsized":"2024-08-18T23:56:59.145512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145778+0000","last_change":"2024-08-18T23:56:52.746017+0000","last_active":"2024-08-18T23:56:59.145778+0000","last_peered":"2024-08-18T23:56:59.145778+0000","last_clean":"2024-08-18T23:56:59.145778+0000","last_became_active":"2024-08-18T23:56:52.745758+0000","last_became_peered":"2024-08-18T23:56:52.745758+0000","last_unstale":"2024-08-18T23:56:59.145778+0000","last_undegraded":"2024-08-18T23:56:59.145778+0000","last_fullsized":"2024-08-18T23:56:59.145778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794035+0000","last_change":"2024-08-18T23:56:57.797625+0000","last_active":"2024-08-18T23:56:58.794035+0000","last_peered":"2024-08-18T23:56:58.794035+0000","last_clean":"2024-08-18T23:56:58.794035+0000","last_became_active":"2024-08-18T23:56:57.797212+0000","last_became_peered":"2024-08-18T23:56:57.797212+0000","last_unstale":"2024-08-18T23:56:58.794035+0000","last_undegraded":"2024-08-18T23:56:58.794035+0000","last_fullsized":"2024-08-18T23:56:58.794035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145996+0000","last_change":"2024-08-18T23:56:53.770813+0000","last_active":"2024-08-18T23:56:59.145996+0000","last_peered":"2024-08-18T23:56:59.145996+0000","last_clean":"2024-08-18T23:56:59.145996+0000","last_became_active":"2024-08-18T23:56:53.770418+0000","last_became_peered":"2024-08-18T23:56:53.770418+0000","last_unstale":"2024-08-18T23:56:59.145996+0000","last_undegraded":"2024-08-18T23:56:59.145996+0000","last_fullsized":"2024-08-18T23:56:59.145996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145393+0000","last_change":"2024-08-18T23:56:52.749549+0000","last_active":"2024-08-18T23:56:59.145393+0000","last_peered":"2024-08-18T23:56:59.145393+0000","last_clean":"2024-08-18T23:56:59.145393+0000","last_became_active":"2024-08-18T23:56:52.749241+0000","last_became_peered":"2024-08-18T23:56:52.749241+0000","last_unstale":"2024-08-18T23:56:59.145393+0000","last_undegraded":"2024-08-18T23:56:59.145393+0000","last_fullsized":"2024-08-18T23:56:59.145393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:10:48.081149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793835+0000","last_change":"2024-08-18T23:56:52.748476+0000","last_active":"2024-08-18T23:56:58.793835+0000","last_peered":"2024-08-18T23:56:58.793835+0000","last_clean":"2024-08-18T23:56:58.793835+0000","last_became_active":"2024-08-18T23:56:52.748086+0000","last_became_peered":"2024-08-18T23:56:52.748086+0000","last_unstale":"2024-08-18T23:56:58.793835+0000","last_undegraded":"2024-08-18T23:56:58.793835+0000","last_fullsized":"2024-08-18T23:56:58.793835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796022+0000","last_change":"2024-08-18T23:56:53.769482+0000","last_active":"2024-08-18T23:56:58.796022+0000","last_peered":"2024-08-18T23:56:58.796022+0000","last_clean":"2024-08-18T23:56:58.796022+0000","last_became_active":"2024-08-18T23:56:53.769011+0000","last_became_peered":"2024-08-18T23:56:53.769011+0000","last_unstale":"2024-08-18T23:56:58.796022+0000","last_undegraded":"2024-08-18T23:56:58.796022+0000","last_fullsized":"2024-08-18T23:56:58.796022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794765+0000","last_change":"2024-08-18T23:56:57.794273+0000","last_active":"2024-08-18T23:56:58.794765+0000","last_peered":"2024-08-18T23:56:58.794765+0000","last_clean":"2024-08-18T23:56:58.794765+0000","last_became_active":"2024-08-18T23:56:57.793881+0000","last_became_peered":"2024-08-18T23:56:57.793881+0000","last_unstale":"2024-08-18T23:56:58.794765+0000","last_undegraded":"2024-08-18T23:56:58.794765+0000","last_fullsized":"2024-08-18T23:56:58.794765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:35.231599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145044+0000","last_change":"2024-08-18T23:56:52.758361+0000","last_active":"2024-08-18T23:56:59.145044+0000","last_peered":"2024-08-18T23:56:59.145044+0000","last_clean":"2024-08-18T23:56:59.145044+0000","last_became_active":"2024-08-18T23:56:52.758061+0000","last_became_peered":"2024-08-18T23:56:52.758061+0000","last_unstale":"2024-08-18T23:56:59.145044+0000","last_undegraded":"2024-08-18T23:56:59.145044+0000","last_fullsized":"2024-08-18T23:56:59.145044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:31.503425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145753+0000","last_change":"2024-08-18T23:56:53.772935+0000","last_active":"2024-08-18T23:56:59.145753+0000","last_peered":"2024-08-18T23:56:59.145753+0000","last_clean":"2024-08-18T23:56:59.145753+0000","last_became_active":"2024-08-18T23:56:53.772663+0000","last_became_peered":"2024-08-18T23:56:53.772663+0000","last_unstale":"2024-08-18T23:56:59.145753+0000","last_undegraded":"2024-08-18T23:56:59.145753+0000","last_fullsized":"2024-08-18T23:56:59.145753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:17.271839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145518+0000","last_change":"2024-08-18T23:56:57.796804+0000","last_active":"2024-08-18T23:56:59.145518+0000","last_peered":"2024-08-18T23:56:59.145518+0000","last_clean":"2024-08-18T23:56:59.145518+0000","last_became_active":"2024-08-18T23:56:57.796403+0000","last_became_peered":"2024-08-18T23:56:57.796403+0000","last_unstale":"2024-08-18T23:56:59.145518+0000","last_undegraded":"2024-08-18T23:56:59.145518+0000","last_fullsized":"2024-08-18T23:56:59.145518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:52.440154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793982+0000","last_change":"2024-08-18T23:56:53.762460+0000","last_active":"2024-08-18T23:56:58.793982+0000","last_peered":"2024-08-18T23:56:58.793982+0000","last_clean":"2024-08-18T23:56:58.793982+0000","last_became_active":"2024-08-18T23:56:53.762178+0000","last_became_peered":"2024-08-18T23:56:53.762178+0000","last_unstale":"2024-08-18T23:56:58.793982+0000","last_undegraded":"2024-08-18T23:56:58.793982+0000","last_fullsized":"2024-08-18T23:56:58.793982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794237+0000","last_change":"2024-08-18T23:56:53.764382+0000","last_active":"2024-08-18T23:56:58.794237+0000","last_peered":"2024-08-18T23:56:58.794237+0000","last_clean":"2024-08-18T23:56:58.794237+0000","last_became_active":"2024-08-18T23:56:53.764101+0000","last_became_peered":"2024-08-18T23:56:53.764101+0000","last_unstale":"2024-08-18T23:56:58.794237+0000","last_undegraded":"2024-08-18T23:56:58.794237+0000","last_fullsized":"2024-08-18T23:56:58.794237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:55.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147476+0000","last_change":"2024-08-18T23:56:53.775607+0000","last_active":"2024-08-18T23:56:59.147476+0000","last_peered":"2024-08-18T23:56:59.147476+0000","last_clean":"2024-08-18T23:56:59.147476+0000","last_became_active":"2024-08-18T23:56:53.775349+0000","last_became_peered":"2024-08-18T23:56:53.775349+0000","last_unstale":"2024-08-18T23:56:59.147476+0000","last_undegraded":"2024-08-18T23:56:59.147476+0000","last_fullsized":"2024-08-18T23:56:59.147476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:49.498231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795886+0000","last_change":"2024-08-18T23:56:53.767511+0000","last_active":"2024-08-18T23:56:58.795886+0000","last_peered":"2024-08-18T23:56:58.795886+0000","last_clean":"2024-08-18T23:56:58.795886+0000","last_became_active":"2024-08-18T23:56:53.762845+0000","last_became_peered":"2024-08-18T23:56:53.762845+0000","last_unstale":"2024-08-18T23:56:58.795886+0000","last_undegraded":"2024-08-18T23:56:58.795886+0000","last_fullsized":"2024-08-18T23:56:58.795886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145268+0000","last_change":"2024-08-18T23:56:53.764036+0000","last_active":"2024-08-18T23:56:59.145268+0000","last_peered":"2024-08-18T23:56:59.145268+0000","last_clean":"2024-08-18T23:56:59.145268+0000","last_became_active":"2024-08-18T23:56:53.763734+0000","last_became_peered":"2024-08-18T23:56:53.763734+0000","last_unstale":"2024-08-18T23:56:59.145268+0000","last_undegraded":"2024-08-18T23:56:59.145268+0000","last_fullsized":"2024-08-18T23:56:59.145268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:24.083795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145438+0000","last_change":"2024-08-18T23:56:53.766271+0000","last_active":"2024-08-18T23:56:59.145438+0000","last_peered":"2024-08-18T23:56:59.145438+0000","last_clean":"2024-08-18T23:56:59.145438+0000","last_became_active":"2024-08-18T23:56:53.766022+0000","last_became_peered":"2024-08-18T23:56:53.766022+0000","last_unstale":"2024-08-18T23:56:59.145438+0000","last_undegraded":"2024-08-18T23:56:59.145438+0000","last_fullsized":"2024-08-18T23:56:59.145438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794419+0000","last_change":"2024-08-18T23:56:53.759600+0000","last_active":"2024-08-18T23:56:58.794419+0000","last_peered":"2024-08-18T23:56:58.794419+0000","last_clean":"2024-08-18T23:56:58.794419+0000","last_became_active":"2024-08-18T23:56:53.759294+0000","last_became_peered":"2024-08-18T23:56:53.759294+0000","last_unstale":"2024-08-18T23:56:58.794419+0000","last_undegraded":"2024-08-18T23:56:58.794419+0000","last_fullsized":"2024-08-18T23:56:58.794419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145362+0000","last_change":"2024-08-18T23:56:53.764119+0000","last_active":"2024-08-18T23:56:59.145362+0000","last_peered":"2024-08-18T23:56:59.145362+0000","last_clean":"2024-08-18T23:56:59.145362+0000","last_became_active":"2024-08-18T23:56:53.763804+0000","last_became_peered":"2024-08-18T23:56:53.763804+0000","last_unstale":"2024-08-18T23:56:59.145362+0000","last_undegraded":"2024-08-18T23:56:59.145362+0000","last_fullsized":"2024-08-18T23:56:59.145362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:49.498231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145653+0000","last_change":"2024-08-18T23:56:53.770463+0000","last_active":"2024-08-18T23:56:59.145653+0000","last_peered":"2024-08-18T23:56:59.145653+0000","last_clean":"2024-08-18T23:56:59.145653+0000","last_became_active":"2024-08-18T23:56:53.768044+0000","last_became_peered":"2024-08-18T23:56:53.768044+0000","last_unstale":"2024-08-18T23:56:59.145653+0000","last_undegraded":"2024-08-18T23:56:59.145653+0000","last_fullsized":"2024-08-18T23:56:59.145653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145134+0000","last_change":"2024-08-18T23:56:53.764055+0000","last_active":"2024-08-18T23:56:59.145134+0000","last_peered":"2024-08-18T23:56:59.145134+0000","last_clean":"2024-08-18T23:56:59.145134+0000","last_became_active":"2024-08-18T23:56:53.763760+0000","last_became_peered":"2024-08-18T23:56:53.763760+0000","last_unstale":"2024-08-18T23:56:59.145134+0000","last_undegraded":"2024-08-18T23:56:59.145134+0000","last_fullsized":"2024-08-18T23:56:59.145134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147400+0000","last_change":"2024-08-18T23:56:53.769367+0000","last_active":"2024-08-18T23:56:59.147400+0000","last_peered":"2024-08-18T23:56:59.147400+0000","last_clean":"2024-08-18T23:56:59.147400+0000","last_became_active":"2024-08-18T23:56:53.767443+0000","last_became_peered":"2024-08-18T23:56:53.767443+0000","last_unstale":"2024-08-18T23:56:59.147400+0000","last_undegraded":"2024-08-18T23:56:59.147400+0000","last_fullsized":"2024-08-18T23:56:59.147400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:24.083795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795708+0000","last_change":"2024-08-18T23:56:53.762405+0000","last_active":"2024-08-18T23:56:58.795708+0000","last_peered":"2024-08-18T23:56:58.795708+0000","last_clean":"2024-08-18T23:56:58.795708+0000","last_became_active":"2024-08-18T23:56:53.761768+0000","last_became_peered":"2024-08-18T23:56:53.761768+0000","last_unstale":"2024-08-18T23:56:58.795708+0000","last_undegraded":"2024-08-18T23:56:58.795708+0000","last_fullsized":"2024-08-18T23:56:58.795708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793905+0000","last_change":"2024-08-18T23:56:53.766982+0000","last_active":"2024-08-18T23:56:58.793905+0000","last_peered":"2024-08-18T23:56:58.793905+0000","last_clean":"2024-08-18T23:56:58.793905+0000","last_became_active":"2024-08-18T23:56:53.766519+0000","last_became_peered":"2024-08-18T23:56:53.766519+0000","last_unstale":"2024-08-18T23:56:58.793905+0000","last_undegraded":"2024-08-18T23:56:58.793905+0000","last_fullsized":"2024-08-18T23:56:58.793905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147183+0000","last_change":"2024-08-18T23:56:53.763491+0000","last_active":"2024-08-18T23:56:59.147183+0000","last_peered":"2024-08-18T23:56:59.147183+0000","last_clean":"2024-08-18T23:56:59.147183+0000","last_became_active":"2024-08-18T23:56:53.763123+0000","last_became_peered":"2024-08-18T23:56:53.763123+0000","last_unstale":"2024-08-18T23:56:59.147183+0000","last_undegraded":"2024-08-18T23:56:59.147183+0000","last_fullsized":"2024-08-18T23:56:59.147183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:48:21.747365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794368+0000","last_change":"2024-08-18T23:56:53.756577+0000","last_active":"2024-08-18T23:56:58.794368+0000","last_peered":"2024-08-18T23:56:58.794368+0000","last_clean":"2024-08-18T23:56:58.794368+0000","last_became_active":"2024-08-18T23:56:53.755872+0000","last_became_peered":"2024-08-18T23:56:53.755872+0000","last_unstale":"2024-08-18T23:56:58.794368+0000","last_undegraded":"2024-08-18T23:56:58.794368+0000","last_fullsized":"2024-08-18T23:56:58.794368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:12.823198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146986+0000","last_change":"2024-08-18T23:56:53.775155+0000","last_active":"2024-08-18T23:56:59.146986+0000","last_peered":"2024-08-18T23:56:59.146986+0000","last_clean":"2024-08-18T23:56:59.146986+0000","last_became_active":"2024-08-18T23:56:53.774332+0000","last_became_peered":"2024-08-18T23:56:53.774332+0000","last_unstale":"2024-08-18T23:56:59.146986+0000","last_undegraded":"2024-08-18T23:56:59.146986+0000","last_fullsized":"2024-08-18T23:56:59.146986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:57.104014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145651+0000","last_change":"2024-08-18T23:56:53.777136+0000","last_active":"2024-08-18T23:56:59.145651+0000","last_peered":"2024-08-18T23:56:59.145651+0000","last_clean":"2024-08-18T23:56:59.145651+0000","last_became_active":"2024-08-18T23:56:53.776851+0000","last_became_peered":"2024-08-18T23:56:53.776851+0000","last_unstale":"2024-08-18T23:56:59.145651+0000","last_undegraded":"2024-08-18T23:56:59.145651+0000","last_fullsized":"2024-08-18T23:56:59.145651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145548+0000","last_change":"2024-08-18T23:56:53.772745+0000","last_active":"2024-08-18T23:56:59.145548+0000","last_peered":"2024-08-18T23:56:59.145548+0000","last_clean":"2024-08-18T23:56:59.145548+0000","last_became_active":"2024-08-18T23:56:53.772455+0000","last_became_peered":"2024-08-18T23:56:53.772455+0000","last_unstale":"2024-08-18T23:56:59.145548+0000","last_undegraded":"2024-08-18T23:56:59.145548+0000","last_fullsized":"2024-08-18T23:56:59.145548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795596+0000","last_change":"2024-08-18T23:56:53.768901+0000","last_active":"2024-08-18T23:56:58.795596+0000","last_peered":"2024-08-18T23:56:58.795596+0000","last_clean":"2024-08-18T23:56:58.795596+0000","last_became_active":"2024-08-18T23:56:53.767949+0000","last_became_peered":"2024-08-18T23:56:53.767949+0000","last_unstale":"2024-08-18T23:56:58.795596+0000","last_undegraded":"2024-08-18T23:56:58.795596+0000","last_fullsized":"2024-08-18T23:56:58.795596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:57.813404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144928+0000","last_change":"2024-08-18T23:56:53.757368+0000","last_active":"2024-08-18T23:56:59.144928+0000","last_peered":"2024-08-18T23:56:59.144928+0000","last_clean":"2024-08-18T23:56:59.144928+0000","last_became_active":"2024-08-18T23:56:53.756898+0000","last_became_peered":"2024-08-18T23:56:53.756898+0000","last_unstale":"2024-08-18T23:56:59.144928+0000","last_undegraded":"2024-08-18T23:56:59.144928+0000","last_fullsized":"2024-08-18T23:56:59.144928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:59.039252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146741+0000","last_change":"2024-08-18T23:56:53.765280+0000","last_active":"2024-08-18T23:56:59.146741+0000","last_peered":"2024-08-18T23:56:59.146741+0000","last_clean":"2024-08-18T23:56:59.146741+0000","last_became_active":"2024-08-18T23:56:53.763756+0000","last_became_peered":"2024-08-18T23:56:53.763756+0000","last_unstale":"2024-08-18T23:56:59.146741+0000","last_undegraded":"2024-08-18T23:56:59.146741+0000","last_fullsized":"2024-08-18T23:56:59.146741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:55.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794162+0000","last_change":"2024-08-18T23:56:53.772201+0000","last_active":"2024-08-18T23:56:58.794162+0000","last_peered":"2024-08-18T23:56:58.794162+0000","last_clean":"2024-08-18T23:56:58.794162+0000","last_became_active":"2024-08-18T23:56:53.770656+0000","last_became_peered":"2024-08-18T23:56:53.770656+0000","last_unstale":"2024-08-18T23:56:58.794162+0000","last_undegraded":"2024-08-18T23:56:58.794162+0000","last_fullsized":"2024-08-18T23:56:58.794162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794351+0000","last_change":"2024-08-18T23:56:53.772162+0000","last_active":"2024-08-18T23:56:58.794351+0000","last_peered":"2024-08-18T23:56:58.794351+0000","last_clean":"2024-08-18T23:56:58.794351+0000","last_became_active":"2024-08-18T23:56:53.771265+0000","last_became_peered":"2024-08-18T23:56:53.771265+0000","last_unstale":"2024-08-18T23:56:58.794351+0000","last_undegraded":"2024-08-18T23:56:58.794351+0000","last_fullsized":"2024-08-18T23:56:58.794351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146824+0000","last_change":"2024-08-18T23:56:53.772410+0000","last_active":"2024-08-18T23:56:59.146824+0000","last_peered":"2024-08-18T23:56:59.146824+0000","last_clean":"2024-08-18T23:56:59.146824+0000","last_became_active":"2024-08-18T23:56:53.771633+0000","last_became_peered":"2024-08-18T23:56:53.771633+0000","last_unstale":"2024-08-18T23:56:59.146824+0000","last_undegraded":"2024-08-18T23:56:59.146824+0000","last_fullsized":"2024-08-18T23:56:59.146824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:41.319632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144814+0000","last_change":"2024-08-18T23:56:53.766249+0000","last_active":"2024-08-18T23:56:59.144814+0000","last_peered":"2024-08-18T23:56:59.144814+0000","last_clean":"2024-08-18T23:56:59.144814+0000","last_became_active":"2024-08-18T23:56:53.765940+0000","last_became_peered":"2024-08-18T23:56:53.765940+0000","last_unstale":"2024-08-18T23:56:59.144814+0000","last_undegraded":"2024-08-18T23:56:59.144814+0000","last_fullsized":"2024-08-18T23:56:59.144814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146148+0000","last_change":"2024-08-18T23:56:53.766607+0000","last_active":"2024-08-18T23:56:59.146148+0000","last_peered":"2024-08-18T23:56:59.146148+0000","last_clean":"2024-08-18T23:56:59.146148+0000","last_became_active":"2024-08-18T23:56:53.766145+0000","last_became_peered":"2024-08-18T23:56:53.766145+0000","last_unstale":"2024-08-18T23:56:59.146148+0000","last_undegraded":"2024-08-18T23:56:59.146148+0000","last_fullsized":"2024-08-18T23:56:59.146148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147356+0000","last_change":"2024-08-18T23:56:53.770217+0000","last_active":"2024-08-18T23:56:59.147356+0000","last_peered":"2024-08-18T23:56:59.147356+0000","last_clean":"2024-08-18T23:56:59.147356+0000","last_became_active":"2024-08-18T23:56:53.769943+0000","last_became_peered":"2024-08-18T23:56:53.769943+0000","last_unstale":"2024-08-18T23:56:59.147356+0000","last_undegraded":"2024-08-18T23:56:59.147356+0000","last_fullsized":"2024-08-18T23:56:59.147356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:22.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146889+0000","last_change":"2024-08-18T23:56:53.763822+0000","last_active":"2024-08-18T23:56:59.146889+0000","last_peered":"2024-08-18T23:56:59.146889+0000","last_clean":"2024-08-18T23:56:59.146889+0000","last_became_active":"2024-08-18T23:56:53.762359+0000","last_became_peered":"2024-08-18T23:56:53.762359+0000","last_unstale":"2024-08-18T23:56:59.146889+0000","last_undegraded":"2024-08-18T23:56:59.146889+0000","last_fullsized":"2024-08-18T23:56:59.146889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:38.459488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147339+0000","last_change":"2024-08-18T23:56:53.775297+0000","last_active":"2024-08-18T23:56:59.147339+0000","last_peered":"2024-08-18T23:56:59.147339+0000","last_clean":"2024-08-18T23:56:59.147339+0000","last_became_active":"2024-08-18T23:56:53.774803+0000","last_became_peered":"2024-08-18T23:56:53.774803+0000","last_unstale":"2024-08-18T23:56:59.147339+0000","last_undegraded":"2024-08-18T23:56:59.147339+0000","last_fullsized":"2024-08-18T23:56:59.147339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:59.039252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795630+0000","last_change":"2024-08-18T23:56:53.761493+0000","last_active":"2024-08-18T23:56:58.795630+0000","last_peered":"2024-08-18T23:56:58.795630+0000","last_clean":"2024-08-18T23:56:58.795630+0000","last_became_active":"2024-08-18T23:56:53.760939+0000","last_became_peered":"2024-08-18T23:56:53.760939+0000","last_unstale":"2024-08-18T23:56:58.795630+0000","last_undegraded":"2024-08-18T23:56:58.795630+0000","last_fullsized":"2024-08-18T23:56:58.795630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145825+0000","last_change":"2024-08-18T23:56:53.763839+0000","last_active":"2024-08-18T23:56:59.145825+0000","last_peered":"2024-08-18T23:56:59.145825+0000","last_clean":"2024-08-18T23:56:59.145825+0000","last_became_active":"2024-08-18T23:56:53.763462+0000","last_became_peered":"2024-08-18T23:56:53.763462+0000","last_unstale":"2024-08-18T23:56:59.145825+0000","last_undegraded":"2024-08-18T23:56:59.145825+0000","last_fullsized":"2024-08-18T23:56:59.145825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146738+0000","last_change":"2024-08-18T23:56:53.769068+0000","last_active":"2024-08-18T23:56:59.146738+0000","last_peered":"2024-08-18T23:56:59.146738+0000","last_clean":"2024-08-18T23:56:59.146738+0000","last_became_active":"2024-08-18T23:56:53.767605+0000","last_became_peered":"2024-08-18T23:56:53.767605+0000","last_unstale":"2024-08-18T23:56:59.146738+0000","last_undegraded":"2024-08-18T23:56:59.146738+0000","last_fullsized":"2024-08-18T23:56:59.146738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:30.270890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:13.806 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:13.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.938+0000 7f00125df640 1 Processor -- start 2024-08-18T23:57:13.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.938+0000 7f00125df640 1 -- start start 2024-08-18T23:57:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.939+0000 7f00125df640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f000c0b4370 0x7f000c0ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.939+0000 7f00125df640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c072610 con 0x7f000c06f770 2024-08-18T23:57:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.939+0000 7f00125df640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000c0728f0 con 0x7f000c15ade0 2024-08-18T23:57:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.939+0000 7f00125df640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f000c06db10 con 0x7f000c0b4370 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.939+0000 7f000b7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f000c06f770 0x7f000c0ad9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56398/0 (socket says 172.21.15.103:56398) 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.939+0000 7f000b7fe640 1 -- 172.21.15.103:0/3221830391 learned_addr learned my addr 172.21.15.103:0/3221830391 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.939+0000 7f0010b7c640 1 --2- 172.21.15.103:0/3221830391 >> v2:172.21.15.190:3300/0 conn(0x7f000c0b4370 0x7f000c0ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.940+0000 7f000affd640 1 -- 172.21.15.103:0/3221830391 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2295240557 0 0) 0x7f000c072610 con 0x7f000c06f770 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.940+0000 7f000affd640 1 -- 172.21.15.103:0/3221830391 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff4003520 con 0x7f000c06f770 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.940+0000 7f000affd640 1 -- 172.21.15.103:0/3221830391 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942763768 0 0) 0x7f000c0728f0 con 0x7f000c15ade0 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.940+0000 7f000affd640 1 -- 172.21.15.103:0/3221830391 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f000c072610 con 0x7f000c15ade0 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.940+0000 7f0010b7c640 1 -- 172.21.15.103:0/3221830391 >> v1:172.21.15.190:6789/0 conn(0x7f000c15ade0 legacy=0x7f000c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.940+0000 7f0010b7c640 1 -- 172.21.15.103:0/3221830391 >> v1:172.21.15.103:6789/0 conn(0x7f000c06f770 legacy=0x7f000c0ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.940+0000 7f0010b7c640 1 -- 172.21.15.103:0/3221830391 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c072bd0 con 0x7f000c0b4370 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.941+0000 7f0010b7c640 1 --2- 172.21.15.103:0/3221830391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 0x7f000c0ae0e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0004009d90 tx=0x7f000402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fc23fa754bae836 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.941+0000 7f000affd640 1 -- 172.21.15.103:0/3221830391 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004007740 con 0x7f000c0b4370 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.941+0000 7f000affd640 1 -- 172.21.15.103:0/3221830391 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00040078e0 con 0x7f000c0b4370 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.941+0000 7f000affd640 1 -- 172.21.15.103:0/3221830391 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0004007cb0 con 0x7f000c0b4370 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.942+0000 7f00125df640 1 -- 172.21.15.103:0/3221830391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 msgr2=0x7f000c0ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.942+0000 7f00125df640 1 --2- 172.21.15.103:0/3221830391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 0x7f000c0ae0e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0004009d90 tx=0x7f000402a660 comp rx=0 tx=0).stop 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.942+0000 7f00125df640 1 -- 172.21.15.103:0/3221830391 shutdown_connections 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.942+0000 7f00125df640 1 --2- 172.21.15.103:0/3221830391 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 0x7f000c0ae0e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.942+0000 7f00125df640 1 -- 172.21.15.103:0/3221830391 >> 172.21.15.103:0/3221830391 conn(0x7f000c0cfc40 msgr2=0x7f000c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.942+0000 7f00125df640 1 -- 172.21.15.103:0/3221830391 shutdown_connections 2024-08-18T23:57:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.942+0000 7f00125df640 1 -- 172.21.15.103:0/3221830391 wait complete. 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.943+0000 7f00125df640 1 Processor -- start 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.943+0000 7f00125df640 1 -- start start 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f00125df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f000c06f770 0x7f000c15a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f00125df640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 0x7f000c1f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f00125df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f000c15ade0 0x7f000c0b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f00125df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f000c06d6c0 con 0x7f000c06f770 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f00125df640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f000c15b1c0 con 0x7f000c0b4370 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f00125df640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f000c06d840 con 0x7f000c15ade0 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f000c06f770 0x7f000c15a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f000c06f770 0x7f000c15a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38144/0 (socket says 172.21.15.103:38144) 2024-08-18T23:57:13.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 -- 172.21.15.103:0/773239339 learned_addr learned my addr 172.21.15.103:0/773239339 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000b7fe640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 0x7f000c1f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f0010b7c640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f000c15ade0 0x7f000c0b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 -- 172.21.15.103:0/773239339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f000c15ade0 msgr2=0x7f000c0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f000c15ade0 0x7f000c0b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 -- 172.21.15.103:0/773239339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 msgr2=0x7f000c1f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 0x7f000c1f4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 -- 172.21.15.103:0/773239339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c06e1a0 con 0x7f000c06f770 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.944+0000 7f000bfff640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f000c06f770 0x7f000c15a2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c430 tx=0x7efffc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.945+0000 7f0008ff9640 1 -- 172.21.15.103:0/773239339 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc017070 con 0x7f000c06f770 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.945+0000 7f0008ff9640 1 -- 172.21.15.103:0/773239339 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efffc0052f0 con 0x7f000c06f770 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.945+0000 7f0008ff9640 1 -- 172.21.15.103:0/773239339 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc003830 con 0x7f000c06f770 2024-08-18T23:57:13.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.945+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c06e480 con 0x7f000c06f770 2024-08-18T23:57:13.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.945+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c06ea40 con 0x7f000c06f770 2024-08-18T23:57:13.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.946+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f000c0b47b0 con 0x7f000c06f770 2024-08-18T23:57:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.946+0000 7f0008ff9640 1 -- 172.21.15.103:0/773239339 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efffc01a070 con 0x7f000c06f770 2024-08-18T23:57:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.946+0000 7f0008ff9640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efff806be30 0x7efff806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.947+0000 7f0008ff9640 1 -- 172.21.15.103:0/773239339 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efffc08a500 con 0x7f000c06f770 2024-08-18T23:57:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.947+0000 7f000b7fe640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efff806be30 0x7efff806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:13.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.947+0000 7f000b7fe640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efff806be30 0x7efff806e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f000c06efe0 tx=0x7f0000009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:13.955+0000 7f0008ff9640 1 -- 172.21.15.103:0/773239339 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7efffc058c00 con 0x7f000c06f770 2024-08-18T23:57:14.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.121+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f000c06df50 con 0x7efff806be30 2024-08-18T23:57:14.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.129+0000 7f0008ff9640 1 -- 172.21.15.103:0/773239339 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f000c06df50 con 0x7efff806be30 2024-08-18T23:57:14.133 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:14.135 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.132+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efff806be30 msgr2=0x7efff806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.132+0000 7f00125df640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efff806be30 0x7efff806e2f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f000c06efe0 tx=0x7f0000009040 comp rx=0 tx=0).stop 2024-08-18T23:57:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.132+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f000c06f770 msgr2=0x7f000c15a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.132+0000 7f00125df640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f000c06f770 0x7f000c15a2e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c430 tx=0x7efffc00c8f0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.133+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 shutdown_connections 2024-08-18T23:57:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.133+0000 7f00125df640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7efff806be30 0x7efff806e2f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.133+0000 7f00125df640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f000c15ade0 0x7f000c0b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.133+0000 7f00125df640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f000c0b4370 0x7f000c1f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.133+0000 7f00125df640 1 --2- 172.21.15.103:0/773239339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f000c06f770 0x7f000c15a2e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.133+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 >> 172.21.15.103:0/773239339 conn(0x7f000c0cfc40 msgr2=0x7f000c0ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:14.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.133+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 shutdown_connections 2024-08-18T23:57:14.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.133+0000 7f00125df640 1 -- 172.21.15.103:0/773239339 wait complete. 2024-08-18T23:57:14.145 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-08-18T23:57:12.168336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003338"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796132+0000","last_change":"2024-08-18T23:56:52.756091+0000","last_active":"2024-08-18T23:56:58.796132+0000","last_peered":"2024-08-18T23:56:58.796132+0000","last_clean":"2024-08-18T23:56:58.796132+0000","last_became_active":"2024-08-18T23:56:52.755823+0000","last_became_peered":"2024-08-18T23:56:52.755823+0000","last_unstale":"2024-08-18T23:56:58.796132+0000","last_undegraded":"2024-08-18T23:56:58.796132+0000","last_fullsized":"2024-08-18T23:56:58.796132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:10:48.081149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145741+0000","last_change":"2024-08-18T23:56:53.755660+0000","last_active":"2024-08-18T23:56:59.145741+0000","last_peered":"2024-08-18T23:56:59.145741+0000","last_clean":"2024-08-18T23:56:59.145741+0000","last_became_active":"2024-08-18T23:56:53.755395+0000","last_became_peered":"2024-08-18T23:56:53.755395+0000","last_unstale":"2024-08-18T23:56:59.145741+0000","last_undegraded":"2024-08-18T23:56:59.145741+0000","last_fullsized":"2024-08-18T23:56:59.145741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:24.430755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144804+0000","last_change":"2024-08-18T23:56:57.985729+0000","last_active":"2024-08-18T23:56:59.144804+0000","last_peered":"2024-08-18T23:56:59.144804+0000","last_clean":"2024-08-18T23:56:59.144804+0000","last_became_active":"2024-08-18T23:56:57.985390+0000","last_became_peered":"2024-08-18T23:56:57.985390+0000","last_unstale":"2024-08-18T23:56:59.144804+0000","last_undegraded":"2024-08-18T23:56:59.144804+0000","last_fullsized":"2024-08-18T23:56:59.144804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:47.865044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145904+0000","last_change":"2024-08-18T23:56:52.757392+0000","last_active":"2024-08-18T23:56:59.145904+0000","last_peered":"2024-08-18T23:56:59.145904+0000","last_clean":"2024-08-18T23:56:59.145904+0000","last_became_active":"2024-08-18T23:56:52.757111+0000","last_became_peered":"2024-08-18T23:56:52.757111+0000","last_unstale":"2024-08-18T23:56:59.145904+0000","last_undegraded":"2024-08-18T23:56:59.145904+0000","last_fullsized":"2024-08-18T23:56:59.145904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795884+0000","last_change":"2024-08-18T23:56:53.773415+0000","last_active":"2024-08-18T23:56:58.795884+0000","last_peered":"2024-08-18T23:56:58.795884+0000","last_clean":"2024-08-18T23:56:58.795884+0000","last_became_active":"2024-08-18T23:56:53.769428+0000","last_became_peered":"2024-08-18T23:56:53.769428+0000","last_unstale":"2024-08-18T23:56:58.795884+0000","last_undegraded":"2024-08-18T23:56:58.795884+0000","last_fullsized":"2024-08-18T23:56:58.795884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145415+0000","last_change":"2024-08-18T23:56:57.796039+0000","last_active":"2024-08-18T23:56:59.145415+0000","last_peered":"2024-08-18T23:56:59.145415+0000","last_clean":"2024-08-18T23:56:59.145415+0000","last_became_active":"2024-08-18T23:56:57.795504+0000","last_became_peered":"2024-08-18T23:56:57.795504+0000","last_unstale":"2024-08-18T23:56:59.145415+0000","last_undegraded":"2024-08-18T23:56:59.145415+0000","last_fullsized":"2024-08-18T23:56:59.145415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:45.045215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146785+0000","last_change":"2024-08-18T23:56:52.758482+0000","last_active":"2024-08-18T23:56:59.146785+0000","last_peered":"2024-08-18T23:56:59.146785+0000","last_clean":"2024-08-18T23:56:59.146785+0000","last_became_active":"2024-08-18T23:56:52.758194+0000","last_became_peered":"2024-08-18T23:56:52.758194+0000","last_unstale":"2024-08-18T23:56:59.146785+0000","last_undegraded":"2024-08-18T23:56:59.146785+0000","last_fullsized":"2024-08-18T23:56:59.146785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:34.443678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147481+0000","last_change":"2024-08-18T23:56:53.769569+0000","last_active":"2024-08-18T23:56:59.147481+0000","last_peered":"2024-08-18T23:56:59.147481+0000","last_clean":"2024-08-18T23:56:59.147481+0000","last_became_active":"2024-08-18T23:56:53.769304+0000","last_became_peered":"2024-08-18T23:56:53.769304+0000","last_unstale":"2024-08-18T23:56:59.147481+0000","last_undegraded":"2024-08-18T23:56:59.147481+0000","last_fullsized":"2024-08-18T23:56:59.147481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:24.430755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145660+0000","last_change":"2024-08-18T23:56:57.804268+0000","last_active":"2024-08-18T23:56:59.145660+0000","last_peered":"2024-08-18T23:56:59.145660+0000","last_clean":"2024-08-18T23:56:59.145660+0000","last_became_active":"2024-08-18T23:56:57.803915+0000","last_became_peered":"2024-08-18T23:56:57.803915+0000","last_unstale":"2024-08-18T23:56:59.145660+0000","last_undegraded":"2024-08-18T23:56:59.145660+0000","last_fullsized":"2024-08-18T23:56:59.145660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:26.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146148+0000","last_change":"2024-08-18T23:56:52.758724+0000","last_active":"2024-08-18T23:56:59.146148+0000","last_peered":"2024-08-18T23:56:59.146148+0000","last_clean":"2024-08-18T23:56:59.146148+0000","last_became_active":"2024-08-18T23:56:52.758420+0000","last_became_peered":"2024-08-18T23:56:52.758420+0000","last_unstale":"2024-08-18T23:56:59.146148+0000","last_undegraded":"2024-08-18T23:56:59.146148+0000","last_fullsized":"2024-08-18T23:56:59.146148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:11.818210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147721+0000","last_change":"2024-08-18T23:56:53.769922+0000","last_active":"2024-08-18T23:56:59.147721+0000","last_peered":"2024-08-18T23:56:59.147721+0000","last_clean":"2024-08-18T23:56:59.147721+0000","last_became_active":"2024-08-18T23:56:53.769638+0000","last_became_peered":"2024-08-18T23:56:53.769638+0000","last_unstale":"2024-08-18T23:56:59.147721+0000","last_undegraded":"2024-08-18T23:56:59.147721+0000","last_fullsized":"2024-08-18T23:56:59.147721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:38.459488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145653+0000","last_change":"2024-08-18T23:56:57.794111+0000","last_active":"2024-08-18T23:56:59.145653+0000","last_peered":"2024-08-18T23:56:59.145653+0000","last_clean":"2024-08-18T23:56:59.145653+0000","last_became_active":"2024-08-18T23:56:57.793673+0000","last_became_peered":"2024-08-18T23:56:57.793673+0000","last_unstale":"2024-08-18T23:56:59.145653+0000","last_undegraded":"2024-08-18T23:56:59.145653+0000","last_fullsized":"2024-08-18T23:56:59.145653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:03.077928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793609+0000","last_change":"2024-08-18T23:56:53.766114+0000","last_active":"2024-08-18T23:56:58.793609+0000","last_peered":"2024-08-18T23:56:58.793609+0000","last_clean":"2024-08-18T23:56:58.793609+0000","last_became_active":"2024-08-18T23:56:53.765850+0000","last_became_peered":"2024-08-18T23:56:53.765850+0000","last_unstale":"2024-08-18T23:56:58.793609+0000","last_undegraded":"2024-08-18T23:56:58.793609+0000","last_fullsized":"2024-08-18T23:56:58.793609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147028+0000","last_change":"2024-08-18T23:56:52.759173+0000","last_active":"2024-08-18T23:56:59.147028+0000","last_peered":"2024-08-18T23:56:59.147028+0000","last_clean":"2024-08-18T23:56:59.147028+0000","last_became_active":"2024-08-18T23:56:52.758044+0000","last_became_peered":"2024-08-18T23:56:52.758044+0000","last_unstale":"2024-08-18T23:56:59.147028+0000","last_undegraded":"2024-08-18T23:56:59.147028+0000","last_fullsized":"2024-08-18T23:56:59.147028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:54.977859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147008+0000","last_change":"2024-08-18T23:56:57.804321+0000","last_active":"2024-08-18T23:56:59.147008+0000","last_peered":"2024-08-18T23:56:59.147008+0000","last_clean":"2024-08-18T23:56:59.147008+0000","last_became_active":"2024-08-18T23:56:57.803852+0000","last_became_peered":"2024-08-18T23:56:57.803852+0000","last_unstale":"2024-08-18T23:56:59.147008+0000","last_undegraded":"2024-08-18T23:56:59.147008+0000","last_fullsized":"2024-08-18T23:56:59.147008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145007+0000","last_change":"2024-08-18T23:56:53.768638+0000","last_active":"2024-08-18T23:56:59.145007+0000","last_peered":"2024-08-18T23:56:59.145007+0000","last_clean":"2024-08-18T23:56:59.145007+0000","last_became_active":"2024-08-18T23:56:53.768163+0000","last_became_peered":"2024-08-18T23:56:53.768163+0000","last_unstale":"2024-08-18T23:56:59.145007+0000","last_undegraded":"2024-08-18T23:56:59.145007+0000","last_fullsized":"2024-08-18T23:56:59.145007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:22.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146062+0000","last_change":"2024-08-18T23:56:52.752900+0000","last_active":"2024-08-18T23:56:59.146062+0000","last_peered":"2024-08-18T23:56:59.146062+0000","last_clean":"2024-08-18T23:56:59.146062+0000","last_became_active":"2024-08-18T23:56:52.752616+0000","last_became_peered":"2024-08-18T23:56:52.752616+0000","last_unstale":"2024-08-18T23:56:59.146062+0000","last_undegraded":"2024-08-18T23:56:59.146062+0000","last_fullsized":"2024-08-18T23:56:59.146062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146712+0000","last_change":"2024-08-18T23:56:57.795841+0000","last_active":"2024-08-18T23:56:59.146712+0000","last_peered":"2024-08-18T23:56:59.146712+0000","last_clean":"2024-08-18T23:56:59.146712+0000","last_became_active":"2024-08-18T23:56:57.795354+0000","last_became_peered":"2024-08-18T23:56:57.795354+0000","last_unstale":"2024-08-18T23:56:59.146712+0000","last_undegraded":"2024-08-18T23:56:59.146712+0000","last_fullsized":"2024-08-18T23:56:59.146712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:53.536907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145239+0000","last_change":"2024-08-18T23:56:53.771090+0000","last_active":"2024-08-18T23:56:59.145239+0000","last_peered":"2024-08-18T23:56:59.145239+0000","last_clean":"2024-08-18T23:56:59.145239+0000","last_became_active":"2024-08-18T23:56:53.770808+0000","last_became_peered":"2024-08-18T23:56:53.770808+0000","last_unstale":"2024-08-18T23:56:59.145239+0000","last_undegraded":"2024-08-18T23:56:59.145239+0000","last_fullsized":"2024-08-18T23:56:59.145239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145853+0000","last_change":"2024-08-18T23:56:52.754196+0000","last_active":"2024-08-18T23:56:59.145853+0000","last_peered":"2024-08-18T23:56:59.145853+0000","last_clean":"2024-08-18T23:56:59.145853+0000","last_became_active":"2024-08-18T23:56:52.753897+0000","last_became_peered":"2024-08-18T23:56:52.753897+0000","last_unstale":"2024-08-18T23:56:59.145853+0000","last_undegraded":"2024-08-18T23:56:59.145853+0000","last_fullsized":"2024-08-18T23:56:59.145853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:33:22.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145815+0000","last_change":"2024-08-18T23:56:57.981814+0000","last_active":"2024-08-18T23:56:59.145815+0000","last_peered":"2024-08-18T23:56:59.145815+0000","last_clean":"2024-08-18T23:56:59.145815+0000","last_became_active":"2024-08-18T23:56:57.981431+0000","last_became_peered":"2024-08-18T23:56:57.981431+0000","last_unstale":"2024-08-18T23:56:59.145815+0000","last_undegraded":"2024-08-18T23:56:59.145815+0000","last_fullsized":"2024-08-18T23:56:59.145815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145805+0000","last_change":"2024-08-18T23:56:53.767404+0000","last_active":"2024-08-18T23:56:59.145805+0000","last_peered":"2024-08-18T23:56:59.145805+0000","last_clean":"2024-08-18T23:56:59.145805+0000","last_became_active":"2024-08-18T23:56:53.764501+0000","last_became_peered":"2024-08-18T23:56:53.764501+0000","last_unstale":"2024-08-18T23:56:59.145805+0000","last_undegraded":"2024-08-18T23:56:59.145805+0000","last_fullsized":"2024-08-18T23:56:59.145805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:37.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147087+0000","last_change":"2024-08-18T23:56:52.759789+0000","last_active":"2024-08-18T23:56:59.147087+0000","last_peered":"2024-08-18T23:56:59.147087+0000","last_clean":"2024-08-18T23:56:59.147087+0000","last_became_active":"2024-08-18T23:56:52.758829+0000","last_became_peered":"2024-08-18T23:56:52.758829+0000","last_unstale":"2024-08-18T23:56:59.147087+0000","last_undegraded":"2024-08-18T23:56:59.147087+0000","last_fullsized":"2024-08-18T23:56:59.147087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:30.187935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146272+0000","last_change":"2024-08-18T23:56:57.801849+0000","last_active":"2024-08-18T23:56:59.146272+0000","last_peered":"2024-08-18T23:56:59.146272+0000","last_clean":"2024-08-18T23:56:59.146272+0000","last_became_active":"2024-08-18T23:56:57.801424+0000","last_became_peered":"2024-08-18T23:56:57.801424+0000","last_unstale":"2024-08-18T23:56:59.146272+0000","last_undegraded":"2024-08-18T23:56:59.146272+0000","last_fullsized":"2024-08-18T23:56:59.146272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:28.469431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796181+0000","last_change":"2024-08-18T23:56:53.769056+0000","last_active":"2024-08-18T23:56:58.796181+0000","last_peered":"2024-08-18T23:56:58.796181+0000","last_clean":"2024-08-18T23:56:58.796181+0000","last_became_active":"2024-08-18T23:56:53.768321+0000","last_became_peered":"2024-08-18T23:56:53.768321+0000","last_unstale":"2024-08-18T23:56:58.796181+0000","last_undegraded":"2024-08-18T23:56:58.796181+0000","last_fullsized":"2024-08-18T23:56:58.796181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794222+0000","last_change":"2024-08-18T23:56:52.755465+0000","last_active":"2024-08-18T23:56:58.794222+0000","last_peered":"2024-08-18T23:56:58.794222+0000","last_clean":"2024-08-18T23:56:58.794222+0000","last_became_active":"2024-08-18T23:56:52.755229+0000","last_became_peered":"2024-08-18T23:56:52.755229+0000","last_unstale":"2024-08-18T23:56:58.794222+0000","last_undegraded":"2024-08-18T23:56:58.794222+0000","last_fullsized":"2024-08-18T23:56:58.794222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145628+0000","last_change":"2024-08-18T23:56:57.986350+0000","last_active":"2024-08-18T23:56:59.145628+0000","last_peered":"2024-08-18T23:56:59.145628+0000","last_clean":"2024-08-18T23:56:59.145628+0000","last_became_active":"2024-08-18T23:56:57.985425+0000","last_became_peered":"2024-08-18T23:56:57.985425+0000","last_unstale":"2024-08-18T23:56:59.145628+0000","last_undegraded":"2024-08-18T23:56:59.145628+0000","last_fullsized":"2024-08-18T23:56:59.145628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:21.592416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145448+0000","last_change":"2024-08-18T23:56:53.768554+0000","last_active":"2024-08-18T23:56:59.145448+0000","last_peered":"2024-08-18T23:56:59.145448+0000","last_clean":"2024-08-18T23:56:59.145448+0000","last_became_active":"2024-08-18T23:56:53.767502+0000","last_became_peered":"2024-08-18T23:56:53.767502+0000","last_unstale":"2024-08-18T23:56:59.145448+0000","last_undegraded":"2024-08-18T23:56:59.145448+0000","last_fullsized":"2024-08-18T23:56:59.145448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145919+0000","last_change":"2024-08-18T23:56:52.742342+0000","last_active":"2024-08-18T23:56:59.145919+0000","last_peered":"2024-08-18T23:56:59.145919+0000","last_clean":"2024-08-18T23:56:59.145919+0000","last_became_active":"2024-08-18T23:56:52.741958+0000","last_became_peered":"2024-08-18T23:56:52.741958+0000","last_unstale":"2024-08-18T23:56:59.145919+0000","last_undegraded":"2024-08-18T23:56:59.145919+0000","last_fullsized":"2024-08-18T23:56:59.145919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144744+0000","last_change":"2024-08-18T23:56:57.982697+0000","last_active":"2024-08-18T23:56:59.144744+0000","last_peered":"2024-08-18T23:56:59.144744+0000","last_clean":"2024-08-18T23:56:59.144744+0000","last_became_active":"2024-08-18T23:56:57.981397+0000","last_became_peered":"2024-08-18T23:56:57.981397+0000","last_unstale":"2024-08-18T23:56:59.144744+0000","last_undegraded":"2024-08-18T23:56:59.144744+0000","last_fullsized":"2024-08-18T23:56:59.144744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:04.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145536+0000","last_change":"2024-08-18T23:56:53.764548+0000","last_active":"2024-08-18T23:56:59.145536+0000","last_peered":"2024-08-18T23:56:59.145536+0000","last_clean":"2024-08-18T23:56:59.145536+0000","last_became_active":"2024-08-18T23:56:53.764280+0000","last_became_peered":"2024-08-18T23:56:53.764280+0000","last_unstale":"2024-08-18T23:56:59.145536+0000","last_undegraded":"2024-08-18T23:56:59.145536+0000","last_fullsized":"2024-08-18T23:56:59.145536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147248+0000","last_change":"2024-08-18T23:56:52.759045+0000","last_active":"2024-08-18T23:56:59.147248+0000","last_peered":"2024-08-18T23:56:59.147248+0000","last_clean":"2024-08-18T23:56:59.147248+0000","last_became_active":"2024-08-18T23:56:52.758744+0000","last_became_peered":"2024-08-18T23:56:52.758744+0000","last_unstale":"2024-08-18T23:56:59.147248+0000","last_undegraded":"2024-08-18T23:56:59.147248+0000","last_fullsized":"2024-08-18T23:56:59.147248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:56.808416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795776+0000","last_change":"2024-08-18T23:56:57.984133+0000","last_active":"2024-08-18T23:56:58.795776+0000","last_peered":"2024-08-18T23:56:58.795776+0000","last_clean":"2024-08-18T23:56:58.795776+0000","last_became_active":"2024-08-18T23:56:57.983723+0000","last_became_peered":"2024-08-18T23:56:57.983723+0000","last_unstale":"2024-08-18T23:56:58.795776+0000","last_undegraded":"2024-08-18T23:56:58.795776+0000","last_fullsized":"2024-08-18T23:56:58.795776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147781+0000","last_change":"2024-08-18T23:56:53.771404+0000","last_active":"2024-08-18T23:56:59.147781+0000","last_peered":"2024-08-18T23:56:59.147781+0000","last_clean":"2024-08-18T23:56:59.147781+0000","last_became_active":"2024-08-18T23:56:53.771115+0000","last_became_peered":"2024-08-18T23:56:53.771115+0000","last_unstale":"2024-08-18T23:56:59.147781+0000","last_undegraded":"2024-08-18T23:56:59.147781+0000","last_fullsized":"2024-08-18T23:56:59.147781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:31.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145623+0000","last_change":"2024-08-18T23:56:52.755938+0000","last_active":"2024-08-18T23:56:59.145623+0000","last_peered":"2024-08-18T23:56:59.145623+0000","last_clean":"2024-08-18T23:56:59.145623+0000","last_became_active":"2024-08-18T23:56:52.755665+0000","last_became_peered":"2024-08-18T23:56:52.755665+0000","last_unstale":"2024-08-18T23:56:59.145623+0000","last_undegraded":"2024-08-18T23:56:59.145623+0000","last_fullsized":"2024-08-18T23:56:59.145623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:54.232884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145948+0000","last_change":"2024-08-18T23:56:57.800426+0000","last_active":"2024-08-18T23:56:59.145948+0000","last_peered":"2024-08-18T23:56:59.145948+0000","last_clean":"2024-08-18T23:56:59.145948+0000","last_became_active":"2024-08-18T23:56:57.800074+0000","last_became_peered":"2024-08-18T23:56:57.800074+0000","last_unstale":"2024-08-18T23:56:59.145948+0000","last_undegraded":"2024-08-18T23:56:59.145948+0000","last_fullsized":"2024-08-18T23:56:59.145948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:36.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146563+0000","last_change":"2024-08-18T23:56:53.766348+0000","last_active":"2024-08-18T23:56:59.146563+0000","last_peered":"2024-08-18T23:56:59.146563+0000","last_clean":"2024-08-18T23:56:59.146563+0000","last_became_active":"2024-08-18T23:56:53.765359+0000","last_became_peered":"2024-08-18T23:56:53.765359+0000","last_unstale":"2024-08-18T23:56:59.146563+0000","last_undegraded":"2024-08-18T23:56:59.146563+0000","last_fullsized":"2024-08-18T23:56:59.146563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:33:23.061905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147639+0000","last_change":"2024-08-18T23:56:52.753019+0000","last_active":"2024-08-18T23:56:59.147639+0000","last_peered":"2024-08-18T23:56:59.147639+0000","last_clean":"2024-08-18T23:56:59.147639+0000","last_became_active":"2024-08-18T23:56:52.752740+0000","last_became_peered":"2024-08-18T23:56:52.752740+0000","last_unstale":"2024-08-18T23:56:59.147639+0000","last_undegraded":"2024-08-18T23:56:59.147639+0000","last_fullsized":"2024-08-18T23:56:59.147639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145300+0000","last_change":"2024-08-18T23:56:57.798746+0000","last_active":"2024-08-18T23:56:59.145300+0000","last_peered":"2024-08-18T23:56:59.145300+0000","last_clean":"2024-08-18T23:56:59.145300+0000","last_became_active":"2024-08-18T23:56:57.798335+0000","last_became_peered":"2024-08-18T23:56:57.798335+0000","last_unstale":"2024-08-18T23:56:59.145300+0000","last_undegraded":"2024-08-18T23:56:59.145300+0000","last_fullsized":"2024-08-18T23:56:59.145300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145775+0000","last_change":"2024-08-18T23:56:53.761896+0000","last_active":"2024-08-18T23:56:59.145775+0000","last_peered":"2024-08-18T23:56:59.145775+0000","last_clean":"2024-08-18T23:56:59.145775+0000","last_became_active":"2024-08-18T23:56:53.761638+0000","last_became_peered":"2024-08-18T23:56:53.761638+0000","last_unstale":"2024-08-18T23:56:59.145775+0000","last_undegraded":"2024-08-18T23:56:59.145775+0000","last_fullsized":"2024-08-18T23:56:59.145775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794282+0000","last_change":"2024-08-18T23:56:52.761057+0000","last_active":"2024-08-18T23:56:58.794282+0000","last_peered":"2024-08-18T23:56:58.794282+0000","last_clean":"2024-08-18T23:56:58.794282+0000","last_became_active":"2024-08-18T23:56:52.760813+0000","last_became_peered":"2024-08-18T23:56:52.760813+0000","last_unstale":"2024-08-18T23:56:58.794282+0000","last_undegraded":"2024-08-18T23:56:58.794282+0000","last_fullsized":"2024-08-18T23:56:58.794282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145978+0000","last_change":"2024-08-18T23:56:57.799531+0000","last_active":"2024-08-18T23:56:59.145978+0000","last_peered":"2024-08-18T23:56:59.145978+0000","last_clean":"2024-08-18T23:56:59.145978+0000","last_became_active":"2024-08-18T23:56:57.798589+0000","last_became_peered":"2024-08-18T23:56:57.798589+0000","last_unstale":"2024-08-18T23:56:59.145978+0000","last_undegraded":"2024-08-18T23:56:59.145978+0000","last_fullsized":"2024-08-18T23:56:59.145978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:57.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795376+0000","last_change":"2024-08-18T23:56:53.773751+0000","last_active":"2024-08-18T23:56:58.795376+0000","last_peered":"2024-08-18T23:56:58.795376+0000","last_clean":"2024-08-18T23:56:58.795376+0000","last_became_active":"2024-08-18T23:56:53.769340+0000","last_became_peered":"2024-08-18T23:56:53.769340+0000","last_unstale":"2024-08-18T23:56:58.795376+0000","last_undegraded":"2024-08-18T23:56:58.795376+0000","last_fullsized":"2024-08-18T23:56:58.795376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:54.085641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147163+0000","last_change":"2024-08-18T23:56:52.759398+0000","last_active":"2024-08-18T23:56:59.147163+0000","last_peered":"2024-08-18T23:56:59.147163+0000","last_clean":"2024-08-18T23:56:59.147163+0000","last_became_active":"2024-08-18T23:56:52.758246+0000","last_became_peered":"2024-08-18T23:56:52.758246+0000","last_unstale":"2024-08-18T23:56:59.147163+0000","last_undegraded":"2024-08-18T23:56:59.147163+0000","last_fullsized":"2024-08-18T23:56:59.147163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:53.080654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796092+0000","last_change":"2024-08-18T23:56:57.985422+0000","last_active":"2024-08-18T23:56:58.796092+0000","last_peered":"2024-08-18T23:56:58.796092+0000","last_clean":"2024-08-18T23:56:58.796092+0000","last_became_active":"2024-08-18T23:56:57.984963+0000","last_became_peered":"2024-08-18T23:56:57.984963+0000","last_unstale":"2024-08-18T23:56:58.796092+0000","last_undegraded":"2024-08-18T23:56:58.796092+0000","last_fullsized":"2024-08-18T23:56:58.796092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.275461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144943+0000","last_change":"2024-08-18T23:56:53.766829+0000","last_active":"2024-08-18T23:56:59.144943+0000","last_peered":"2024-08-18T23:56:59.144943+0000","last_clean":"2024-08-18T23:56:59.144943+0000","last_became_active":"2024-08-18T23:56:53.766585+0000","last_became_peered":"2024-08-18T23:56:53.766585+0000","last_unstale":"2024-08-18T23:56:59.144943+0000","last_undegraded":"2024-08-18T23:56:59.144943+0000","last_fullsized":"2024-08-18T23:56:59.144943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146162+0000","last_change":"2024-08-18T23:56:52.749395+0000","last_active":"2024-08-18T23:56:59.146162+0000","last_peered":"2024-08-18T23:56:59.146162+0000","last_clean":"2024-08-18T23:56:59.146162+0000","last_became_active":"2024-08-18T23:56:52.749089+0000","last_became_peered":"2024-08-18T23:56:52.749089+0000","last_unstale":"2024-08-18T23:56:59.146162+0000","last_undegraded":"2024-08-18T23:56:59.146162+0000","last_fullsized":"2024-08-18T23:56:59.146162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147280+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:56:59.147280+0000","last_peered":"2024-08-18T23:56:59.147280+0000","last_clean":"2024-08-18T23:56:59.147280+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:56:59.147280+0000","last_undegraded":"2024-08-18T23:56:59.147280+0000","last_fullsized":"2024-08-18T23:56:59.147280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793760+0000","last_change":"2024-08-18T23:56:57.985242+0000","last_active":"2024-08-18T23:56:58.793760+0000","last_peered":"2024-08-18T23:56:58.793760+0000","last_clean":"2024-08-18T23:56:58.793760+0000","last_became_active":"2024-08-18T23:56:57.984868+0000","last_became_peered":"2024-08-18T23:56:57.984868+0000","last_unstale":"2024-08-18T23:56:58.793760+0000","last_undegraded":"2024-08-18T23:56:58.793760+0000","last_fullsized":"2024-08-18T23:56:58.793760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146556+0000","last_change":"2024-08-18T23:56:53.770252+0000","last_active":"2024-08-18T23:56:59.146556+0000","last_peered":"2024-08-18T23:56:59.146556+0000","last_clean":"2024-08-18T23:56:59.146556+0000","last_became_active":"2024-08-18T23:56:53.769985+0000","last_became_peered":"2024-08-18T23:56:53.769985+0000","last_unstale":"2024-08-18T23:56:59.146556+0000","last_undegraded":"2024-08-18T23:56:59.146556+0000","last_fullsized":"2024-08-18T23:56:59.146556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:53.459015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794847+0000","last_change":"2024-08-18T23:56:52.753918+0000","last_active":"2024-08-18T23:56:58.794847+0000","last_peered":"2024-08-18T23:56:58.794847+0000","last_clean":"2024-08-18T23:56:58.794847+0000","last_became_active":"2024-08-18T23:56:52.753634+0000","last_became_peered":"2024-08-18T23:56:52.753634+0000","last_unstale":"2024-08-18T23:56:58.794847+0000","last_undegraded":"2024-08-18T23:56:58.794847+0000","last_fullsized":"2024-08-18T23:56:58.794847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793607+0000","last_change":"2024-08-18T23:56:57.981987+0000","last_active":"2024-08-18T23:56:58.793607+0000","last_peered":"2024-08-18T23:56:58.793607+0000","last_clean":"2024-08-18T23:56:58.793607+0000","last_became_active":"2024-08-18T23:56:57.981487+0000","last_became_peered":"2024-08-18T23:56:57.981487+0000","last_unstale":"2024-08-18T23:56:58.793607+0000","last_undegraded":"2024-08-18T23:56:58.793607+0000","last_fullsized":"2024-08-18T23:56:58.793607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147493+0000","last_change":"2024-08-18T23:56:53.775056+0000","last_active":"2024-08-18T23:56:59.147493+0000","last_peered":"2024-08-18T23:56:59.147493+0000","last_clean":"2024-08-18T23:56:59.147493+0000","last_became_active":"2024-08-18T23:56:53.772898+0000","last_became_peered":"2024-08-18T23:56:53.772898+0000","last_unstale":"2024-08-18T23:56:59.147493+0000","last_undegraded":"2024-08-18T23:56:59.147493+0000","last_fullsized":"2024-08-18T23:56:59.147493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145727+0000","last_change":"2024-08-18T23:56:52.753178+0000","last_active":"2024-08-18T23:56:59.145727+0000","last_peered":"2024-08-18T23:56:59.145727+0000","last_clean":"2024-08-18T23:56:59.145727+0000","last_became_active":"2024-08-18T23:56:52.752810+0000","last_became_peered":"2024-08-18T23:56:52.752810+0000","last_unstale":"2024-08-18T23:56:59.145727+0000","last_undegraded":"2024-08-18T23:56:59.145727+0000","last_fullsized":"2024-08-18T23:56:59.145727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795903+0000","last_change":"2024-08-18T23:56:57.796078+0000","last_active":"2024-08-18T23:56:58.795903+0000","last_peered":"2024-08-18T23:56:58.795903+0000","last_clean":"2024-08-18T23:56:58.795903+0000","last_became_active":"2024-08-18T23:56:57.795669+0000","last_became_peered":"2024-08-18T23:56:57.795669+0000","last_unstale":"2024-08-18T23:56:58.795903+0000","last_undegraded":"2024-08-18T23:56:58.795903+0000","last_fullsized":"2024-08-18T23:56:58.795903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:36.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146826+0000","last_change":"2024-08-18T23:56:53.769692+0000","last_active":"2024-08-18T23:56:59.146826+0000","last_peered":"2024-08-18T23:56:59.146826+0000","last_clean":"2024-08-18T23:56:59.146826+0000","last_became_active":"2024-08-18T23:56:53.768418+0000","last_became_peered":"2024-08-18T23:56:53.768418+0000","last_unstale":"2024-08-18T23:56:59.146826+0000","last_undegraded":"2024-08-18T23:56:59.146826+0000","last_fullsized":"2024-08-18T23:56:59.146826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:06.397680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794421+0000","last_change":"2024-08-18T23:56:52.756405+0000","last_active":"2024-08-18T23:56:58.794421+0000","last_peered":"2024-08-18T23:56:58.794421+0000","last_clean":"2024-08-18T23:56:58.794421+0000","last_became_active":"2024-08-18T23:56:52.756101+0000","last_became_peered":"2024-08-18T23:56:52.756101+0000","last_unstale":"2024-08-18T23:56:58.794421+0000","last_undegraded":"2024-08-18T23:56:58.794421+0000","last_fullsized":"2024-08-18T23:56:58.794421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145551+0000","last_change":"2024-08-18T23:56:57.984658+0000","last_active":"2024-08-18T23:56:59.145551+0000","last_peered":"2024-08-18T23:56:59.145551+0000","last_clean":"2024-08-18T23:56:59.145551+0000","last_became_active":"2024-08-18T23:56:57.984250+0000","last_became_peered":"2024-08-18T23:56:57.984250+0000","last_unstale":"2024-08-18T23:56:59.145551+0000","last_undegraded":"2024-08-18T23:56:59.145551+0000","last_fullsized":"2024-08-18T23:56:59.145551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:45.358309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146315+0000","last_change":"2024-08-18T23:56:53.764626+0000","last_active":"2024-08-18T23:56:59.146315+0000","last_peered":"2024-08-18T23:56:59.146315+0000","last_clean":"2024-08-18T23:56:59.146315+0000","last_became_active":"2024-08-18T23:56:53.764329+0000","last_became_peered":"2024-08-18T23:56:53.764329+0000","last_unstale":"2024-08-18T23:56:59.146315+0000","last_undegraded":"2024-08-18T23:56:59.146315+0000","last_fullsized":"2024-08-18T23:56:59.146315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:16.778909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146458+0000","last_change":"2024-08-18T23:56:52.756222+0000","last_active":"2024-08-18T23:56:59.146458+0000","last_peered":"2024-08-18T23:56:59.146458+0000","last_clean":"2024-08-18T23:56:59.146458+0000","last_became_active":"2024-08-18T23:56:52.755983+0000","last_became_peered":"2024-08-18T23:56:52.755983+0000","last_unstale":"2024-08-18T23:56:59.146458+0000","last_undegraded":"2024-08-18T23:56:59.146458+0000","last_fullsized":"2024-08-18T23:56:59.146458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:43:40.687385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145369+0000","last_change":"2024-08-18T23:56:57.797013+0000","last_active":"2024-08-18T23:56:59.145369+0000","last_peered":"2024-08-18T23:56:59.145369+0000","last_clean":"2024-08-18T23:56:59.145369+0000","last_became_active":"2024-08-18T23:56:57.796588+0000","last_became_peered":"2024-08-18T23:56:57.796588+0000","last_unstale":"2024-08-18T23:56:59.145369+0000","last_undegraded":"2024-08-18T23:56:59.145369+0000","last_fullsized":"2024-08-18T23:56:59.145369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:01.094119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146228+0000","last_change":"2024-08-18T23:56:53.769197+0000","last_active":"2024-08-18T23:56:59.146228+0000","last_peered":"2024-08-18T23:56:59.146228+0000","last_clean":"2024-08-18T23:56:59.146228+0000","last_became_active":"2024-08-18T23:56:53.768715+0000","last_became_peered":"2024-08-18T23:56:53.768715+0000","last_unstale":"2024-08-18T23:56:59.146228+0000","last_undegraded":"2024-08-18T23:56:59.146228+0000","last_fullsized":"2024-08-18T23:56:59.146228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:57.104014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794086+0000","last_change":"2024-08-18T23:56:52.756491+0000","last_active":"2024-08-18T23:56:58.794086+0000","last_peered":"2024-08-18T23:56:58.794086+0000","last_clean":"2024-08-18T23:56:58.794086+0000","last_became_active":"2024-08-18T23:56:52.756158+0000","last_became_peered":"2024-08-18T23:56:52.756158+0000","last_unstale":"2024-08-18T23:56:58.794086+0000","last_undegraded":"2024-08-18T23:56:58.794086+0000","last_fullsized":"2024-08-18T23:56:58.794086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:31.503425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795726+0000","last_change":"2024-08-18T23:56:57.796919+0000","last_active":"2024-08-18T23:56:58.795726+0000","last_peered":"2024-08-18T23:56:58.795726+0000","last_clean":"2024-08-18T23:56:58.795726+0000","last_became_active":"2024-08-18T23:56:57.796482+0000","last_became_peered":"2024-08-18T23:56:57.796482+0000","last_unstale":"2024-08-18T23:56:58.795726+0000","last_undegraded":"2024-08-18T23:56:58.795726+0000","last_fullsized":"2024-08-18T23:56:58.795726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:57.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793669+0000","last_change":"2024-08-18T23:56:53.762288+0000","last_active":"2024-08-18T23:56:58.793669+0000","last_peered":"2024-08-18T23:56:58.793669+0000","last_clean":"2024-08-18T23:56:58.793669+0000","last_became_active":"2024-08-18T23:56:53.762007+0000","last_became_peered":"2024-08-18T23:56:53.762007+0000","last_unstale":"2024-08-18T23:56:58.793669+0000","last_undegraded":"2024-08-18T23:56:58.793669+0000","last_fullsized":"2024-08-18T23:56:58.793669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793757+0000","last_change":"2024-08-18T23:56:52.748797+0000","last_active":"2024-08-18T23:56:58.793757+0000","last_peered":"2024-08-18T23:56:58.793757+0000","last_clean":"2024-08-18T23:56:58.793757+0000","last_became_active":"2024-08-18T23:56:52.747807+0000","last_became_peered":"2024-08-18T23:56:52.747807+0000","last_unstale":"2024-08-18T23:56:58.793757+0000","last_undegraded":"2024-08-18T23:56:58.793757+0000","last_fullsized":"2024-08-18T23:56:58.793757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145359+0000","last_change":"2024-08-18T23:56:57.985530+0000","last_active":"2024-08-18T23:56:59.145359+0000","last_peered":"2024-08-18T23:56:59.145359+0000","last_clean":"2024-08-18T23:56:59.145359+0000","last_became_active":"2024-08-18T23:56:57.985049+0000","last_became_peered":"2024-08-18T23:56:57.985049+0000","last_unstale":"2024-08-18T23:56:59.145359+0000","last_undegraded":"2024-08-18T23:56:59.145359+0000","last_fullsized":"2024-08-18T23:56:59.145359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:31.882944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146550+0000","last_change":"2024-08-18T23:56:53.769503+0000","last_active":"2024-08-18T23:56:59.146550+0000","last_peered":"2024-08-18T23:56:59.146550+0000","last_clean":"2024-08-18T23:56:59.146550+0000","last_became_active":"2024-08-18T23:56:53.768768+0000","last_became_peered":"2024-08-18T23:56:53.768768+0000","last_unstale":"2024-08-18T23:56:59.146550+0000","last_undegraded":"2024-08-18T23:56:59.146550+0000","last_fullsized":"2024-08-18T23:56:59.146550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:31.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147504+0000","last_change":"2024-08-18T23:56:52.752031+0000","last_active":"2024-08-18T23:56:59.147504+0000","last_peered":"2024-08-18T23:56:59.147504+0000","last_clean":"2024-08-18T23:56:59.147504+0000","last_became_active":"2024-08-18T23:56:52.751751+0000","last_became_peered":"2024-08-18T23:56:52.751751+0000","last_unstale":"2024-08-18T23:56:59.147504+0000","last_undegraded":"2024-08-18T23:56:59.147504+0000","last_fullsized":"2024-08-18T23:56:59.147504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145177+0000","last_change":"2024-08-18T23:56:57.981834+0000","last_active":"2024-08-18T23:56:59.145177+0000","last_peered":"2024-08-18T23:56:59.145177+0000","last_clean":"2024-08-18T23:56:59.145177+0000","last_became_active":"2024-08-18T23:56:57.981436+0000","last_became_peered":"2024-08-18T23:56:57.981436+0000","last_unstale":"2024-08-18T23:56:59.145177+0000","last_undegraded":"2024-08-18T23:56:59.145177+0000","last_fullsized":"2024-08-18T23:56:59.145177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:26.326851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795759+0000","last_change":"2024-08-18T23:56:53.767263+0000","last_active":"2024-08-18T23:56:58.795759+0000","last_peered":"2024-08-18T23:56:58.795759+0000","last_clean":"2024-08-18T23:56:58.795759+0000","last_became_active":"2024-08-18T23:56:53.763206+0000","last_became_peered":"2024-08-18T23:56:53.763206+0000","last_unstale":"2024-08-18T23:56:58.795759+0000","last_undegraded":"2024-08-18T23:56:58.795759+0000","last_fullsized":"2024-08-18T23:56:58.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:55.982846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796033+0000","last_change":"2024-08-18T23:56:52.755349+0000","last_active":"2024-08-18T23:56:58.796033+0000","last_peered":"2024-08-18T23:56:58.796033+0000","last_clean":"2024-08-18T23:56:58.796033+0000","last_became_active":"2024-08-18T23:56:52.755083+0000","last_became_peered":"2024-08-18T23:56:52.755083+0000","last_unstale":"2024-08-18T23:56:58.796033+0000","last_undegraded":"2024-08-18T23:56:58.796033+0000","last_fullsized":"2024-08-18T23:56:58.796033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:21.056208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147710+0000","last_change":"2024-08-18T23:56:57.982048+0000","last_active":"2024-08-18T23:56:59.147710+0000","last_peered":"2024-08-18T23:56:59.147710+0000","last_clean":"2024-08-18T23:56:59.147710+0000","last_became_active":"2024-08-18T23:56:57.981629+0000","last_became_peered":"2024-08-18T23:56:57.981629+0000","last_unstale":"2024-08-18T23:56:59.147710+0000","last_undegraded":"2024-08-18T23:56:59.147710+0000","last_fullsized":"2024-08-18T23:56:59.147710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:10.436357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146447+0000","last_change":"2024-08-18T23:56:53.769453+0000","last_active":"2024-08-18T23:56:59.146447+0000","last_peered":"2024-08-18T23:56:59.146447+0000","last_clean":"2024-08-18T23:56:59.146447+0000","last_became_active":"2024-08-18T23:56:53.768971+0000","last_became_peered":"2024-08-18T23:56:53.768971+0000","last_unstale":"2024-08-18T23:56:59.146447+0000","last_undegraded":"2024-08-18T23:56:59.146447+0000","last_fullsized":"2024-08-18T23:56:59.146447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:18.236785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:57:03.095757+0000","last_change":"2024-08-18T23:56:52.742740+0000","last_active":"2024-08-18T23:57:03.095757+0000","last_peered":"2024-08-18T23:57:03.095757+0000","last_clean":"2024-08-18T23:57:03.095757+0000","last_became_active":"2024-08-18T23:56:52.742250+0000","last_became_peered":"2024-08-18T23:56:52.742250+0000","last_unstale":"2024-08-18T23:57:03.095757+0000","last_undegraded":"2024-08-18T23:57:03.095757+0000","last_fullsized":"2024-08-18T23:57:03.095757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145905+0000","last_change":"2024-08-18T23:56:57.796638+0000","last_active":"2024-08-18T23:56:59.145905+0000","last_peered":"2024-08-18T23:56:59.145905+0000","last_clean":"2024-08-18T23:56:59.145905+0000","last_became_active":"2024-08-18T23:56:57.796223+0000","last_became_peered":"2024-08-18T23:56:57.796223+0000","last_unstale":"2024-08-18T23:56:59.145905+0000","last_undegraded":"2024-08-18T23:56:59.145905+0000","last_fullsized":"2024-08-18T23:56:59.145905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146813+0000","last_change":"2024-08-18T23:56:53.766948+0000","last_active":"2024-08-18T23:56:59.146813+0000","last_peered":"2024-08-18T23:56:59.146813+0000","last_clean":"2024-08-18T23:56:59.146813+0000","last_became_active":"2024-08-18T23:56:53.766437+0000","last_became_peered":"2024-08-18T23:56:53.766437+0000","last_unstale":"2024-08-18T23:56:59.146813+0000","last_undegraded":"2024-08-18T23:56:59.146813+0000","last_fullsized":"2024-08-18T23:56:59.146813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:12.823198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145614+0000","last_change":"2024-08-18T23:56:52.752268+0000","last_active":"2024-08-18T23:56:59.145614+0000","last_peered":"2024-08-18T23:56:59.145614+0000","last_clean":"2024-08-18T23:56:59.145614+0000","last_became_active":"2024-08-18T23:56:52.751988+0000","last_became_peered":"2024-08-18T23:56:52.751988+0000","last_unstale":"2024-08-18T23:56:59.145614+0000","last_undegraded":"2024-08-18T23:56:59.145614+0000","last_fullsized":"2024-08-18T23:56:59.145614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146117+0000","last_change":"2024-08-18T23:56:57.795578+0000","last_active":"2024-08-18T23:56:59.146117+0000","last_peered":"2024-08-18T23:56:59.146117+0000","last_clean":"2024-08-18T23:56:59.146117+0000","last_became_active":"2024-08-18T23:56:57.795182+0000","last_became_peered":"2024-08-18T23:56:57.795182+0000","last_unstale":"2024-08-18T23:56:59.146117+0000","last_undegraded":"2024-08-18T23:56:59.146117+0000","last_fullsized":"2024-08-18T23:56:59.146117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:28.122472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796078+0000","last_change":"2024-08-18T23:56:53.773616+0000","last_active":"2024-08-18T23:56:58.796078+0000","last_peered":"2024-08-18T23:56:58.796078+0000","last_clean":"2024-08-18T23:56:58.796078+0000","last_became_active":"2024-08-18T23:56:53.773129+0000","last_became_peered":"2024-08-18T23:56:53.773129+0000","last_unstale":"2024-08-18T23:56:58.796078+0000","last_undegraded":"2024-08-18T23:56:58.796078+0000","last_fullsized":"2024-08-18T23:56:58.796078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146443+0000","last_change":"2024-08-18T23:56:52.744917+0000","last_active":"2024-08-18T23:56:59.146443+0000","last_peered":"2024-08-18T23:56:59.146443+0000","last_clean":"2024-08-18T23:56:59.146443+0000","last_became_active":"2024-08-18T23:56:52.744638+0000","last_became_peered":"2024-08-18T23:56:52.744638+0000","last_unstale":"2024-08-18T23:56:59.146443+0000","last_undegraded":"2024-08-18T23:56:59.146443+0000","last_fullsized":"2024-08-18T23:56:59.146443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144951+0000","last_change":"2024-08-18T23:56:57.794782+0000","last_active":"2024-08-18T23:56:59.144951+0000","last_peered":"2024-08-18T23:56:59.144951+0000","last_clean":"2024-08-18T23:56:59.144951+0000","last_became_active":"2024-08-18T23:56:57.794392+0000","last_became_peered":"2024-08-18T23:56:57.794392+0000","last_unstale":"2024-08-18T23:56:59.144951+0000","last_undegraded":"2024-08-18T23:56:59.144951+0000","last_fullsized":"2024-08-18T23:56:59.144951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:47.357886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146347+0000","last_change":"2024-08-18T23:56:53.774590+0000","last_active":"2024-08-18T23:56:59.146347+0000","last_peered":"2024-08-18T23:56:59.146347+0000","last_clean":"2024-08-18T23:56:59.146347+0000","last_became_active":"2024-08-18T23:56:53.774302+0000","last_became_peered":"2024-08-18T23:56:53.774302+0000","last_unstale":"2024-08-18T23:56:59.146347+0000","last_undegraded":"2024-08-18T23:56:59.146347+0000","last_fullsized":"2024-08-18T23:56:59.146347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793992+0000","last_change":"2024-08-18T23:56:52.750383+0000","last_active":"2024-08-18T23:56:58.793992+0000","last_peered":"2024-08-18T23:56:58.793992+0000","last_clean":"2024-08-18T23:56:58.793992+0000","last_became_active":"2024-08-18T23:56:52.750095+0000","last_became_peered":"2024-08-18T23:56:52.750095+0000","last_unstale":"2024-08-18T23:56:58.793992+0000","last_undegraded":"2024-08-18T23:56:58.793992+0000","last_fullsized":"2024-08-18T23:56:58.793992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144880+0000","last_change":"2024-08-18T23:56:57.982444+0000","last_active":"2024-08-18T23:56:59.144880+0000","last_peered":"2024-08-18T23:56:59.144880+0000","last_clean":"2024-08-18T23:56:59.144880+0000","last_became_active":"2024-08-18T23:56:57.982080+0000","last_became_peered":"2024-08-18T23:56:57.982080+0000","last_unstale":"2024-08-18T23:56:59.144880+0000","last_undegraded":"2024-08-18T23:56:59.144880+0000","last_fullsized":"2024-08-18T23:56:59.144880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:46:30.528419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795672+0000","last_change":"2024-08-18T23:56:57.984231+0000","last_active":"2024-08-18T23:56:58.795672+0000","last_peered":"2024-08-18T23:56:58.795672+0000","last_clean":"2024-08-18T23:56:58.795672+0000","last_became_active":"2024-08-18T23:56:57.983816+0000","last_became_peered":"2024-08-18T23:56:57.983816+0000","last_unstale":"2024-08-18T23:56:58.795672+0000","last_undegraded":"2024-08-18T23:56:58.795672+0000","last_fullsized":"2024-08-18T23:56:58.795672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145512+0000","last_change":"2024-08-18T23:56:53.765456+0000","last_active":"2024-08-18T23:56:59.145512+0000","last_peered":"2024-08-18T23:56:59.145512+0000","last_clean":"2024-08-18T23:56:59.145512+0000","last_became_active":"2024-08-18T23:56:53.765209+0000","last_became_peered":"2024-08-18T23:56:53.765209+0000","last_unstale":"2024-08-18T23:56:59.145512+0000","last_undegraded":"2024-08-18T23:56:59.145512+0000","last_fullsized":"2024-08-18T23:56:59.145512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145778+0000","last_change":"2024-08-18T23:56:52.746017+0000","last_active":"2024-08-18T23:56:59.145778+0000","last_peered":"2024-08-18T23:56:59.145778+0000","last_clean":"2024-08-18T23:56:59.145778+0000","last_became_active":"2024-08-18T23:56:52.745758+0000","last_became_peered":"2024-08-18T23:56:52.745758+0000","last_unstale":"2024-08-18T23:56:59.145778+0000","last_undegraded":"2024-08-18T23:56:59.145778+0000","last_fullsized":"2024-08-18T23:56:59.145778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794035+0000","last_change":"2024-08-18T23:56:57.797625+0000","last_active":"2024-08-18T23:56:58.794035+0000","last_peered":"2024-08-18T23:56:58.794035+0000","last_clean":"2024-08-18T23:56:58.794035+0000","last_became_active":"2024-08-18T23:56:57.797212+0000","last_became_peered":"2024-08-18T23:56:57.797212+0000","last_unstale":"2024-08-18T23:56:58.794035+0000","last_undegraded":"2024-08-18T23:56:58.794035+0000","last_fullsized":"2024-08-18T23:56:58.794035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145996+0000","last_change":"2024-08-18T23:56:53.770813+0000","last_active":"2024-08-18T23:56:59.145996+0000","last_peered":"2024-08-18T23:56:59.145996+0000","last_clean":"2024-08-18T23:56:59.145996+0000","last_became_active":"2024-08-18T23:56:53.770418+0000","last_became_peered":"2024-08-18T23:56:53.770418+0000","last_unstale":"2024-08-18T23:56:59.145996+0000","last_undegraded":"2024-08-18T23:56:59.145996+0000","last_fullsized":"2024-08-18T23:56:59.145996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145393+0000","last_change":"2024-08-18T23:56:52.749549+0000","last_active":"2024-08-18T23:56:59.145393+0000","last_peered":"2024-08-18T23:56:59.145393+0000","last_clean":"2024-08-18T23:56:59.145393+0000","last_became_active":"2024-08-18T23:56:52.749241+0000","last_became_peered":"2024-08-18T23:56:52.749241+0000","last_unstale":"2024-08-18T23:56:59.145393+0000","last_undegraded":"2024-08-18T23:56:59.145393+0000","last_fullsized":"2024-08-18T23:56:59.145393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:10:48.081149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793835+0000","last_change":"2024-08-18T23:56:52.748476+0000","last_active":"2024-08-18T23:56:58.793835+0000","last_peered":"2024-08-18T23:56:58.793835+0000","last_clean":"2024-08-18T23:56:58.793835+0000","last_became_active":"2024-08-18T23:56:52.748086+0000","last_became_peered":"2024-08-18T23:56:52.748086+0000","last_unstale":"2024-08-18T23:56:58.793835+0000","last_undegraded":"2024-08-18T23:56:58.793835+0000","last_fullsized":"2024-08-18T23:56:58.793835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796022+0000","last_change":"2024-08-18T23:56:53.769482+0000","last_active":"2024-08-18T23:56:58.796022+0000","last_peered":"2024-08-18T23:56:58.796022+0000","last_clean":"2024-08-18T23:56:58.796022+0000","last_became_active":"2024-08-18T23:56:53.769011+0000","last_became_peered":"2024-08-18T23:56:53.769011+0000","last_unstale":"2024-08-18T23:56:58.796022+0000","last_undegraded":"2024-08-18T23:56:58.796022+0000","last_fullsized":"2024-08-18T23:56:58.796022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794765+0000","last_change":"2024-08-18T23:56:57.794273+0000","last_active":"2024-08-18T23:56:58.794765+0000","last_peered":"2024-08-18T23:56:58.794765+0000","last_clean":"2024-08-18T23:56:58.794765+0000","last_became_active":"2024-08-18T23:56:57.793881+0000","last_became_peered":"2024-08-18T23:56:57.793881+0000","last_unstale":"2024-08-18T23:56:58.794765+0000","last_undegraded":"2024-08-18T23:56:58.794765+0000","last_fullsized":"2024-08-18T23:56:58.794765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:35.231599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145044+0000","last_change":"2024-08-18T23:56:52.758361+0000","last_active":"2024-08-18T23:56:59.145044+0000","last_peered":"2024-08-18T23:56:59.145044+0000","last_clean":"2024-08-18T23:56:59.145044+0000","last_became_active":"2024-08-18T23:56:52.758061+0000","last_became_peered":"2024-08-18T23:56:52.758061+0000","last_unstale":"2024-08-18T23:56:59.145044+0000","last_undegraded":"2024-08-18T23:56:59.145044+0000","last_fullsized":"2024-08-18T23:56:59.145044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:31.503425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145753+0000","last_change":"2024-08-18T23:56:53.772935+0000","last_active":"2024-08-18T23:56:59.145753+0000","last_peered":"2024-08-18T23:56:59.145753+0000","last_clean":"2024-08-18T23:56:59.145753+0000","last_became_active":"2024-08-18T23:56:53.772663+0000","last_became_peered":"2024-08-18T23:56:53.772663+0000","last_unstale":"2024-08-18T23:56:59.145753+0000","last_undegraded":"2024-08-18T23:56:59.145753+0000","last_fullsized":"2024-08-18T23:56:59.145753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:17.271839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145518+0000","last_change":"2024-08-18T23:56:57.796804+0000","last_active":"2024-08-18T23:56:59.145518+0000","last_peered":"2024-08-18T23:56:59.145518+0000","last_clean":"2024-08-18T23:56:59.145518+0000","last_became_active":"2024-08-18T23:56:57.796403+0000","last_became_peered":"2024-08-18T23:56:57.796403+0000","last_unstale":"2024-08-18T23:56:59.145518+0000","last_undegraded":"2024-08-18T23:56:59.145518+0000","last_fullsized":"2024-08-18T23:56:59.145518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:52.440154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793982+0000","last_change":"2024-08-18T23:56:53.762460+0000","last_active":"2024-08-18T23:56:58.793982+0000","last_peered":"2024-08-18T23:56:58.793982+0000","last_clean":"2024-08-18T23:56:58.793982+0000","last_became_active":"2024-08-18T23:56:53.762178+0000","last_became_peered":"2024-08-18T23:56:53.762178+0000","last_unstale":"2024-08-18T23:56:58.793982+0000","last_undegraded":"2024-08-18T23:56:58.793982+0000","last_fullsized":"2024-08-18T23:56:58.793982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794237+0000","last_change":"2024-08-18T23:56:53.764382+0000","last_active":"2024-08-18T23:56:58.794237+0000","last_peered":"2024-08-18T23:56:58.794237+0000","last_clean":"2024-08-18T23:56:58.794237+0000","last_became_active":"2024-08-18T23:56:53.764101+0000","last_became_peered":"2024-08-18T23:56:53.764101+0000","last_unstale":"2024-08-18T23:56:58.794237+0000","last_undegraded":"2024-08-18T23:56:58.794237+0000","last_fullsized":"2024-08-18T23:56:58.794237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:55.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147476+0000","last_change":"2024-08-18T23:56:53.775607+0000","last_active":"2024-08-18T23:56:59.147476+0000","last_peered":"2024-08-18T23:56:59.147476+0000","last_clean":"2024-08-18T23:56:59.147476+0000","last_became_active":"2024-08-18T23:56:53.775349+0000","last_became_peered":"2024-08-18T23:56:53.775349+0000","last_unstale":"2024-08-18T23:56:59.147476+0000","last_undegraded":"2024-08-18T23:56:59.147476+0000","last_fullsized":"2024-08-18T23:56:59.147476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:49.498231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795886+0000","last_change":"2024-08-18T23:56:53.767511+0000","last_active":"2024-08-18T23:56:58.795886+0000","last_peered":"2024-08-18T23:56:58.795886+0000","last_clean":"2024-08-18T23:56:58.795886+0000","last_became_active":"2024-08-18T23:56:53.762845+0000","last_became_peered":"2024-08-18T23:56:53.762845+0000","last_unstale":"2024-08-18T23:56:58.795886+0000","last_undegraded":"2024-08-18T23:56:58.795886+0000","last_fullsized":"2024-08-18T23:56:58.795886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145268+0000","last_change":"2024-08-18T23:56:53.764036+0000","last_active":"2024-08-18T23:56:59.145268+0000","last_peered":"2024-08-18T23:56:59.145268+0000","last_clean":"2024-08-18T23:56:59.145268+0000","last_became_active":"2024-08-18T23:56:53.763734+0000","last_became_peered":"2024-08-18T23:56:53.763734+0000","last_unstale":"2024-08-18T23:56:59.145268+0000","last_undegraded":"2024-08-18T23:56:59.145268+0000","last_fullsized":"2024-08-18T23:56:59.145268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:24.083795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145438+0000","last_change":"2024-08-18T23:56:53.766271+0000","last_active":"2024-08-18T23:56:59.145438+0000","last_peered":"2024-08-18T23:56:59.145438+0000","last_clean":"2024-08-18T23:56:59.145438+0000","last_became_active":"2024-08-18T23:56:53.766022+0000","last_became_peered":"2024-08-18T23:56:53.766022+0000","last_unstale":"2024-08-18T23:56:59.145438+0000","last_undegraded":"2024-08-18T23:56:59.145438+0000","last_fullsized":"2024-08-18T23:56:59.145438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794419+0000","last_change":"2024-08-18T23:56:53.759600+0000","last_active":"2024-08-18T23:56:58.794419+0000","last_peered":"2024-08-18T23:56:58.794419+0000","last_clean":"2024-08-18T23:56:58.794419+0000","last_became_active":"2024-08-18T23:56:53.759294+0000","last_became_peered":"2024-08-18T23:56:53.759294+0000","last_unstale":"2024-08-18T23:56:58.794419+0000","last_undegraded":"2024-08-18T23:56:58.794419+0000","last_fullsized":"2024-08-18T23:56:58.794419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145362+0000","last_change":"2024-08-18T23:56:53.764119+0000","last_active":"2024-08-18T23:56:59.145362+0000","last_peered":"2024-08-18T23:56:59.145362+0000","last_clean":"2024-08-18T23:56:59.145362+0000","last_became_active":"2024-08-18T23:56:53.763804+0000","last_became_peered":"2024-08-18T23:56:53.763804+0000","last_unstale":"2024-08-18T23:56:59.145362+0000","last_undegraded":"2024-08-18T23:56:59.145362+0000","last_fullsized":"2024-08-18T23:56:59.145362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:49.498231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145653+0000","last_change":"2024-08-18T23:56:53.770463+0000","last_active":"2024-08-18T23:56:59.145653+0000","last_peered":"2024-08-18T23:56:59.145653+0000","last_clean":"2024-08-18T23:56:59.145653+0000","last_became_active":"2024-08-18T23:56:53.768044+0000","last_became_peered":"2024-08-18T23:56:53.768044+0000","last_unstale":"2024-08-18T23:56:59.145653+0000","last_undegraded":"2024-08-18T23:56:59.145653+0000","last_fullsized":"2024-08-18T23:56:59.145653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145134+0000","last_change":"2024-08-18T23:56:53.764055+0000","last_active":"2024-08-18T23:56:59.145134+0000","last_peered":"2024-08-18T23:56:59.145134+0000","last_clean":"2024-08-18T23:56:59.145134+0000","last_became_active":"2024-08-18T23:56:53.763760+0000","last_became_peered":"2024-08-18T23:56:53.763760+0000","last_unstale":"2024-08-18T23:56:59.145134+0000","last_undegraded":"2024-08-18T23:56:59.145134+0000","last_fullsized":"2024-08-18T23:56:59.145134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147400+0000","last_change":"2024-08-18T23:56:53.769367+0000","last_active":"2024-08-18T23:56:59.147400+0000","last_peered":"2024-08-18T23:56:59.147400+0000","last_clean":"2024-08-18T23:56:59.147400+0000","last_became_active":"2024-08-18T23:56:53.767443+0000","last_became_peered":"2024-08-18T23:56:53.767443+0000","last_unstale":"2024-08-18T23:56:59.147400+0000","last_undegraded":"2024-08-18T23:56:59.147400+0000","last_fullsized":"2024-08-18T23:56:59.147400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:24.083795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795708+0000","last_change":"2024-08-18T23:56:53.762405+0000","last_active":"2024-08-18T23:56:58.795708+0000","last_peered":"2024-08-18T23:56:58.795708+0000","last_clean":"2024-08-18T23:56:58.795708+0000","last_became_active":"2024-08-18T23:56:53.761768+0000","last_became_peered":"2024-08-18T23:56:53.761768+0000","last_unstale":"2024-08-18T23:56:58.795708+0000","last_undegraded":"2024-08-18T23:56:58.795708+0000","last_fullsized":"2024-08-18T23:56:58.795708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793905+0000","last_change":"2024-08-18T23:56:53.766982+0000","last_active":"2024-08-18T23:56:58.793905+0000","last_peered":"2024-08-18T23:56:58.793905+0000","last_clean":"2024-08-18T23:56:58.793905+0000","last_became_active":"2024-08-18T23:56:53.766519+0000","last_became_peered":"2024-08-18T23:56:53.766519+0000","last_unstale":"2024-08-18T23:56:58.793905+0000","last_undegraded":"2024-08-18T23:56:58.793905+0000","last_fullsized":"2024-08-18T23:56:58.793905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147183+0000","last_change":"2024-08-18T23:56:53.763491+0000","last_active":"2024-08-18T23:56:59.147183+0000","last_peered":"2024-08-18T23:56:59.147183+0000","last_clean":"2024-08-18T23:56:59.147183+0000","last_became_active":"2024-08-18T23:56:53.763123+0000","last_became_peered":"2024-08-18T23:56:53.763123+0000","last_unstale":"2024-08-18T23:56:59.147183+0000","last_undegraded":"2024-08-18T23:56:59.147183+0000","last_fullsized":"2024-08-18T23:56:59.147183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:48:21.747365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794368+0000","last_change":"2024-08-18T23:56:53.756577+0000","last_active":"2024-08-18T23:56:58.794368+0000","last_peered":"2024-08-18T23:56:58.794368+0000","last_clean":"2024-08-18T23:56:58.794368+0000","last_became_active":"2024-08-18T23:56:53.755872+0000","last_became_peered":"2024-08-18T23:56:53.755872+0000","last_unstale":"2024-08-18T23:56:58.794368+0000","last_undegraded":"2024-08-18T23:56:58.794368+0000","last_fullsized":"2024-08-18T23:56:58.794368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:12.823198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146986+0000","last_change":"2024-08-18T23:56:53.775155+0000","last_active":"2024-08-18T23:56:59.146986+0000","last_peered":"2024-08-18T23:56:59.146986+0000","last_clean":"2024-08-18T23:56:59.146986+0000","last_became_active":"2024-08-18T23:56:53.774332+0000","last_became_peered":"2024-08-18T23:56:53.774332+0000","last_unstale":"2024-08-18T23:56:59.146986+0000","last_undegraded":"2024-08-18T23:56:59.146986+0000","last_fullsized":"2024-08-18T23:56:59.146986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:57.104014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145651+0000","last_change":"2024-08-18T23:56:53.777136+0000","last_active":"2024-08-18T23:56:59.145651+0000","last_peered":"2024-08-18T23:56:59.145651+0000","last_clean":"2024-08-18T23:56:59.145651+0000","last_became_active":"2024-08-18T23:56:53.776851+0000","last_became_peered":"2024-08-18T23:56:53.776851+0000","last_unstale":"2024-08-18T23:56:59.145651+0000","last_undegraded":"2024-08-18T23:56:59.145651+0000","last_fullsized":"2024-08-18T23:56:59.145651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145548+0000","last_change":"2024-08-18T23:56:53.772745+0000","last_active":"2024-08-18T23:56:59.145548+0000","last_peered":"2024-08-18T23:56:59.145548+0000","last_clean":"2024-08-18T23:56:59.145548+0000","last_became_active":"2024-08-18T23:56:53.772455+0000","last_became_peered":"2024-08-18T23:56:53.772455+0000","last_unstale":"2024-08-18T23:56:59.145548+0000","last_undegraded":"2024-08-18T23:56:59.145548+0000","last_fullsized":"2024-08-18T23:56:59.145548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795596+0000","last_change":"2024-08-18T23:56:53.768901+0000","last_active":"2024-08-18T23:56:58.795596+0000","last_peered":"2024-08-18T23:56:58.795596+0000","last_clean":"2024-08-18T23:56:58.795596+0000","last_became_active":"2024-08-18T23:56:53.767949+0000","last_became_peered":"2024-08-18T23:56:53.767949+0000","last_unstale":"2024-08-18T23:56:58.795596+0000","last_undegraded":"2024-08-18T23:56:58.795596+0000","last_fullsized":"2024-08-18T23:56:58.795596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:57.813404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144928+0000","last_change":"2024-08-18T23:56:53.757368+0000","last_active":"2024-08-18T23:56:59.144928+0000","last_peered":"2024-08-18T23:56:59.144928+0000","last_clean":"2024-08-18T23:56:59.144928+0000","last_became_active":"2024-08-18T23:56:53.756898+0000","last_became_peered":"2024-08-18T23:56:53.756898+0000","last_unstale":"2024-08-18T23:56:59.144928+0000","last_undegraded":"2024-08-18T23:56:59.144928+0000","last_fullsized":"2024-08-18T23:56:59.144928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:59.039252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146741+0000","last_change":"2024-08-18T23:56:53.765280+0000","last_active":"2024-08-18T23:56:59.146741+0000","last_peered":"2024-08-18T23:56:59.146741+0000","last_clean":"2024-08-18T23:56:59.146741+0000","last_became_active":"2024-08-18T23:56:53.763756+0000","last_became_peered":"2024-08-18T23:56:53.763756+0000","last_unstale":"2024-08-18T23:56:59.146741+0000","last_undegraded":"2024-08-18T23:56:59.146741+0000","last_fullsized":"2024-08-18T23:56:59.146741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:55.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794162+0000","last_change":"2024-08-18T23:56:53.772201+0000","last_active":"2024-08-18T23:56:58.794162+0000","last_peered":"2024-08-18T23:56:58.794162+0000","last_clean":"2024-08-18T23:56:58.794162+0000","last_became_active":"2024-08-18T23:56:53.770656+0000","last_became_peered":"2024-08-18T23:56:53.770656+0000","last_unstale":"2024-08-18T23:56:58.794162+0000","last_undegraded":"2024-08-18T23:56:58.794162+0000","last_fullsized":"2024-08-18T23:56:58.794162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794351+0000","last_change":"2024-08-18T23:56:53.772162+0000","last_active":"2024-08-18T23:56:58.794351+0000","last_peered":"2024-08-18T23:56:58.794351+0000","last_clean":"2024-08-18T23:56:58.794351+0000","last_became_active":"2024-08-18T23:56:53.771265+0000","last_became_peered":"2024-08-18T23:56:53.771265+0000","last_unstale":"2024-08-18T23:56:58.794351+0000","last_undegraded":"2024-08-18T23:56:58.794351+0000","last_fullsized":"2024-08-18T23:56:58.794351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146824+0000","last_change":"2024-08-18T23:56:53.772410+0000","last_active":"2024-08-18T23:56:59.146824+0000","last_peered":"2024-08-18T23:56:59.146824+0000","last_clean":"2024-08-18T23:56:59.146824+0000","last_became_active":"2024-08-18T23:56:53.771633+0000","last_became_peered":"2024-08-18T23:56:53.771633+0000","last_unstale":"2024-08-18T23:56:59.146824+0000","last_undegraded":"2024-08-18T23:56:59.146824+0000","last_fullsized":"2024-08-18T23:56:59.146824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:41.319632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144814+0000","last_change":"2024-08-18T23:56:53.766249+0000","last_active":"2024-08-18T23:56:59.144814+0000","last_peered":"2024-08-18T23:56:59.144814+0000","last_clean":"2024-08-18T23:56:59.144814+0000","last_became_active":"2024-08-18T23:56:53.765940+0000","last_became_peered":"2024-08-18T23:56:53.765940+0000","last_unstale":"2024-08-18T23:56:59.144814+0000","last_undegraded":"2024-08-18T23:56:59.144814+0000","last_fullsized":"2024-08-18T23:56:59.144814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146148+0000","last_change":"2024-08-18T23:56:53.766607+0000","last_active":"2024-08-18T23:56:59.146148+0000","last_peered":"2024-08-18T23:56:59.146148+0000","last_clean":"2024-08-18T23:56:59.146148+0000","last_became_active":"2024-08-18T23:56:53.766145+0000","last_became_peered":"2024-08-18T23:56:53.766145+0000","last_unstale":"2024-08-18T23:56:59.146148+0000","last_undegraded":"2024-08-18T23:56:59.146148+0000","last_fullsized":"2024-08-18T23:56:59.146148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147356+0000","last_change":"2024-08-18T23:56:53.770217+0000","last_active":"2024-08-18T23:56:59.147356+0000","last_peered":"2024-08-18T23:56:59.147356+0000","last_clean":"2024-08-18T23:56:59.147356+0000","last_became_active":"2024-08-18T23:56:53.769943+0000","last_became_peered":"2024-08-18T23:56:53.769943+0000","last_unstale":"2024-08-18T23:56:59.147356+0000","last_undegraded":"2024-08-18T23:56:59.147356+0000","last_fullsized":"2024-08-18T23:56:59.147356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:22.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146889+0000","last_change":"2024-08-18T23:56:53.763822+0000","last_active":"2024-08-18T23:56:59.146889+0000","last_peered":"2024-08-18T23:56:59.146889+0000","last_clean":"2024-08-18T23:56:59.146889+0000","last_became_active":"2024-08-18T23:56:53.762359+0000","last_became_peered":"2024-08-18T23:56:53.762359+0000","last_unstale":"2024-08-18T23:56:59.146889+0000","last_undegraded":"2024-08-18T23:56:59.146889+0000","last_fullsized":"2024-08-18T23:56:59.146889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:38.459488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147339+0000","last_change":"2024-08-18T23:56:53.775297+0000","last_active":"2024-08-18T23:56:59.147339+0000","last_peered":"2024-08-18T23:56:59.147339+0000","last_clean":"2024-08-18T23:56:59.147339+0000","last_became_active":"2024-08-18T23:56:53.774803+0000","last_became_peered":"2024-08-18T23:56:53.774803+0000","last_unstale":"2024-08-18T23:56:59.147339+0000","last_undegraded":"2024-08-18T23:56:59.147339+0000","last_fullsized":"2024-08-18T23:56:59.147339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:59.039252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795630+0000","last_change":"2024-08-18T23:56:53.761493+0000","last_active":"2024-08-18T23:56:58.795630+0000","last_peered":"2024-08-18T23:56:58.795630+0000","last_clean":"2024-08-18T23:56:58.795630+0000","last_became_active":"2024-08-18T23:56:53.760939+0000","last_became_peered":"2024-08-18T23:56:53.760939+0000","last_unstale":"2024-08-18T23:56:58.795630+0000","last_undegraded":"2024-08-18T23:56:58.795630+0000","last_fullsized":"2024-08-18T23:56:58.795630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145825+0000","last_change":"2024-08-18T23:56:53.763839+0000","last_active":"2024-08-18T23:56:59.145825+0000","last_peered":"2024-08-18T23:56:59.145825+0000","last_clean":"2024-08-18T23:56:59.145825+0000","last_became_active":"2024-08-18T23:56:53.763462+0000","last_became_peered":"2024-08-18T23:56:53.763462+0000","last_unstale":"2024-08-18T23:56:59.145825+0000","last_undegraded":"2024-08-18T23:56:59.145825+0000","last_fullsized":"2024-08-18T23:56:59.145825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146738+0000","last_change":"2024-08-18T23:56:53.769068+0000","last_active":"2024-08-18T23:56:59.146738+0000","last_peered":"2024-08-18T23:56:59.146738+0000","last_clean":"2024-08-18T23:56:59.146738+0000","last_became_active":"2024-08-18T23:56:53.767605+0000","last_became_peered":"2024-08-18T23:56:53.767605+0000","last_unstale":"2024-08-18T23:56:59.146738+0000","last_undegraded":"2024-08-18T23:56:59.146738+0000","last_fullsized":"2024-08-18T23:56:59.146738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:30.270890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:14.150 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T23:57:14.150 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-18T23:57:14.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-18T23:57:14.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-18T23:57:14.151 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-18T23:57:14.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.283+0000 7f91c28a4640 1 Processor -- start 2024-08-18T23:57:14.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.284+0000 7f91c28a4640 1 -- start start 2024-08-18T23:57:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.284+0000 7f91c28a4640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91bc0b4400 0x7f91bc0ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.284+0000 7f91c28a4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91bc0b3800 0x7f91bc06df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.284+0000 7f91c28a4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91bc0aeac0 con 0x7f91bc0b47e0 2024-08-18T23:57:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.284+0000 7f91c28a4640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f91bc15e420 con 0x7f91bc0b4400 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.284+0000 7f91c28a4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f91bc06c0f0 con 0x7f91bc0b3800 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bbfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91bc0b4400 0x7f91bc0ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bbfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91bc0b4400 0x7f91bc0ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38152/0 (socket says 172.21.15.103:38152) 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bbfff640 1 -- 172.21.15.103:0/3688003301 learned_addr learned my addr 172.21.15.103:0/3688003301 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bb7fe640 1 --2- 172.21.15.103:0/3688003301 >> v2:172.21.15.190:3300/0 conn(0x7f91bc0b3800 0x7f91bc06df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bbfff640 1 -- 172.21.15.103:0/3688003301 >> v2:172.21.15.190:3300/0 conn(0x7f91bc0b3800 msgr2=0x7f91bc06df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bbfff640 1 --2- 172.21.15.103:0/3688003301 >> v2:172.21.15.190:3300/0 conn(0x7f91bc0b3800 0x7f91bc06df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bbfff640 1 -- 172.21.15.103:0/3688003301 >> v1:172.21.15.190:6789/0 conn(0x7f91bc0b47e0 legacy=0x7f91bc06c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bbfff640 1 -- 172.21.15.103:0/3688003301 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc0ae7e0 con 0x7f91bc0b4400 2024-08-18T23:57:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.285+0000 7f91bbfff640 1 --2- 172.21.15.103:0/3688003301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc0ae1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0d1140 tx=0x7f91ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573dd545dc03d852 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91baffd640 1 -- 172.21.15.103:0/3688003301 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac037070 con 0x7f91bc0b4400 2024-08-18T23:57:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91baffd640 1 -- 172.21.15.103:0/3688003301 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ac032440 con 0x7f91bc0b4400 2024-08-18T23:57:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91baffd640 1 -- 172.21.15.103:0/3688003301 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac032810 con 0x7f91bc0b4400 2024-08-18T23:57:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91c28a4640 1 -- 172.21.15.103:0/3688003301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 msgr2=0x7f91bc0ae1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91c28a4640 1 --2- 172.21.15.103:0/3688003301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc0ae1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0d1140 tx=0x7f91ac02a230 comp rx=0 tx=0).stop 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91c28a4640 1 -- 172.21.15.103:0/3688003301 shutdown_connections 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91c28a4640 1 --2- 172.21.15.103:0/3688003301 >> v2:172.21.15.190:3300/0 conn(0x7f91bc0b3800 0x7f91bc06df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91c28a4640 1 --2- 172.21.15.103:0/3688003301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc0ae1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91c28a4640 1 -- 172.21.15.103:0/3688003301 >> 172.21.15.103:0/3688003301 conn(0x7f91bc0d0560 msgr2=0x7f91bc0d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91c28a4640 1 -- 172.21.15.103:0/3688003301 shutdown_connections 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.286+0000 7f91c28a4640 1 -- 172.21.15.103:0/3688003301 wait complete. 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.287+0000 7f91c28a4640 1 Processor -- start 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.288+0000 7f91c28a4640 1 -- start start 2024-08-18T23:57:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.288+0000 7f91c28a4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91bc0b3800 0x7f91bc151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.288+0000 7f91c28a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc1f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.288+0000 7f91c28a4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91bc0b47e0 0x7f91bc160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.288+0000 7f91c28a4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc0cca50 con 0x7f91bc0b4400 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.288+0000 7f91c28a4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc06bd80 con 0x7f91bc0b3800 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.288+0000 7f91c28a4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f91bc0b4c70 con 0x7f91bc0b47e0 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc1f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc1f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38168/0 (socket says 172.21.15.103:38168) 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 -- 172.21.15.103:0/816669082 learned_addr learned my addr 172.21.15.103:0/816669082 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bbfff640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91bc0b3800 0x7f91bc151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91c0e41640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91bc0b47e0 0x7f91bc160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 -- 172.21.15.103:0/816669082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91bc0b47e0 msgr2=0x7f91bc160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91bc0b47e0 0x7f91bc160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 -- 172.21.15.103:0/816669082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91bc0b3800 msgr2=0x7f91bc151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91bc0b3800 0x7f91bc151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 -- 172.21.15.103:0/816669082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc1e7dd0 con 0x7f91bc0b4400 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91bb7fe640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc1f4770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f91b000d800 tx=0x7f91b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91b8ff9640 1 -- 172.21.15.103:0/816669082 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b000b6c0 con 0x7f91bc0b4400 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91b8ff9640 1 -- 172.21.15.103:0/816669082 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b0019070 con 0x7f91bc0b4400 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91b8ff9640 1 -- 172.21.15.103:0/816669082 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b000ba80 con 0x7f91bc0b4400 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc1e80b0 con 0x7f91bc0b4400 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.289+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc1e8670 con 0x7f91bc0b4400 2024-08-18T23:57:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.290+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91bc06df90 con 0x7f91bc0b4400 2024-08-18T23:57:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.291+0000 7f91b8ff9640 1 -- 172.21.15.103:0/816669082 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91b000bc20 con 0x7f91bc0b4400 2024-08-18T23:57:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.291+0000 7f91b8ff9640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91a806be30 0x7f91a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.291+0000 7f91b8ff9640 1 -- 172.21.15.103:0/816669082 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f91b008b490 con 0x7f91bc0b4400 2024-08-18T23:57:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.291+0000 7f91bbfff640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91a806be30 0x7f91a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.292+0000 7f91bbfff640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91a806be30 0x7f91a806e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91ac034000 tx=0x7f91ac02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.296+0000 7f91b8ff9640 1 -- 172.21.15.103:0/816669082 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f91b0059540 con 0x7f91bc0b4400 2024-08-18T23:57:14.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.510+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f91bc0b1710 con 0x7f91bc0b4400 2024-08-18T23:57:14.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.513+0000 7f91b8ff9640 1 -- 172.21.15.103:0/816669082 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172946 (secure 0 0 0) 0x7f91b005d840 con 0x7f91bc0b4400 2024-08-18T23:57:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91a806be30 msgr2=0x7f91a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91a806be30 0x7f91a806e2f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91ac034000 tx=0x7f91ac02e000 comp rx=0 tx=0).stop 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 msgr2=0x7f91bc1f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc1f4770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f91b000d800 tx=0x7f91b000dcc0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 shutdown_connections 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91a806be30 0x7f91a806e2f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91bc0b47e0 0x7f91bc160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91bc0b4400 0x7f91bc1f4770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 --2- 172.21.15.103:0/816669082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91bc0b3800 0x7f91bc151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 >> 172.21.15.103:0/816669082 conn(0x7f91bc0d0560 msgr2=0x7f91bc0d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 shutdown_connections 2024-08-18T23:57:14.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.516+0000 7f91c28a4640 1 -- 172.21.15.103:0/816669082 wait complete. 2024-08-18T23:57:14.528 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2424797051},{"type":"v1","addr":"172.21.15.103:6833","nonce":2424797051}]},"active_addr":"172.21.15.103:6833/2424797051","active_change":"2024-08-18T23:56:34.155139+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2864275881}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3654163721}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2809152287}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1608092322}]}]} 2024-08-18T23:57:14.531 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-18T23:57:14.531 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-18T23:57:14.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.628+0000 7fdd07d9a640 1 Processor -- start 2024-08-18T23:57:14.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.628+0000 7fdd07d9a640 1 -- start start 2024-08-18T23:57:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.629+0000 7fdd07d9a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdd0006f770 0x7fdd000ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.629+0000 7fdd07d9a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd00072610 con 0x7fdd0015ade0 2024-08-18T23:57:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.629+0000 7fdd07d9a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd000728f0 con 0x7fdd000b4370 2024-08-18T23:57:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.629+0000 7fdd07d9a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdd0006db10 con 0x7fdd0006f770 2024-08-18T23:57:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.629+0000 7fdd05b36640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdd0015ade0 0x7fdd0006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56408/0 (socket says 172.21.15.103:56408) 2024-08-18T23:57:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.629+0000 7fdd05b36640 1 -- 172.21.15.103:0/1814123491 learned_addr learned my addr 172.21.15.103:0/1814123491 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:14.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.629+0000 7fdd05335640 1 --2- 172.21.15.103:0/1814123491 >> v2:172.21.15.103:3300/0 conn(0x7fdd0006f770 0x7fdd000ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.630+0000 7fdd04b34640 1 -- 172.21.15.103:0/1814123491 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689689052 0 0) 0x7fdd00072610 con 0x7fdd0015ade0 2024-08-18T23:57:14.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.630+0000 7fdd04b34640 1 -- 172.21.15.103:0/1814123491 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcec003520 con 0x7fdd0015ade0 2024-08-18T23:57:14.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.630+0000 7fdd05335640 1 -- 172.21.15.103:0/1814123491 >> v1:172.21.15.190:6789/0 conn(0x7fdd000b4370 legacy=0x7fdd000adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:14.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.630+0000 7fdd05335640 1 -- 172.21.15.103:0/1814123491 >> v1:172.21.15.103:6789/0 conn(0x7fdd0015ade0 legacy=0x7fdd0006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.630+0000 7fdd05335640 1 -- 172.21.15.103:0/1814123491 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd00072bd0 con 0x7fdd0006f770 2024-08-18T23:57:14.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.630+0000 7fdd05335640 1 --2- 172.21.15.103:0/1814123491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd0006f770 0x7fdd000ad9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00097a0 tx=0x7fdcf002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48d5801e4e6eae9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.630+0000 7fdd04b34640 1 -- 172.21.15.103:0/1814123491 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0037070 con 0x7fdd0006f770 2024-08-18T23:57:14.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd04b34640 1 -- 172.21.15.103:0/1814123491 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf002ae50 con 0x7fdd0006f770 2024-08-18T23:57:14.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd04b34640 1 -- 172.21.15.103:0/1814123491 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0032640 con 0x7fdd0006f770 2024-08-18T23:57:14.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd07d9a640 1 -- 172.21.15.103:0/1814123491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd0006f770 msgr2=0x7fdd000ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd07d9a640 1 --2- 172.21.15.103:0/1814123491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd0006f770 0x7fdd000ad9d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00097a0 tx=0x7fdcf002a140 comp rx=0 tx=0).stop 2024-08-18T23:57:14.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd07d9a640 1 -- 172.21.15.103:0/1814123491 shutdown_connections 2024-08-18T23:57:14.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd07d9a640 1 --2- 172.21.15.103:0/1814123491 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd0006f770 0x7fdd000ad9d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd07d9a640 1 -- 172.21.15.103:0/1814123491 >> 172.21.15.103:0/1814123491 conn(0x7fdd000cfc40 msgr2=0x7fdd000d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:14.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd07d9a640 1 -- 172.21.15.103:0/1814123491 shutdown_connections 2024-08-18T23:57:14.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.631+0000 7fdd07d9a640 1 -- 172.21.15.103:0/1814123491 wait complete. 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.632+0000 7fdd07d9a640 1 Processor -- start 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.632+0000 7fdd07d9a640 1 -- start start 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd07d9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd0006f770 0x7fdd00155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd07d9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd000b4370 0x7fdd000cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd07d9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd0015ade0 0x7fdd0015e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd07d9a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0006d6c0 con 0x7fdd000b4370 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd07d9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0015b1c0 con 0x7fdd0006f770 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd07d9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdd0006d840 con 0x7fdd0015ade0 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05335640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd000b4370 0x7fdd000cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05335640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd000b4370 0x7fdd000cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38178/0 (socket says 172.21.15.103:38178) 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05335640 1 -- 172.21.15.103:0/2974268148 learned_addr learned my addr 172.21.15.103:0/2974268148 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05335640 1 -- 172.21.15.103:0/2974268148 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd0015ade0 msgr2=0x7fdd0015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05b36640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd0006f770 0x7fdd00155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05335640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd0015ade0 0x7fdd0015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05335640 1 -- 172.21.15.103:0/2974268148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd0006f770 msgr2=0x7fdd00155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05335640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd0006f770 0x7fdd00155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.633+0000 7fdd05335640 1 -- 172.21.15.103:0/2974268148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd000cbd60 con 0x7fdd000b4370 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.634+0000 7fdd05335640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd000b4370 0x7fdd000cb430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0000c00 tx=0x7fdcf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.634+0000 7fdcf67fc640 1 -- 172.21.15.103:0/2974268148 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0042070 con 0x7fdd000b4370 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.634+0000 7fdcf67fc640 1 -- 172.21.15.103:0/2974268148 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf003e460 con 0x7fdd000b4370 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.634+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd000cc040 con 0x7fdd000b4370 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.634+0000 7fdcf67fc640 1 -- 172.21.15.103:0/2974268148 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0037040 con 0x7fdd000b4370 2024-08-18T23:57:14.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.634+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd0015c370 con 0x7fdd000b4370 2024-08-18T23:57:14.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.635+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd000b47b0 con 0x7fdd000b4370 2024-08-18T23:57:14.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.635+0000 7fdcf67fc640 1 -- 172.21.15.103:0/2974268148 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdcf0045070 con 0x7fdd000b4370 2024-08-18T23:57:14.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.636+0000 7fdcf67fc640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdce406be60 0x7fdce406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.636+0000 7fdcf67fc640 1 -- 172.21.15.103:0/2974268148 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdcf00ab630 con 0x7fdd000b4370 2024-08-18T23:57:14.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.636+0000 7fdd05b36640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdce406be60 0x7fdce406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.636+0000 7fdd05b36640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdce406be60 0x7fdce406e320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc000f60 tx=0x7fdcfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.640+0000 7fdcf67fc640 1 -- 172.21.15.103:0/2974268148 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdcf0079d30 con 0x7fdd000b4370 2024-08-18T23:57:14.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.807+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd0015f5b0 con 0x7fdd000b4370 2024-08-18T23:57:14.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.808+0000 7fdcf67fc640 1 -- 172.21.15.103:0/2974268148 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7fdcf0079630 con 0x7fdd000b4370 2024-08-18T23:57:14.810 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:14.810 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:14.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdce406be60 msgr2=0x7fdce406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdce406be60 0x7fdce406e320 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc000f60 tx=0x7fdcfc009040 comp rx=0 tx=0).stop 2024-08-18T23:57:14.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd000b4370 msgr2=0x7fdd000cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd000b4370 0x7fdd000cb430 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0000c00 tx=0x7fdcf00046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 shutdown_connections 2024-08-18T23:57:14.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdce406be60 0x7fdce406e320 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdd0015ade0 0x7fdd0015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd000b4370 0x7fdd000cb430 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 --2- 172.21.15.103:0/2974268148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdd0006f770 0x7fdd00155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 >> 172.21.15.103:0/2974268148 conn(0x7fdd000cfc40 msgr2=0x7fdd000ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:14.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 shutdown_connections 2024-08-18T23:57:14.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.810+0000 7fdd07d9a640 1 -- 172.21.15.103:0/2974268148 wait complete. 2024-08-18T23:57:14.823 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-18T23:57:14.823 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:14.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.922+0000 7fe67c81e640 1 Processor -- start 2024-08-18T23:57:14.924 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.922+0000 7fe67c81e640 1 -- start start 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe67c81e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe67815ade0 0x7fe67806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe67c81e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe6780b4370 0x7fe67806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe67c81e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b47b0 0x7fe67815e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe67c81e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe67806db10 con 0x7fe6780b4370 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe67c81e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe67815b1c0 con 0x7fe67815ade0 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe67c81e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe678072610 con 0x7fe6780b47b0 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe675d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe6780b4370 0x7fe67806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe675d9b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe6780b4370 0x7fe67806f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38190/0 (socket says 172.21.15.103:38190) 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe675d9b640 1 -- 172.21.15.103:0/4231296159 learned_addr learned my addr 172.21.15.103:0/4231296159 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe675d9b640 1 -- 172.21.15.103:0/4231296159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b47b0 msgr2=0x7fe67815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe675d9b640 1 --2- 172.21.15.103:0/4231296159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b47b0 0x7fe67815e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe67659c640 1 --2- 172.21.15.103:0/4231296159 >> v2:172.21.15.190:3300/0 conn(0x7fe67815ade0 0x7fe67806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe675d9b640 1 -- 172.21.15.103:0/4231296159 >> v2:172.21.15.190:3300/0 conn(0x7fe67815ade0 msgr2=0x7fe67806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe675d9b640 1 --2- 172.21.15.103:0/4231296159 >> v2:172.21.15.190:3300/0 conn(0x7fe67815ade0 0x7fe67806f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.923+0000 7fe675d9b640 1 -- 172.21.15.103:0/4231296159 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6780728f0 con 0x7fe6780b4370 2024-08-18T23:57:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.924+0000 7fe675d9b640 1 --2- 172.21.15.103:0/4231296159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67806f5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe678069160 tx=0x7fe66c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23565aa1678c940 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.924+0000 7fe67559a640 1 -- 172.21.15.103:0/4231296159 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c037070 con 0x7fe6780b4370 2024-08-18T23:57:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.924+0000 7fe67559a640 1 -- 172.21.15.103:0/4231296159 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66c032440 con 0x7fe6780b4370 2024-08-18T23:57:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.924+0000 7fe67559a640 1 -- 172.21.15.103:0/4231296159 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c032810 con 0x7fe6780b4370 2024-08-18T23:57:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 -- 172.21.15.103:0/4231296159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 msgr2=0x7fe67806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 --2- 172.21.15.103:0/4231296159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67806f5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe678069160 tx=0x7fe66c02a140 comp rx=0 tx=0).stop 2024-08-18T23:57:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 -- 172.21.15.103:0/4231296159 shutdown_connections 2024-08-18T23:57:14.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 --2- 172.21.15.103:0/4231296159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe6780b47b0 0x7fe67815e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 --2- 172.21.15.103:0/4231296159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67806f5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 --2- 172.21.15.103:0/4231296159 >> v2:172.21.15.190:3300/0 conn(0x7fe67815ade0 0x7fe67806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 -- 172.21.15.103:0/4231296159 >> 172.21.15.103:0/4231296159 conn(0x7fe6780cfc40 msgr2=0x7fe6780d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:14.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 -- 172.21.15.103:0/4231296159 shutdown_connections 2024-08-18T23:57:14.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.925+0000 7fe67c81e640 1 -- 172.21.15.103:0/4231296159 wait complete. 2024-08-18T23:57:14.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.926+0000 7fe67c81e640 1 Processor -- start 2024-08-18T23:57:14.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.926+0000 7fe67c81e640 1 -- start start 2024-08-18T23:57:14.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67c81e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67c81e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6780b47b0 0x7fe67809d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67c81e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe67815ade0 0x7fe6781507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67c81e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe67806d6c0 con 0x7fe6780b4370 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67c81e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe678072eb0 con 0x7fe6780b47b0 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67c81e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe67806d840 con 0x7fe67815ade0 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67809aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38204/0 (socket says 172.21.15.103:38204) 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 -- 172.21.15.103:0/669250756 learned_addr learned my addr 172.21.15.103:0/669250756 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe675d9b640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6780b47b0 0x7fe67809d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe676d9d640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe67815ade0 0x7fe6781507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 -- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe67815ade0 msgr2=0x7fe6781507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe67815ade0 0x7fe6781507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 -- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6780b47b0 msgr2=0x7fe67809d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6780b47b0 0x7fe67809d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 -- 172.21.15.103:0/669250756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe678157c20 con 0x7fe6780b4370 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe676d9d640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe67815ade0 0x7fe6781507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.927+0000 7fe67659c640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67809aa40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe66800c7f0 tx=0x7fe66800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.928+0000 7fe666ffd640 1 -- 172.21.15.103:0/669250756 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668015070 con 0x7fe6780b4370 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.928+0000 7fe666ffd640 1 -- 172.21.15.103:0/669250756 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe668004240 con 0x7fe6780b4370 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.928+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67815c970 con 0x7fe6780b4370 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.928+0000 7fe666ffd640 1 -- 172.21.15.103:0/669250756 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668007620 con 0x7fe6780b4370 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.928+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67815cf30 con 0x7fe6780b4370 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.929+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67815e8a0 con 0x7fe6780b4370 2024-08-18T23:57:14.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.929+0000 7fe666ffd640 1 -- 172.21.15.103:0/669250756 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6680079d0 con 0x7fe6780b4370 2024-08-18T23:57:14.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.930+0000 7fe666ffd640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe65806be30 0x7fe65806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:14.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.930+0000 7fe666ffd640 1 -- 172.21.15.103:0/669250756 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe66808b6d0 con 0x7fe6780b4370 2024-08-18T23:57:14.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.930+0000 7fe675d9b640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe65806be30 0x7fe65806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:14.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.930+0000 7fe675d9b640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe65806be30 0x7fe65806e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe66c034000 tx=0x7fe66c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:14.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:14.934+0000 7fe666ffd640 1 -- 172.21.15.103:0/669250756 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe668059cb0 con 0x7fe6780b4370 2024-08-18T23:57:15.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.100+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6780af400 con 0x7fe6780b4370 2024-08-18T23:57:15.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.101+0000 7fe666ffd640 1 -- 172.21.15.103:0/669250756 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7fe6680595b0 con 0x7fe6780b4370 2024-08-18T23:57:15.103 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:15.103 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:15.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe65806be30 msgr2=0x7fe65806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe65806be30 0x7fe65806e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe66c034000 tx=0x7fe66c02e000 comp rx=0 tx=0).stop 2024-08-18T23:57:15.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 msgr2=0x7fe67809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67809aa40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe66800c7f0 tx=0x7fe66800ccb0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 shutdown_connections 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe65806be30 0x7fe65806e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe67815ade0 0x7fe6781507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6780b47b0 0x7fe67809d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 --2- 172.21.15.103:0/669250756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6780b4370 0x7fe67809aa40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 >> 172.21.15.103:0/669250756 conn(0x7fe6780cfc40 msgr2=0x7fe67806f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 shutdown_connections 2024-08-18T23:57:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.104+0000 7fe67c81e640 1 -- 172.21.15.103:0/669250756 wait complete. 2024-08-18T23:57:15.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-18T23:57:15.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-18T23:57:15.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-18T23:57:15.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-18T23:57:15.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-18T23:57:15.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-18T23:57:15.118 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-18T23:57:15.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-18T23:57:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.282+0000 7f0b08344640 1 Processor -- start 2024-08-18T23:57:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.282+0000 7f0b08344640 1 -- start start 2024-08-18T23:57:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b08344640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b0015e470 0x7f0b000d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b060e0640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0b000d0ae0 0x7f0b000d0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56412/0 (socket says 172.21.15.103:56412) 2024-08-18T23:57:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7fe3426b1640 1 Processor -- start 2024-08-18T23:57:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7fe3426b1640 1 -- start start 2024-08-18T23:57:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b08344640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0b000cf780 0x7f0b000b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b08344640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000b6f00 con 0x7f0b000d0ae0 2024-08-18T23:57:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b08344640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0b000cfef0 con 0x7f0b000cf780 2024-08-18T23:57:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b08344640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000b7170 con 0x7f0b0015e470 2024-08-18T23:57:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b058df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b0015e470 0x7f0b000d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b058df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b0015e470 0x7f0b000d4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43446/0 (socket says 172.21.15.103:43446) 2024-08-18T23:57:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7f00fddc8640 1 Processor -- start 2024-08-18T23:57:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b058df640 1 -- 172.21.15.103:0/2188570194 learned_addr learned my addr 172.21.15.103:0/2188570194 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b068e1640 1 --2- 172.21.15.103:0/2188570194 >> v2:172.21.15.190:3300/0 conn(0x7f0b000cf780 0x7f0b000b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b058df640 1 -- 172.21.15.103:0/2188570194 >> v2:172.21.15.190:3300/0 conn(0x7f0b000cf780 msgr2=0x7f0b000b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b058df640 1 --2- 172.21.15.103:0/2188570194 >> v2:172.21.15.190:3300/0 conn(0x7f0b000cf780 0x7f0b000b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b058df640 1 -- 172.21.15.103:0/2188570194 >> v1:172.21.15.103:6789/0 conn(0x7f0b000d0ae0 legacy=0x7f0b000d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.284+0000 7f0b058df640 1 -- 172.21.15.103:0/2188570194 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000b7450 con 0x7f0b0015e470 2024-08-18T23:57:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7f0b060e0640 1 --1- 172.21.15.103:0/2188570194 >> v1:172.21.15.103:6789/0 conn(0x7f0b000d0ae0 0x7f0b000d0ec0 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-18T23:57:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7f0b058df640 1 --2- 172.21.15.103:0/2188570194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b0015e470 0x7f0b000d4bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009870 tx=0x7f0afc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3d1ecb066cf8229 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7fe3426b1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe3340e6f80 0x7fe334006200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7fe3426b1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 0x7fe334006740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7fe3426b1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33400b6c0 con 0x7fe334033a00 2024-08-18T23:57:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7fe3426b1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe334047780 con 0x7fe3340e6f80 2024-08-18T23:57:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7fe3426b1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe33400b9a0 con 0x7fe334047c10 2024-08-18T23:57:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7f76006a7640 1 Processor -- start 2024-08-18T23:57:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe87aacb640 1 Processor -- start 2024-08-18T23:57:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.285+0000 7f00fddc8640 1 -- start start 2024-08-18T23:57:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe341eb0640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe334033a00 0x7fe3340eab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56424/0 (socket says 172.21.15.103:56424) 2024-08-18T23:57:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe341eb0640 1 -- 172.21.15.103:0/1165048062 learned_addr learned my addr 172.21.15.103:0/1165048062 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7f0b050de640 1 -- 172.21.15.103:0/2188570194 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc037070 con 0x7f0b0015e470 2024-08-18T23:57:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe3416af640 1 --2- 172.21.15.103:0/1165048062 >> v2:172.21.15.190:3300/0 conn(0x7fe3340e6f80 0x7fe334006200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe340eae640 1 --2- 172.21.15.103:0/1165048062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 0x7fe334006740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7f0b050de640 1 -- 172.21.15.103:0/2188570194 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc032440 con 0x7f0b0015e470 2024-08-18T23:57:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7f0b050de640 1 -- 172.21.15.103:0/2188570194 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc032810 con 0x7f0b0015e470 2024-08-18T23:57:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe333fff640 1 -- 172.21.15.103:0/1165048062 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066762615 0 0) 0x7fe33400b6c0 con 0x7fe334033a00 2024-08-18T23:57:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe3416af640 1 -- 172.21.15.103:0/1165048062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 msgr2=0x7fe334006740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe3416af640 1 --2- 172.21.15.103:0/1165048062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 0x7fe334006740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe3416af640 1 -- 172.21.15.103:0/1165048062 >> v1:172.21.15.103:6789/0 conn(0x7fe334033a00 legacy=0x7fe3340eab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7fe3416af640 1 -- 172.21.15.103:0/1165048062 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe334005ba0 con 0x7fe3340e6f80 2024-08-18T23:57:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.286+0000 7f76006a7640 1 -- start start 2024-08-18T23:57:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7f0b08344640 1 -- 172.21.15.103:0/2188570194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b0015e470 msgr2=0x7f0b000d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7f0b08344640 1 --2- 172.21.15.103:0/2188570194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b0015e470 0x7f0b000d4bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009870 tx=0x7f0afc02a210 comp rx=0 tx=0).stop 2024-08-18T23:57:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7fe87aacb640 1 -- start start 2024-08-18T23:57:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7f0b08344640 1 -- 172.21.15.103:0/2188570194 shutdown_connections 2024-08-18T23:57:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7f76006a7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75f8144590 0x7f75f80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7fe3416af640 1 --2- 172.21.15.103:0/1165048062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340e6f80 0x7fe334006200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe33c06b230 tx=0x7fe33c0a5a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f25ba1cdf24cfa48 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7f0b08344640 1 --2- 172.21.15.103:0/2188570194 >> v2:172.21.15.190:3300/0 conn(0x7f0b000cf780 0x7f0b000b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7f00fddc8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f00f806b900 0x7f00f80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.287+0000 7f0b08344640 1 --2- 172.21.15.103:0/2188570194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b0015e470 0x7f0b000d4bb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7fe333fff640 1 -- 172.21.15.103:0/1165048062 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0ae070 con 0x7fe3340e6f80 2024-08-18T23:57:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f75fe443640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75f8144590 0x7f75f80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f0b08344640 1 -- 172.21.15.103:0/2188570194 >> 172.21.15.103:0/2188570194 conn(0x7f0b0009d410 msgr2=0x7f0b000d40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7fe333fff640 1 -- 172.21.15.103:0/1165048062 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c0aa930 con 0x7fe3340e6f80 2024-08-18T23:57:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f00f806b900 0x7f00f80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f77fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f00f806b900 0x7f00f80ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55134/0 (socket says 172.21.15.103:55134) 2024-08-18T23:57:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00eeffd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f00f80cf460 0x7f00f806bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45716/0 (socket says 172.21.15.103:45716) 2024-08-18T23:57:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00fddc8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00f80cef10 0x7f00f80acd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7fe333fff640 1 -- 172.21.15.103:0/1165048062 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0aada0 con 0x7fe3340e6f80 2024-08-18T23:57:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f77fe640 1 -- 172.21.15.103:0/562766061 learned_addr learned my addr 172.21.15.103:0/562766061 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00fddc8640 1 -- 172.21.15.103:0/562766061 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00f80af630 con 0x7f00f80cf460 2024-08-18T23:57:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f7fff640 1 --2- 172.21.15.103:0/562766061 >> v2:172.21.15.103:3300/0 conn(0x7f00f80cef10 0x7f00f80acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00fddc8640 1 -- 172.21.15.103:0/562766061 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f00f80cdb90 con 0x7f00f80cef10 2024-08-18T23:57:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00fddc8640 1 -- 172.21.15.103:0/562766061 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f00f80cde30 con 0x7f00f806b900 2024-08-18T23:57:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7fe87aacb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe8740cd080 0x7fe8740b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f76006a7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f75f8072c50 0x7f75f806e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f76006a7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f80cc420 con 0x7f75f815ea90 2024-08-18T23:57:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f76006a7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f75f80cc700 con 0x7f75f8144590 2024-08-18T23:57:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f76006a7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f75f80cc9e0 con 0x7f75f8072c50 2024-08-18T23:57:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7fe87aacb640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8740b2c60 con 0x7fe87415f5c0 2024-08-18T23:57:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7fe879068640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe8740cd4f0 0x7fe8740b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45718/0 (socket says 172.21.15.103:45718) 2024-08-18T23:57:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7fe879068640 1 -- 172.21.15.103:0/1526166370 learned_addr learned my addr 172.21.15.103:0/1526166370 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f75fe443640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75f8144590 0x7f75f80cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38218/0 (socket says 172.21.15.103:38218) 2024-08-18T23:57:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f75fe443640 1 -- 172.21.15.103:0/979855993 learned_addr learned my addr 172.21.15.103:0/979855993 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f6ffd640 1 -- 172.21.15.103:0/562766061 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714264790 0 0) 0x7f00f80af630 con 0x7f00f80cf460 2024-08-18T23:57:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe87aacb640 1 -- 172.21.15.103:0/1526166370 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8740b2f40 con 0x7fe8740cd4f0 2024-08-18T23:57:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f0b08344640 1 -- 172.21.15.103:0/2188570194 shutdown_connections 2024-08-18T23:57:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f017b48b640 1 Processor -- start 2024-08-18T23:57:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe87aacb640 1 -- 172.21.15.103:0/1526166370 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe8740d0e60 con 0x7fe8740cd080 2024-08-18T23:57:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe8737fe640 1 -- 172.21.15.103:0/1526166370 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094669353 0 0) 0x7fe8740b2f40 con 0x7fe8740cd4f0 2024-08-18T23:57:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe8737fe640 1 -- 172.21.15.103:0/1526166370 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe864003520 con 0x7fe8740cd4f0 2024-08-18T23:57:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe873fff640 1 --2- 172.21.15.103:0/1526166370 >> v2:172.21.15.190:3300/0 conn(0x7fe8740cd080 0x7fe8740b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe3426b1640 1 -- 172.21.15.103:0/1165048062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340e6f80 msgr2=0x7fe334006200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe3426b1640 1 --2- 172.21.15.103:0/1165048062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340e6f80 0x7fe334006200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe33c06b230 tx=0x7fe33c0a5a50 comp rx=0 tx=0).stop 2024-08-18T23:57:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7ff8b8fff640 1 Processor -- start 2024-08-18T23:57:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe3426b1640 1 -- 172.21.15.103:0/1165048062 shutdown_connections 2024-08-18T23:57:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe3426b1640 1 --2- 172.21.15.103:0/1165048062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 0x7fe334006740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe3426b1640 1 --2- 172.21.15.103:0/1165048062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340e6f80 0x7fe334006200 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe33c06b230 tx=0x7fe33c0a5a50 comp rx=0 tx=0).stop 2024-08-18T23:57:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f6ffd640 1 -- 172.21.15.103:0/562766061 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00e4003520 con 0x7f00f80cf460 2024-08-18T23:57:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f77fe640 1 -- 172.21.15.103:0/562766061 >> v2:172.21.15.103:3300/0 conn(0x7f00f80cef10 msgr2=0x7f00f80acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f77fe640 1 --2- 172.21.15.103:0/562766061 >> v2:172.21.15.103:3300/0 conn(0x7f00f80cef10 0x7f00f80acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f77fe640 1 -- 172.21.15.103:0/562766061 >> v1:172.21.15.190:6789/0 conn(0x7f00f80cf460 legacy=0x7f00f806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.288+0000 7f00f77fe640 1 -- 172.21.15.103:0/562766061 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f80ce110 con 0x7f00f806b900 2024-08-18T23:57:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f00f7fff640 1 --2- 172.21.15.103:0/562766061 >> v2:172.21.15.103:3300/0 conn(0x7f00f80cef10 0x7f00f80acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f75fe443640 1 -- 172.21.15.103:0/979855993 >> v2:172.21.15.190:3300/0 conn(0x7f75f8072c50 msgr2=0x7f75f806e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f75fec44640 1 --2- 172.21.15.103:0/979855993 >> v2:172.21.15.190:3300/0 conn(0x7f75f8072c50 0x7f75f806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f75fe443640 1 --2- 172.21.15.103:0/979855993 >> v2:172.21.15.190:3300/0 conn(0x7f75f8072c50 0x7f75f806e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f75fe443640 1 -- 172.21.15.103:0/979855993 >> v1:172.21.15.103:6789/0 conn(0x7f75f815ea90 legacy=0x7f75f8072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f75fe443640 1 -- 172.21.15.103:0/979855993 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f80cccc0 con 0x7f75f8144590 2024-08-18T23:57:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe873fff640 1 -- 172.21.15.103:0/1526166370 >> v1:172.21.15.190:6789/0 conn(0x7fe8740cd4f0 legacy=0x7fe8740b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7fe873fff640 1 -- 172.21.15.103:0/1526166370 >> v1:172.21.15.103:6789/0 conn(0x7fe87415f5c0 legacy=0x7fe8740cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f0b08344640 1 -- 172.21.15.103:0/2188570194 wait complete. 2024-08-18T23:57:15.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7fe873fff640 1 -- 172.21.15.103:0/1526166370 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8740b3220 con 0x7fe8740cd080 2024-08-18T23:57:15.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f00f77fe640 1 --2- 172.21.15.103:0/562766061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f806b900 0x7f00f80ce910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00f80cd620 tx=0x7f00e802a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9b7dbe6c4be72 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7f017b48b640 1 -- start start 2024-08-18T23:57:15.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7ff8b8fff640 1 -- start start 2024-08-18T23:57:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f00f6ffd640 1 -- 172.21.15.103:0/562766061 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e8037070 con 0x7f00f806b900 2024-08-18T23:57:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f00f6ffd640 1 -- 172.21.15.103:0/562766061 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e8032440 con 0x7f00f806b900 2024-08-18T23:57:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f75fe443640 1 --2- 172.21.15.103:0/979855993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75f8144590 0x7f75f80cb9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75f8068610 tx=0x7f75f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67d2bac0d8b1038 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f00f6ffd640 1 -- 172.21.15.103:0/562766061 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e8032810 con 0x7f00f806b900 2024-08-18T23:57:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f017b48b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f016c037130 0x7f016c037510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f017b48b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f016c037cd0 0x7f016c054e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f017b48b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f016c0348f0 0x7f016c00aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f75fd441640 1 -- 172.21.15.103:0/979855993 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4037070 con 0x7f75f8144590 2024-08-18T23:57:15.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f017b48b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f016c0549b0 con 0x7f016c037130 2024-08-18T23:57:15.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f017b48b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f016c053e10 con 0x7f016c0348f0 2024-08-18T23:57:15.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.290+0000 7f017b48b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f016c037a50 con 0x7f016c037cd0 2024-08-18T23:57:15.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.289+0000 7fe3426b1640 1 -- 172.21.15.103:0/1165048062 >> 172.21.15.103:0/1165048062 conn(0x7fe33401d930 msgr2=0x7fe3340545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f75fd441640 1 -- 172.21.15.103:0/979855993 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f4032440 con 0x7f75f8144590 2024-08-18T23:57:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f75fd441640 1 -- 172.21.15.103:0/979855993 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4032810 con 0x7f75f8144590 2024-08-18T23:57:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7fe3426b1640 1 -- 172.21.15.103:0/1165048062 shutdown_connections 2024-08-18T23:57:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f017ac8a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f016c0348f0 0x7f016c00aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f017ac8a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f016c0348f0 0x7f016c00aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55158/0 (socket says 172.21.15.103:55158) 2024-08-18T23:57:15.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f017ac8a640 1 -- 172.21.15.103:0/2057621285 learned_addr learned my addr 172.21.15.103:0/2057621285 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f017a489640 1 --2- 172.21.15.103:0/2057621285 >> v2:172.21.15.103:3300/0 conn(0x7f016c037130 0x7f016c037510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7fe873fff640 1 --2- 172.21.15.103:0/1526166370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8740cd080 0x7fe8740b4c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8680097a0 tx=0x7fe86802a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=121baf0fe6961eda server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f00fddc8640 1 -- 172.21.15.103:0/562766061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f806b900 msgr2=0x7f00f80ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f00fddc8640 1 --2- 172.21.15.103:0/562766061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f806b900 0x7f00f80ce910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00f80cd620 tx=0x7f00e802a1f0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f0b08344640 1 Processor -- start 2024-08-18T23:57:15.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f0b08344640 1 -- start start 2024-08-18T23:57:15.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f00fddc8640 1 -- 172.21.15.103:0/562766061 shutdown_connections 2024-08-18T23:57:15.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f00fddc8640 1 --2- 172.21.15.103:0/562766061 >> v2:172.21.15.103:3300/0 conn(0x7f00f80cef10 0x7f00f80acd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f00fddc8640 1 --2- 172.21.15.103:0/562766061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f806b900 0x7f00f80ce910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f00fddc8640 1 -- 172.21.15.103:0/562766061 >> 172.21.15.103:0/562766061 conn(0x7f00f80cc6e0 msgr2=0x7f00f80ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7ff8b8fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff8b415c1f0 0x7ff8b40d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7ff8b8fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b40cf050 0x7ff8b40cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7ff8b8fff640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8b40cf490 con 0x7ff8b415fc50 2024-08-18T23:57:15.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7ff8b8fff640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff8b415c5d0 con 0x7ff8b415c1f0 2024-08-18T23:57:15.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7ff8b8fff640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b40cf710 con 0x7ff8b40cf050 2024-08-18T23:57:15.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f00fddc8640 1 -- 172.21.15.103:0/562766061 shutdown_connections 2024-08-18T23:57:15.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f00fddc8640 1 -- 172.21.15.103:0/562766061 wait complete. 2024-08-18T23:57:15.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7fe8737fe640 1 -- 172.21.15.103:0/1526166370 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868037070 con 0x7fe8740cd080 2024-08-18T23:57:15.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7fe8737fe640 1 -- 172.21.15.103:0/1526166370 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe868032440 con 0x7fe8740cd080 2024-08-18T23:57:15.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7ff8b2d9d640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff8b415fc50 0x7ff8b406f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45730/0 (socket says 172.21.15.103:45730) 2024-08-18T23:57:15.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7ff8b2d9d640 1 -- 172.21.15.103:0/2487781425 learned_addr learned my addr 172.21.15.103:0/2487781425 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:15.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7ff8b259c640 1 --2- 172.21.15.103:0/2487781425 >> v2:172.21.15.190:3300/0 conn(0x7ff8b415c1f0 0x7ff8b40d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7ff8b1d9b640 1 --2- 172.21.15.103:0/2487781425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b40cf050 0x7ff8b40cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f76006a7640 1 -- 172.21.15.103:0/979855993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75f8144590 msgr2=0x7f75f80cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7fe3426b1640 1 -- 172.21.15.103:0/1165048062 wait complete. 2024-08-18T23:57:15.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f76006a7640 1 --2- 172.21.15.103:0/979855993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75f8144590 0x7f75f80cb9b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f75f8068610 tx=0x7f75f402a230 comp rx=0 tx=0).stop 2024-08-18T23:57:15.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7ff8b159a640 1 -- 172.21.15.103:0/2487781425 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222731109 0 0) 0x7ff8ac001490 con 0x7ff8b415fc50 2024-08-18T23:57:15.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7ff8b159a640 1 -- 172.21.15.103:0/2487781425 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff89c003520 con 0x7ff8b415fc50 2024-08-18T23:57:15.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7ff8b259c640 1 -- 172.21.15.103:0/2487781425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b40cf050 msgr2=0x7ff8b40cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7fe8737fe640 1 -- 172.21.15.103:0/1526166370 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8680327f0 con 0x7fe8740cd080 2024-08-18T23:57:15.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7ff8b259c640 1 --2- 172.21.15.103:0/2487781425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b40cf050 0x7ff8b40cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7ff8b259c640 1 -- 172.21.15.103:0/2487781425 >> v1:172.21.15.190:6789/0 conn(0x7ff8b415fc50 legacy=0x7ff8b406f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7ff8b259c640 1 -- 172.21.15.103:0/2487781425 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b40ccdb0 con 0x7ff8b415c1f0 2024-08-18T23:57:15.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f0b08344640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b000cf780 0x7f0b000c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f76006a7640 1 -- 172.21.15.103:0/979855993 shutdown_connections 2024-08-18T23:57:15.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f76006a7640 1 --2- 172.21.15.103:0/979855993 >> v2:172.21.15.190:3300/0 conn(0x7f75f8072c50 0x7f75f806e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f76006a7640 1 --2- 172.21.15.103:0/979855993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75f8144590 0x7f75f80cb9b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f76006a7640 1 -- 172.21.15.103:0/979855993 >> 172.21.15.103:0/979855993 conn(0x7f75f80d0bc0 msgr2=0x7f75f80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f0b08344640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b000d0ae0 0x7f0b000c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7fe87aacb640 1 -- 172.21.15.103:0/1526166370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8740cd080 msgr2=0x7fe8740b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7fe87aacb640 1 --2- 172.21.15.103:0/1526166370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8740cd080 0x7fe8740b4c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8680097a0 tx=0x7fe86802a1e0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f0b060e0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b000cf780 0x7f0b000c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f76006a7640 1 -- 172.21.15.103:0/979855993 shutdown_connections 2024-08-18T23:57:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f76006a7640 1 -- 172.21.15.103:0/979855993 wait complete. 2024-08-18T23:57:15.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.292+0000 7f0b060e0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b000cf780 0x7f0b000c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55176/0 (socket says 172.21.15.103:55176) 2024-08-18T23:57:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7fe87aacb640 1 -- 172.21.15.103:0/1526166370 shutdown_connections 2024-08-18T23:57:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7fe87aacb640 1 --2- 172.21.15.103:0/1526166370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8740cd080 0x7fe8740b4c80 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe8680097a0 tx=0x7fe86802a1e0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7fe87aacb640 1 -- 172.21.15.103:0/1526166370 >> 172.21.15.103:0/1526166370 conn(0x7fe8740d1e30 msgr2=0x7fe8740d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b08344640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0015e470 0x7f0b00160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b058df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b000d0ae0 0x7f0b000c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b058df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b000d0ae0 0x7f0b000c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43468/0 (socket says 172.21.15.103:43468) 2024-08-18T23:57:15.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f017ac8a640 1 -- 172.21.15.103:0/2057621285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f016c037cd0 msgr2=0x7f016c054e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f017ac8a640 1 --2- 172.21.15.103:0/2057621285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f016c037cd0 0x7f016c054e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.291+0000 7f017ac8a640 1 -- 172.21.15.103:0/2057621285 >> v2:172.21.15.103:3300/0 conn(0x7f016c037130 msgr2=0x7f016c037510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b08344640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000b8190 con 0x7f0b0015e470 2024-08-18T23:57:15.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b08344640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000cfc10 con 0x7f0b000cf780 2024-08-18T23:57:15.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f017ac8a640 1 --2- 172.21.15.103:0/2057621285 >> v2:172.21.15.103:3300/0 conn(0x7f016c037130 0x7f016c037510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f017ac8a640 1 -- 172.21.15.103:0/2057621285 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c054080 con 0x7f016c0348f0 2024-08-18T23:57:15.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b08344640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000b8310 con 0x7f0b000d0ae0 2024-08-18T23:57:15.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b060e0640 1 -- 172.21.15.103:0/1744450096 learned_addr learned my addr 172.21.15.103:0/1744450096 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f017a489640 1 --2- 172.21.15.103:0/2057621285 >> v2:172.21.15.103:3300/0 conn(0x7f016c037130 0x7f016c037510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7ff8b259c640 1 --2- 172.21.15.103:0/2487781425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415c1f0 0x7ff8b40d2a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40097d0 tx=0x7ff8a402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36822b5cddd1db18 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b068e1640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0015e470 0x7f0b00160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f00fddc8640 1 Processor -- start 2024-08-18T23:57:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f00fddc8640 1 -- start start 2024-08-18T23:57:15.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7fe3426b1640 1 Processor -- start 2024-08-18T23:57:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b060e0640 1 -- 172.21.15.103:0/1744450096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b000d0ae0 msgr2=0x7f0b000c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b060e0640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b000d0ae0 0x7f0b000c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b060e0640 1 -- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0015e470 msgr2=0x7f0b00160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b060e0640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b0015e470 0x7f0b00160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7f0b060e0640 1 -- 172.21.15.103:0/1744450096 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0015f7f0 con 0x7f0b000cf780 2024-08-18T23:57:15.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.293+0000 7ff8b159a640 1 -- 172.21.15.103:0/2487781425 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4037070 con 0x7ff8b415c1f0 2024-08-18T23:57:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7fe3426b1640 1 -- start start 2024-08-18T23:57:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f0b060e0640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b000cf780 0x7f0b000c7a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c430 tx=0x7f0af000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7ff8b159a640 1 -- 172.21.15.103:0/2487781425 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a4032440 con 0x7ff8b415c1f0 2024-08-18T23:57:15.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7ff8b159a640 1 -- 172.21.15.103:0/2487781425 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4037070 con 0x7ff8b415c1f0 2024-08-18T23:57:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af00074e0 con 0x7f0b000cf780 2024-08-18T23:57:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af00047e0 con 0x7f0b000cf780 2024-08-18T23:57:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0004bd0 con 0x7f0b000cf780 2024-08-18T23:57:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0015fad0 con 0x7f0b000cf780 2024-08-18T23:57:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f017ac8a640 1 --2- 172.21.15.103:0/2057621285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f016c0348f0 0x7f016c00aca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f017402db70 tx=0x7f01740a5ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4928c71083a84de9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b00160090 con 0x7f0b000cf780 2024-08-18T23:57:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7fe87aacb640 1 -- 172.21.15.103:0/1526166370 shutdown_connections 2024-08-18T23:57:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f00fddc8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f806b900 0x7f00f80c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f76006a7640 1 Processor -- start 2024-08-18T23:57:15.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7ff8b8fff640 1 -- 172.21.15.103:0/2487781425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415c1f0 msgr2=0x7ff8b40d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.294+0000 7f0179487640 1 -- 172.21.15.103:0/2057621285 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01740a9920 con 0x7f016c0348f0 2024-08-18T23:57:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f0179487640 1 -- 172.21.15.103:0/2057621285 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01740a9ac0 con 0x7f016c0348f0 2024-08-18T23:57:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f0179487640 1 -- 172.21.15.103:0/2057621285 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01740a9920 con 0x7f016c0348f0 2024-08-18T23:57:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f76006a7640 1 -- start start 2024-08-18T23:57:15.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7ff8b8fff640 1 --2- 172.21.15.103:0/2487781425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415c1f0 0x7ff8b40d2a00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40097d0 tx=0x7ff8a402a1c0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f00fddc8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f80cef10 0x7f00f80b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7fe87aacb640 1 -- 172.21.15.103:0/1526166370 wait complete. 2024-08-18T23:57:15.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f00fddc8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f80cf460 0x7f00f815ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7fe3426b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe334033a00 0x7fe3340dc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f00eeffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f80cef10 0x7f00f80b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f00eeffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f80cef10 0x7f00f80b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55188/0 (socket says 172.21.15.103:55188) 2024-08-18T23:57:15.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7ff8b8fff640 1 -- 172.21.15.103:0/2487781425 shutdown_connections 2024-08-18T23:57:15.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7ff8b8fff640 1 --2- 172.21.15.103:0/2487781425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b40cf050 0x7ff8b40cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7ff8b8fff640 1 --2- 172.21.15.103:0/2487781425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415c1f0 0x7ff8b40d2a00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7ff8b8fff640 1 -- 172.21.15.103:0/2487781425 >> 172.21.15.103:0/2487781425 conn(0x7ff8b40d1ee0 msgr2=0x7ff8b40d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7ff8b8fff640 1 -- 172.21.15.103:0/2487781425 shutdown_connections 2024-08-18T23:57:15.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7fe3416af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe334033a00 0x7fe3340dc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f00eeffd640 1 -- 172.21.15.103:0/2858567197 learned_addr learned my addr 172.21.15.103:0/2858567197 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7fe3416af640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe334033a00 0x7fe3340dc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38280/0 (socket says 172.21.15.103:38280) 2024-08-18T23:57:15.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00f8162810 con 0x7f00f806b900 2024-08-18T23:57:15.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7fe3416af640 1 -- 172.21.15.103:0/2133295399 learned_addr learned my addr 172.21.15.103:0/2133295399 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f00f80af2c0 con 0x7f00f80cef10 2024-08-18T23:57:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7f00f7fff640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f80cf460 0x7f00f815ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f00f8162990 con 0x7f00f80cf460 2024-08-18T23:57:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7fe3426b1640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 0x7fe3340e82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f017b48b640 1 -- 172.21.15.103:0/2057621285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f016c0348f0 msgr2=0x7f016c00aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f017b48b640 1 --2- 172.21.15.103:0/2057621285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f016c0348f0 0x7f016c00aca0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f017402db70 tx=0x7f01740a5ae0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.295+0000 7ff8b8fff640 1 -- 172.21.15.103:0/2487781425 wait complete. 2024-08-18T23:57:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f017b48b640 1 -- 172.21.15.103:0/2057621285 shutdown_connections 2024-08-18T23:57:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f017b48b640 1 --2- 172.21.15.103:0/2057621285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f016c0348f0 0x7f016c00aca0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f017b48b640 1 --2- 172.21.15.103:0/2057621285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f016c037cd0 0x7f016c054e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f017b48b640 1 --2- 172.21.15.103:0/2057621285 >> v2:172.21.15.103:3300/0 conn(0x7f016c037130 0x7f016c037510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f017b48b640 1 -- 172.21.15.103:0/2057621285 >> 172.21.15.103:0/2057621285 conn(0x7f016c01ea40 msgr2=0x7f016c0556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f0af4ff9640 1 -- 172.21.15.103:0/1744450096 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b00160470 con 0x7f0b000cf780 2024-08-18T23:57:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7fe3426b1640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340dce70 0x7fe3340e8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7fe3426b1640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe3340e7360 con 0x7fe334033a00 2024-08-18T23:57:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7fe3426b1640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe334006c80 con 0x7fe3340dce70 2024-08-18T23:57:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7fe3426b1640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe33404aa30 con 0x7fe334047c10 2024-08-18T23:57:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f76006a7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75f8072c50 0x7f75f815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f76006a7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75f8144590 0x7f75f8137530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f75fe443640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75f8072c50 0x7f75f815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f75fe443640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75f8072c50 0x7f75f815b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43492/0 (socket says 172.21.15.103:43492) 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f76006a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75f815ea90 0x7f75f8137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f76006a7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f75f80cbef0 con 0x7f75f815ea90 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f75fe443640 1 -- 172.21.15.103:0/1063114634 learned_addr learned my addr 172.21.15.103:0/1063114634 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f75fec44640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75f815ea90 0x7f75f8137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f75f8144b80 con 0x7f75f8144590 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f75f80cc070 con 0x7f75f8072c50 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f00f7fff640 1 -- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f80cef10 msgr2=0x7f00f80b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f00f7fff640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00f80cef10 0x7f00f80b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f00f7fff640 1 -- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f806b900 msgr2=0x7f00f80c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f00f77fe640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f806b900 0x7f00f80c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f00f7fff640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f806b900 0x7f00f80c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f00f7fff640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f80b0740 con 0x7f00f80cf460 2024-08-18T23:57:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f017b48b640 1 -- 172.21.15.103:0/2057621285 shutdown_connections 2024-08-18T23:57:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7fe340eae640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 0x7fe3340e82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0af0011070 con 0x7f0b000cf780 2024-08-18T23:57:15.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.296+0000 7f00f77fe640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f806b900 0x7f00f80c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:15.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f00f7fff640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f80cf460 0x7f00f815ebe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f00f000ccc0 tx=0x7f00f000a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f75fe443640 1 -- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75f8144590 msgr2=0x7f75f8137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f75fe443640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75f8144590 0x7f75f8137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f75fe443640 1 -- 172.21.15.103:0/1063114634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75f815ea90 msgr2=0x7f75f8137a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f75fe443640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75f815ea90 0x7f75f8137a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f75fe443640 1 -- 172.21.15.103:0/1063114634 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f81386d0 con 0x7f75f8072c50 2024-08-18T23:57:15.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f000f680 con 0x7f00f80cf460 2024-08-18T23:57:15.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f000f820 con 0x7f00f80cf460 2024-08-18T23:57:15.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7fe87aacb640 1 Processor -- start 2024-08-18T23:57:15.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f80b0a10 con 0x7f00f80cf460 2024-08-18T23:57:15.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7fe87aacb640 1 -- start start 2024-08-18T23:57:15.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f0af6ffd640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ae406be30 0x7f0ae406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f7e83cfc640 1 Processor -- start 2024-08-18T23:57:15.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7fe341eb0640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340dce70 0x7fe3340e8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7fe340eae640 1 -- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340dce70 msgr2=0x7fe3340e8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f75fe443640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75f8072c50 0x7f75f815b8a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f75f4000c00 tx=0x7f75f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7fe340eae640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3340dce70 0x7fe3340e8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7fe340eae640 1 -- 172.21.15.103:0/2133295399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe334033a00 msgr2=0x7fe3340dc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7fe340eae640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe334033a00 0x7fe3340dc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7ff8b8fff640 1 Processor -- start 2024-08-18T23:57:15.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7fe340eae640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33404ad10 con 0x7fe334047c10 2024-08-18T23:57:15.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7fe3416af640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe334033a00 0x7fe3340dc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:15.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7ff8b8fff640 1 -- start start 2024-08-18T23:57:15.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f0b058df640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ae406be30 0x7f0ae406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f80b0fd0 con 0x7f00f80cf460 2024-08-18T23:57:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4041020 con 0x7f75f8072c50 2024-08-18T23:57:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f4030990 con 0x7f75f8072c50 2024-08-18T23:57:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4037040 con 0x7f75f8072c50 2024-08-18T23:57:15.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f815bfb0 con 0x7f75f8072c50 2024-08-18T23:57:15.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f815ca90 con 0x7f75f8072c50 2024-08-18T23:57:15.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.297+0000 7f017b48b640 1 -- 172.21.15.103:0/2057621285 wait complete. 2024-08-18T23:57:15.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f017b48b640 1 Processor -- start 2024-08-18T23:57:15.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f000fc10 con 0x7f00f80cf460 2024-08-18T23:57:15.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7fe87aacb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8740cd4f0 0x7fe8740c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f7e83cfc640 1 -- start start 2024-08-18T23:57:15.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7ff8b8fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b40cf050 0x7ff8b40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7fe87aacb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe87415f5c0 0x7fe874157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e83cfc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7e7c071ff0 0x7f7e7c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e83cfc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7e7c0cb580 0x7f7e7c159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e83cfc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7c0ce400 con 0x7f7e7c0723d0 2024-08-18T23:57:15.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e83cfc640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7e7c070010 con 0x7f7e7c071ff0 2024-08-18T23:57:15.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e83cfc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7e7c0cf010 con 0x7f7e7c0cb580 2024-08-18T23:57:15.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7fe87aacb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe874156380 0x7fe8740c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f00edffb640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f00d0001030 con 0x7f00f80cf460 2024-08-18T23:57:15.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0af008ad10 con 0x7f0b000cf780 2024-08-18T23:57:15.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.298+0000 7f0af6ffd640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7f0ae40755b0 0x7f0ae40779f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e81297640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7e7c0723d0 0x7f7e7c06f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45736/0 (socket says 172.21.15.103:45736) 2024-08-18T23:57:15.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e81297640 1 -- 172.21.15.103:0/2068927836 learned_addr learned my addr 172.21.15.103:0/2068927836 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:15.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 --> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ae40780c0 con 0x7f0ae40755b0 2024-08-18T23:57:15.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0af008d370 con 0x7f0b000cf780 2024-08-18T23:57:15.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7fe87aacb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe8740d09d0 con 0x7fe874156380 2024-08-18T23:57:15.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7fe87aacb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8740d0410 con 0x7fe8740cd4f0 2024-08-18T23:57:15.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e81a98640 1 --2- 172.21.15.103:0/2068927836 >> v2:172.21.15.103:3300/0 conn(0x7f7e7c071ff0 0x7f7e7c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f7e82299640 1 --2- 172.21.15.103:0/2068927836 >> v2:172.21.15.190:3300/0 conn(0x7f7e7c0cb580 0x7f7e7c159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7fe87aacb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8740d2b00 con 0x7fe87415f5c0 2024-08-18T23:57:15.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f0b058df640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ae406be30 0x7f0ae406e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0afc034000 tx=0x7f0afc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe340eae640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 0x7fe3340e82e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe334054f40 tx=0x7fe33800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.299+0000 7f017b48b640 1 -- start start 2024-08-18T23:57:15.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f017b48b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f016c0348f0 0x7f016c04f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe873fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe87415f5c0 0x7fe874157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe873fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe87415f5c0 0x7fe874157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43508/0 (socket says 172.21.15.103:43508) 2024-08-18T23:57:15.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe879068640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe874156380 0x7fe8740c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe879068640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe874156380 0x7fe8740c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38328/0 (socket says 172.21.15.103:38328) 2024-08-18T23:57:15.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe873fff640 1 -- 172.21.15.103:0/463563659 learned_addr learned my addr 172.21.15.103:0/463563659 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b8fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b415c1f0 0x7ff8b40b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b8fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415fc50 0x7ff8b414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b8fff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b40cddd0 con 0x7ff8b40cf050 2024-08-18T23:57:15.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b8fff640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b40cd370 con 0x7ff8b415fc50 2024-08-18T23:57:15.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b8fff640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff8b40cca60 con 0x7ff8b415c1f0 2024-08-18T23:57:15.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b40cf050 0x7ff8b40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f0b068e1640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7f0ae40755b0 0x7f0ae40779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f017b48b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c037130 0x7f016c050aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f017b48b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f016c037cd0 0x7f016c050fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f017b48b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f016c055380 con 0x7f016c037130 2024-08-18T23:57:15.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f017b48b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f016c054640 con 0x7f016c037cd0 2024-08-18T23:57:15.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f017b48b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f016c034d80 con 0x7f016c0348f0 2024-08-18T23:57:15.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe878867640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8740cd4f0 0x7fe8740c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75f4044020 con 0x7f75f8072c50 2024-08-18T23:57:15.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f0179c88640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c037130 0x7f016c050aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f0179c88640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c037130 0x7f016c050aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38332/0 (socket says 172.21.15.103:38332) 2024-08-18T23:57:15.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f0179c88640 1 -- 172.21.15.103:0/1494916514 learned_addr learned my addr 172.21.15.103:0/1494916514 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b1d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b415c1f0 0x7ff8b40b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b1d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b415c1f0 0x7ff8b40b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43524/0 (socket says 172.21.15.103:43524) 2024-08-18T23:57:15.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7ff8b1d9b640 1 -- 172.21.15.103:0/3981142754 learned_addr learned my addr 172.21.15.103:0/3981142754 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f017a489640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f016c0348f0 0x7f016c04f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe873fff640 1 -- 172.21.15.103:0/463563659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8740cd4f0 msgr2=0x7fe8740c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7fe873fff640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8740cd4f0 0x7fe8740c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7fe873fff640 1 -- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe874156380 msgr2=0x7fe8740c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7fe873fff640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe874156380 0x7fe8740c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7fe873fff640 1 -- 172.21.15.103:0/463563659 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe874157f90 con 0x7fe87415f5c0 2024-08-18T23:57:15.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75f815bde0 con 0x7f75f8072c50 2024-08-18T23:57:15.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f017ac8a640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f016c037cd0 0x7f016c050fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80112918 0 0) 0x7f7e7c0ce400 con 0x7f7e7c0723d0 2024-08-18T23:57:15.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e64003520 con 0x7f7e7c0723d0 2024-08-18T23:57:15.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1292406545 0 0) 0x7f7e64003520 con 0x7f7e7c0723d0 2024-08-18T23:57:15.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 >> v2:172.21.15.190:3300/0 conn(0x7f7e7c0cb580 msgr2=0x7f7e7c159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 --2- 172.21.15.103:0/2068927836 >> v2:172.21.15.190:3300/0 conn(0x7f7e7c0cb580 0x7f7e7c159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 >> v2:172.21.15.103:3300/0 conn(0x7f7e7c071ff0 msgr2=0x7f7e7c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 --2- 172.21.15.103:0/2068927836 >> v2:172.21.15.103:3300/0 conn(0x7f7e7c071ff0 0x7f7e7c0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c0ce6e0 con 0x7f7e7c0723d0 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f7e6c0019f0 con 0x7f7e7c0723d0 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 >> v1:172.21.15.190:6789/0 conn(0x7f7e7c0723d0 legacy=0x7f7e7c06f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e640039b0 0x7f7e64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e64004800 0x7f7e64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e640051c0 0x7f7e6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c070010 con 0x7f7e64004800 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c0cf010 con 0x7f7e640039b0 2024-08-18T23:57:15.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.300+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7e6400c090 con 0x7f7e640051c0 2024-08-18T23:57:15.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f0b068e1640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7f0ae40755b0 0x7f0ae40779f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f0179c88640 1 -- 172.21.15.103:0/1494916514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f016c0348f0 msgr2=0x7f016c04f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f0179c88640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f016c0348f0 0x7f016c04f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f0179c88640 1 -- 172.21.15.103:0/1494916514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f016c037cd0 msgr2=0x7f016c050fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f0179c88640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f016c037cd0 0x7f016c050fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f0179c88640 1 -- 172.21.15.103:0/1494916514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c04ca00 con 0x7f016c037130 2024-08-18T23:57:15.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f7e81297640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e64004800 0x7f7e64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f7e81a98640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e640039b0 0x7f7e64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f75eeffd640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75dc06be80 0x7f75dc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f00f0018400 con 0x7f00f80cf460 2024-08-18T23:57:15.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f75f40abba0 con 0x7f75f8072c50 2024-08-18T23:57:15.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f75fdc42640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75dc06be80 0x7f75dc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7ff8b2d9d640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415fc50 0x7ff8b414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7ff8b1d9b640 1 -- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415fc50 msgr2=0x7ff8b414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f75eeffd640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7f75dc075570 0x7f75dc0779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 --> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75f4032440 con 0x7f75dc075570 2024-08-18T23:57:15.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f75f4078fb0 con 0x7f75f8072c50 2024-08-18T23:57:15.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.301+0000 7f0179c88640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c037130 0x7f016c050aa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f016400b410 tx=0x7f016400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f7e81a98640 1 -- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e640051c0 msgr2=0x7f7e6400b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T23:57:15.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f7e81a98640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e640051c0 0x7f7e6400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f7e81a98640 1 -- 172.21.15.103:0/2068927836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e64004800 msgr2=0x7f7e64004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f7e81a98640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e64004800 0x7f7e64004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f7e81a98640 1 -- 172.21.15.103:0/2068927836 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c0ce6e0 con 0x7f7e640039b0 2024-08-18T23:57:15.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f7e81297640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e64004800 0x7f7e64004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:15.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f00f4ff9640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f00d806bf00 0x7f00d806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7ff8b1d9b640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415fc50 0x7ff8b414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7ff8b1d9b640 1 -- 172.21.15.103:0/3981142754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b40cf050 msgr2=0x7ff8b40b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7ff8b1d9b640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b40cf050 0x7ff8b40b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f75fec44640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7f75dc075570 0x7f75dc0779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f7e82299640 1 -- 172.21.15.103:0/2068927836 reap_dead start 2024-08-18T23:57:15.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7ff8b1d9b640 1 -- 172.21.15.103:0/3981142754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b40b7300 con 0x7ff8b415c1f0 2024-08-18T23:57:15.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 <== osd.2 v2:172.21.15.103:6824/1313986771 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0ae40780c0 con 0x7f0ae40755b0 2024-08-18T23:57:15.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7ff8b2d9d640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff8b415fc50 0x7ff8b414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:15.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164015020 con 0x7f016c037130 2024-08-18T23:57:15.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0164011830 con 0x7f016c037130 2024-08-18T23:57:15.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016c04cce0 con 0x7f016c037130 2024-08-18T23:57:15.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338017070 con 0x7fe334047c10 2024-08-18T23:57:15.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33800c700 con 0x7fe334047c10 2024-08-18T23:57:15.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f00f77fe640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f00d806bf00 0x7f00d806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7fe873fff640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe87415f5c0 0x7fe874157820 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe868035040 tx=0x7fe8680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7ff8b259c640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b40cf050 0x7ff8b40b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:15.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f016c04d2a0 con 0x7f016c037130 2024-08-18T23:57:15.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164011c20 con 0x7f016c037130 2024-08-18T23:57:15.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7ff8b1d9b640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b415c1f0 0x7ff8b40b2020 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800e870 tx=0x7ff8a800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f00f008c9a0 con 0x7f00f80cf460 2024-08-18T23:57:15.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7f00f77fe640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f00d806bf00 0x7f00d806e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f00e8034000 tx=0x7f00e802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868037040 con 0x7fe87415f5c0 2024-08-18T23:57:15.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7f7e81a98640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e640039b0 0x7f7e64003dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400be80 tx=0x7f7e64005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96d6b01b762f60b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7fe3426b1640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3340317a0 con 0x7fe334047c10 2024-08-18T23:57:15.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338017070 con 0x7fe334047c10 2024-08-18T23:57:15.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.302+0000 7fe3426b1640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33404a650 con 0x7fe334047c10 2024-08-18T23:57:15.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7f00f4ff9640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f00d8075680 0x7f00d8077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f00f0006b90 con 0x7f00d8075680 2024-08-18T23:57:15.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7f75fdc42640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75dc06be80 0x7f75dc06e340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75f8168f30 tx=0x7f75e8006ba0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f00f008cd90 con 0x7f00f80cf460 2024-08-18T23:57:15.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7f00eeffd640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f00d8075680 0x7f00d8077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe318001030 con 0x7fe334047c10 2024-08-18T23:57:15.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8017070 con 0x7ff8b415c1f0 2024-08-18T23:57:15.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8a800c940 con 0x7ff8b415c1f0 2024-08-18T23:57:15.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74031070 con 0x7f7e640039b0 2024-08-18T23:57:15.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7402be50 con 0x7f7e640039b0 2024-08-18T23:57:15.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f015c001030 con 0x7f016c037130 2024-08-18T23:57:15.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7f7e80a96640 1 -- 172.21.15.103:0/2068927836 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400d160 con 0x7f7e640039b0 2024-08-18T23:57:15.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7f75fec44640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7f75dc075570 0x7f75dc0779b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0164018020 con 0x7f016c037130 2024-08-18T23:57:15.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8740c58d0 con 0x7fe87415f5c0 2024-08-18T23:57:15.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.303+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8740c5e90 con 0x7fe87415f5c0 2024-08-18T23:57:15.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe868032440 con 0x7fe87415f5c0 2024-08-18T23:57:15.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.304+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868006e10 con 0x7fe87415f5c0 2024-08-18T23:57:15.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe854001030 con 0x7fe87415f5c0 2024-08-18T23:57:15.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f016affd640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f015806bf00 0x7f015806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800cd10 con 0x7ff8b415c1f0 2024-08-18T23:57:15.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f7e83cfc640 1 -- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e640039b0 msgr2=0x7f7e64003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f7e83cfc640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e640039b0 0x7f7e64003dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400be80 tx=0x7f7e64005830 comp rx=0 tx=0).stop 2024-08-18T23:57:15.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b40b2560 con 0x7ff8b415c1f0 2024-08-18T23:57:15.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f016408afd0 con 0x7f016c037130 2024-08-18T23:57:15.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f7e83cfc640 1 -- 172.21.15.103:0/2068927836 shutdown_connections 2024-08-18T23:57:15.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f7e83cfc640 1 --2- 172.21.15.103:0/2068927836 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e640039b0 0x7f7e64003dd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f7e83cfc640 1 -- 172.21.15.103:0/2068927836 >> 172.21.15.103:0/2068927836 conn(0x7f7e7c0b18b0 msgr2=0x7f7e7c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b41e6590 con 0x7ff8b415c1f0 2024-08-18T23:57:15.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f016affd640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f0158075680 0x7f0158077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 --> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0158078190 con 0x7f0158075680 2024-08-18T23:57:15.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f016408d5d0 con 0x7f016c037130 2024-08-18T23:57:15.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f7e83cfc640 1 -- 172.21.15.103:0/2068927836 shutdown_connections 2024-08-18T23:57:15.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f017a489640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f015806bf00 0x7f015806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f017ac8a640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f0158075680 0x7f0158077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f00eeffd640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f00d8075680 0x7f00d8077ac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 <== osd.6 v2:172.21.15.190:6824/1150487598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75f4032440 con 0x7f75dc075570 2024-08-18T23:57:15.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.306+0000 7f017ac8a640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f0158075680 0x7f0158077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.306+0000 7f017a489640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f015806bf00 0x7f015806e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0170009500 tx=0x7f0170008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.305+0000 7f7e83cfc640 1 -- 172.21.15.103:0/2068927836 wait complete. 2024-08-18T23:57:15.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.306+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8b40cd890 con 0x7ff8b415c1f0 2024-08-18T23:57:15.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.306+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe33801a070 con 0x7fe334047c10 2024-08-18T23:57:15.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.306+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 <== osd.7 v2:172.21.15.190:6808/3667598505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f00f0006b90 con 0x7f00d8075680 2024-08-18T23:57:15.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.307+0000 7fe331ffb640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe32006c030 0x7fe32006e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.307+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 <== osd.0 v2:172.21.15.103:6808/927187765 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0158078190 con 0x7f0158075680 2024-08-18T23:57:15.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.307+0000 7f7e83cfc640 1 Processor -- start 2024-08-18T23:57:15.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.307+0000 7f7e83cfc640 1 -- start start 2024-08-18T23:57:15.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.307+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff8a801a070 con 0x7ff8b415c1f0 2024-08-18T23:57:15.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7ff8a2ffd640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff89406be80 0x7ff89406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff8a808afb0 con 0x7ff8b415c1f0 2024-08-18T23:57:15.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7ff8b259c640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff89406be80 0x7ff89406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.307+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe86803a070 con 0x7fe87415f5c0 2024-08-18T23:57:15.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7fe8717fa640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe858070240 0x7fe858072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe8680abc00 con 0x7fe87415f5c0 2024-08-18T23:57:15.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7ff8a2ffd640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7ff894075600 0x7ff894077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7fe8717fa640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7fe8580799b0 0x7fe85807bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 --> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8a8015e50 con 0x7ff894075600 2024-08-18T23:57:15.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff8a808d5d0 con 0x7ff8b415c1f0 2024-08-18T23:57:15.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7fe879068640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7fe8580799b0 0x7fe85807bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.308+0000 7ff8b259c640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff89406be80 0x7ff89406e340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4034000 tx=0x7ff8a402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e83cfc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e640039b0 0x7f7e7c155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e83cfc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7c1fc1b0 0x7f7e7c155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e83cfc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e7c0728b0 0x7f7e7c072d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e81a98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e640039b0 0x7f7e7c155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e81a98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e640039b0 0x7f7e7c155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38362/0 (socket says 172.21.15.103:38362) 2024-08-18T23:57:15.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7ff8b2d9d640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7ff894075600 0x7ff894077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e81a98640 1 -- 172.21.15.103:0/3716044142 learned_addr learned my addr 172.21.15.103:0/3716044142 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e81297640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7c1fc1b0 0x7f7e7c155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c0b23a0 con 0x7f7e640039b0 2024-08-18T23:57:15.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e82299640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e7c0728b0 0x7f7e7c072d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c0ceca0 con 0x7f7e7c0728b0 2024-08-18T23:57:15.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7c0b2520 con 0x7f7e7c1fc1b0 2024-08-18T23:57:15.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7ff8b2d9d640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7ff894075600 0x7ff894077a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe3380574e0 con 0x7fe334047c10 2024-08-18T23:57:15.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7fe3416af640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe32006c030 0x7fe32006e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7fe331ffb640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fe3200763d0 0x7fe320078870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe320078f40 con 0x7fe3200763d0 2024-08-18T23:57:15.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe338055e70 con 0x7fe334047c10 2024-08-18T23:57:15.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 --> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe868064ec0 con 0x7fe8580799b0 2024-08-18T23:57:15.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe8680abff0 con 0x7fe87415f5c0 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.309+0000 7fe879068640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7fe8580799b0 0x7fe85807bdf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 <== osd.1 v2:172.21.15.103:6800/3370631755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe868064ec0 con 0x7fe8580799b0 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7fe878867640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe858070240 0x7fe858072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7f7e82299640 1 -- 172.21.15.103:0/3716044142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7c1fc1b0 msgr2=0x7f7e7c155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7f7e82299640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e7c1fc1b0 0x7f7e7c155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7f7e82299640 1 -- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e640039b0 msgr2=0x7f7e7c155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7f7e82299640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7e640039b0 0x7f7e7c155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7f7e82299640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c1fc6b0 con 0x7f7e7c0728b0 2024-08-18T23:57:15.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7fe341eb0640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fe3200763d0 0x7fe320078870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 <== osd.4 v2:172.21.15.190:6816/491823420 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8a8015e50 con 0x7ff894075600 2024-08-18T23:57:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.310+0000 7f7e82299640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e7c0728b0 0x7f7e7c072d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c071bf0 tx=0x7f7e7000eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.311+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00a4f0 con 0x7f7e7c0728b0 2024-08-18T23:57:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.311+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e7001a070 con 0x7f7e7c0728b0 2024-08-18T23:57:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.311+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00a4f0 con 0x7f7e7c0728b0 2024-08-18T23:57:15.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.311+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c0c94f0 con 0x7f7e7c0728b0 2024-08-18T23:57:15.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.311+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c0c9ab0 con 0x7f7e7c0728b0 2024-08-18T23:57:15.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.311+0000 7fe3416af640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe32006c030 0x7fe32006e4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe33c06b230 tx=0x7fe33c0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.312+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7e5c001030 con 0x7f7e7c0728b0 2024-08-18T23:57:15.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.312+0000 7fe341eb0640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fe3200763d0 0x7fe320078870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.313+0000 7fe878867640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe858070240 0x7fe858072700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe860007fd0 tx=0x7fe860009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.313+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e70004020 con 0x7f7e7c0728b0 2024-08-18T23:57:15.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.314+0000 7f7e7a7fc640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e6806c260 0x7f7e6806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.314+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e7000f040 con 0x7f7e7c0728b0 2024-08-18T23:57:15.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.314+0000 7f7e7a7fc640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f7e68076530 0x7f7e680789d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.314+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e680790a0 con 0x7f7e68076530 2024-08-18T23:57:15.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.315+0000 7f7e81297640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f7e68076530 0x7f7e680789d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.313+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 <== osd.5 v2:172.21.15.190:6800/1802306472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe320078f40 con 0x7fe3200763d0 2024-08-18T23:57:15.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.315+0000 7f7e81297640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f7e68076530 0x7f7e680789d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.316+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 <== osd.3 v2:172.21.15.103:6816/2012367824 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7e680790a0 con 0x7f7e68076530 2024-08-18T23:57:15.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.316+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e70054b50 con 0x7f7e7c0728b0 2024-08-18T23:57:15.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.317+0000 7f7e81a98640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e6806c260 0x7f7e6806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.329+0000 7f7e81a98640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e6806c260 0x7f7e6806e720 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000c00 tx=0x7f7e74031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.329+0000 7f0af4ff9640 1 -- 172.21.15.103:0/1744450096 --> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0b0009db70 con 0x7f0ae40755b0 2024-08-18T23:57:15.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.330+0000 7f0af6ffd640 1 -- 172.21.15.103:0/1744450096 <== osd.2 v2:172.21.15.103:6824/1313986771 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0b0009db70 con 0x7f0ae40755b0 2024-08-18T23:57:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.330+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7f0ae40755b0 msgr2=0x7f0ae40779f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.331+0000 7f0b08344640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7f0ae40755b0 0x7f0ae40779f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.331+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ae406be30 msgr2=0x7f0ae406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.331+0000 7f0b08344640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ae406be30 0x7f0ae406e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0afc034000 tx=0x7f0afc02e000 comp rx=0 tx=0).stop 2024-08-18T23:57:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.331+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b000cf780 msgr2=0x7f0b000c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.331+0000 7f0b08344640 1 --2- 172.21.15.103:0/1744450096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b000cf780 0x7f0b000c7a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c430 tx=0x7f0af000c8f0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.331+0000 7f0b068e1640 1 -- 172.21.15.103:0/1744450096 reap_dead start 2024-08-18T23:57:15.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.331+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 shutdown_connections 2024-08-18T23:57:15.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.331+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 >> 172.21.15.103:0/1744450096 conn(0x7f0b0009d410 msgr2=0x7f0b00161360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.333+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 shutdown_connections 2024-08-18T23:57:15.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.336+0000 7f0b08344640 1 -- 172.21.15.103:0/1744450096 wait complete. 2024-08-18T23:57:15.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.336+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 --> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f75f80ce6d0 con 0x7f75dc075570 2024-08-18T23:57:15.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.337+0000 7f75eeffd640 1 -- 172.21.15.103:0/1063114634 <== osd.6 v2:172.21.15.190:6824/1150487598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f75f80ce6d0 con 0x7f75dc075570 2024-08-18T23:57:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.337+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7f75dc075570 msgr2=0x7f75dc0779b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.337+0000 7f76006a7640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7f75dc075570 0x7f75dc0779b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.337+0000 7f00edffb640 1 -- 172.21.15.103:0/2858567197 --> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f00d0002dd0 con 0x7f00d8075680 2024-08-18T23:57:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75dc06be80 msgr2=0x7f75dc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f76006a7640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75dc06be80 0x7f75dc06e340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f75f8168f30 tx=0x7f75e8006ba0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75f8072c50 msgr2=0x7f75f815b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f76006a7640 1 --2- 172.21.15.103:0/1063114634 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75f8072c50 0x7f75f815b8a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f75f4000c00 tx=0x7f75f40046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f75fec44640 1 -- 172.21.15.103:0/1063114634 reap_dead start 2024-08-18T23:57:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 shutdown_connections 2024-08-18T23:57:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 >> 172.21.15.103:0/1063114634 conn(0x7f75f80d0bc0 msgr2=0x7f75f806fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f00f4ff9640 1 -- 172.21.15.103:0/2858567197 <== osd.7 v2:172.21.15.190:6808/3667598505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f00d0002dd0 con 0x7f00d8075680 2024-08-18T23:57:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.338+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f00d8075680 msgr2=0x7f00d8077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 shutdown_connections 2024-08-18T23:57:15.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f76006a7640 1 -- 172.21.15.103:0/1063114634 wait complete. 2024-08-18T23:57:15.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00fddc8640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f00d8075680 0x7f00d8077ac0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f00d806bf00 msgr2=0x7f00d806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00fddc8640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f00d806bf00 0x7f00d806e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f00e8034000 tx=0x7f00e802e000 comp rx=0 tx=0).stop 2024-08-18T23:57:15.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f80cf460 msgr2=0x7f00f815ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00fddc8640 1 --2- 172.21.15.103:0/2858567197 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00f80cf460 0x7f00f815ebe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f00f000ccc0 tx=0x7f00f000a650 comp rx=0 tx=0).stop 2024-08-18T23:57:15.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00f7fff640 1 -- 172.21.15.103:0/2858567197 reap_dead start 2024-08-18T23:57:15.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 shutdown_connections 2024-08-18T23:57:15.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 >> 172.21.15.103:0/2858567197 conn(0x7f00f80cc6e0 msgr2=0x7f00f8161650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.339+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 shutdown_connections 2024-08-18T23:57:15.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.340+0000 7f00fddc8640 1 -- 172.21.15.103:0/2858567197 wait complete. 2024-08-18T23:57:15.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.340+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 --> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f015c002dd0 con 0x7f0158075680 2024-08-18T23:57:15.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.340+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 --> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7e5c002e10 con 0x7f7e68076530 2024-08-18T23:57:15.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.340+0000 7f016affd640 1 -- 172.21.15.103:0/1494916514 <== osd.0 v2:172.21.15.103:6808/927187765 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f015c002dd0 con 0x7f0158075680 2024-08-18T23:57:15.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.340+0000 7f7e7a7fc640 1 -- 172.21.15.103:0/3716044142 <== osd.3 v2:172.21.15.103:6816/2012367824 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7e5c002e10 con 0x7f7e68076530 2024-08-18T23:57:15.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f7e68076530 msgr2=0x7f7e680789d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f7e68076530 0x7f7e680789d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e6806c260 msgr2=0x7f7e6806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e6806c260 0x7f7e6806e720 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7e74000c00 tx=0x7f7e74031000 comp rx=0 tx=0).stop 2024-08-18T23:57:15.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e7c0728b0 msgr2=0x7f7e7c072d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 --2- 172.21.15.103:0/3716044142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e7c0728b0 0x7f7e7c072d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c071bf0 tx=0x7f7e7000eb40 comp rx=0 tx=0).stop 2024-08-18T23:57:15.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e82299640 1 -- 172.21.15.103:0/3716044142 reap_dead start 2024-08-18T23:57:15.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 shutdown_connections 2024-08-18T23:57:15.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 >> 172.21.15.103:0/3716044142 conn(0x7f7e7c0b18b0 msgr2=0x7f7e7c0aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f0158075680 msgr2=0x7f0158077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 shutdown_connections 2024-08-18T23:57:15.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 --> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8b40b7e60 con 0x7ff894075600 2024-08-18T23:57:15.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f7e83cfc640 1 -- 172.21.15.103:0/3716044142 wait complete. 2024-08-18T23:57:15.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017b48b640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f0158075680 0x7f0158077ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.342+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 --> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe854002dd0 con 0x7fe8580799b0 2024-08-18T23:57:15.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f015806bf00 msgr2=0x7f015806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017b48b640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f015806bf00 0x7f015806e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0170009500 tx=0x7f0170008040 comp rx=0 tx=0).stop 2024-08-18T23:57:15.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c037130 msgr2=0x7f016c050aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017b48b640 1 --2- 172.21.15.103:0/1494916514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f016c037130 0x7f016c050aa0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f016400b410 tx=0x7f016400b8d0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.342+0000 7ff8a2ffd640 1 -- 172.21.15.103:0/3981142754 <== osd.4 v2:172.21.15.190:6816/491823420 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff8b40b7e60 con 0x7ff894075600 2024-08-18T23:57:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017ac8a640 1 -- 172.21.15.103:0/1494916514 reap_dead start 2024-08-18T23:57:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 shutdown_connections 2024-08-18T23:57:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.341+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 >> 172.21.15.103:0/1494916514 conn(0x7f016c01ea40 msgr2=0x7f016c0358d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.342+0000 7fe8717fa640 1 -- 172.21.15.103:0/463563659 <== osd.1 v2:172.21.15.103:6800/3370631755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe854002dd0 con 0x7fe8580799b0 2024-08-18T23:57:15.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.342+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 shutdown_connections 2024-08-18T23:57:15.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.342+0000 7f017b48b640 1 -- 172.21.15.103:0/1494916514 wait complete. 2024-08-18T23:57:15.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.342+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7ff894075600 msgr2=0x7ff894077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7ff894075600 0x7ff894077a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff89406be80 msgr2=0x7ff89406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff89406be80 0x7ff89406e340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4034000 tx=0x7ff8a402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b415c1f0 msgr2=0x7ff8b40b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 --2- 172.21.15.103:0/3981142754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff8b415c1f0 0x7ff8b40b2020 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800e870 tx=0x7ff8a800ed30 comp rx=0 tx=0).stop 2024-08-18T23:57:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b2d9d640 1 -- 172.21.15.103:0/3981142754 reap_dead start 2024-08-18T23:57:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 shutdown_connections 2024-08-18T23:57:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 >> 172.21.15.103:0/3981142754 conn(0x7ff8b40d1ee0 msgr2=0x7ff8b4160100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7fe8580799b0 msgr2=0x7fe85807bdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe87aacb640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7fe8580799b0 0x7fe85807bdf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe858070240 msgr2=0x7fe858072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe87aacb640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe858070240 0x7fe858072700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe860007fd0 tx=0x7fe860009040 comp rx=0 tx=0).stop 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe87415f5c0 msgr2=0x7fe874157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe87aacb640 1 --2- 172.21.15.103:0/463563659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe87415f5c0 0x7fe874157820 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe868035040 tx=0x7fe8680046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe879068640 1 -- 172.21.15.103:0/463563659 reap_dead start 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 shutdown_connections 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 >> 172.21.15.103:0/463563659 conn(0x7fe8740d1e30 msgr2=0x7fe87406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 shutdown_connections 2024-08-18T23:57:15.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.343+0000 7ff8b8fff640 1 -- 172.21.15.103:0/3981142754 wait complete. 2024-08-18T23:57:15.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.344+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 --> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe318002dd0 con 0x7fe3200763d0 2024-08-18T23:57:15.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.344+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 shutdown_connections 2024-08-18T23:57:15.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.344+0000 7fe87aacb640 1 -- 172.21.15.103:0/463563659 wait complete. 2024-08-18T23:57:15.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.345+0000 7fe331ffb640 1 -- 172.21.15.103:0/2133295399 <== osd.5 v2:172.21.15.190:6800/1802306472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe318002dd0 con 0x7fe3200763d0 2024-08-18T23:57:15.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.345+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fe3200763d0 msgr2=0x7fe320078870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.345+0000 7fe31f7fe640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fe3200763d0 0x7fe320078870 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.345+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe32006c030 msgr2=0x7fe32006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.345+0000 7fe31f7fe640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe32006c030 0x7fe32006e4f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe33c06b230 tx=0x7fe33c0b5040 comp rx=0 tx=0).stop 2024-08-18T23:57:15.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.346+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 msgr2=0x7fe3340e82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.346+0000 7fe31f7fe640 1 --2- 172.21.15.103:0/2133295399 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe334047c10 0x7fe3340e82e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe334054f40 tx=0x7fe33800ecd0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.346+0000 7fe341eb0640 1 -- 172.21.15.103:0/2133295399 reap_dead start 2024-08-18T23:57:15.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.346+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 shutdown_connections 2024-08-18T23:57:15.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.346+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 >> 172.21.15.103:0/2133295399 conn(0x7fe33401d930 msgr2=0x7fe334050410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.347+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 shutdown_connections 2024-08-18T23:57:15.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.352+0000 7fe31f7fe640 1 -- 172.21.15.103:0/2133295399 wait complete. 2024-08-18T23:57:15.412 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-08-18T23:57:15.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-18T23:57:15.413 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:15.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-18T23:57:15.414 INFO:teuthology.orchestra.run.smithi103.stdout:55834574859 2024-08-18T23:57:15.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-18T23:57:15.415 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-08-18T23:57:15.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-18T23:57:15.416 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:15.416 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-18T23:57:15.417 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:15.417 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-18T23:57:15.418 INFO:teuthology.orchestra.run.smithi103.stdout:55834574859 2024-08-18T23:57:15.418 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-18T23:57:15.419 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-08-18T23:57:15.419 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-18T23:57:15.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.617+0000 7fb5c0931640 1 Processor -- start 2024-08-18T23:57:15.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.617+0000 7fb5c0931640 1 -- start start 2024-08-18T23:57:15.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.618+0000 7f0b19d8f640 1 Processor -- start 2024-08-18T23:57:15.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.618+0000 7fb5c0931640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0d0630 0x7fb5bc142a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7fb5c0931640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5bc06d7b0 con 0x7fb5bc0b42a0 2024-08-18T23:57:15.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7fb5c0931640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5bc0b4b30 con 0x7fb5bc143760 2024-08-18T23:57:15.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7fb5c0931640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc0715f0 con 0x7fb5bc0d0630 2024-08-18T23:57:15.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7f0b19d8f640 1 -- start start 2024-08-18T23:57:15.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7fb5bb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0d0630 0x7fb5bc142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7fb5bb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0d0630 0x7fb5bc142a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43554/0 (socket says 172.21.15.103:43554) 2024-08-18T23:57:15.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7fb5bb7fe640 1 -- 172.21.15.103:0/3500761429 learned_addr learned my addr 172.21.15.103:0/3500761429 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b19d8f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0b140d4bc0 0x7f0b140d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b19d8f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b3da0 0x7f0b140b4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b19d8f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b140d5000 con 0x7f0b140b32f0 2024-08-18T23:57:15.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b19d8f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0b14162ed0 con 0x7f0b140d4bc0 2024-08-18T23:57:15.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b19d8f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0b140d2f90 con 0x7f0b140b3da0 2024-08-18T23:57:15.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0e291e0640 1 Processor -- start 2024-08-18T23:57:15.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0e291e0640 1 -- start start 2024-08-18T23:57:15.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7fb5bb7fe640 1 -- 172.21.15.103:0/3500761429 >> v1:172.21.15.190:6789/0 conn(0x7fb5bc143760 legacy=0x7fb5bc0b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.619+0000 7fb5bb7fe640 1 -- 172.21.15.103:0/3500761429 >> v1:172.21.15.103:6789/0 conn(0x7fb5bc0b42a0 legacy=0x7fb5bc0720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7fb5bb7fe640 1 -- 172.21.15.103:0/3500761429 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc0718d0 con 0x7fb5bc0d0630 2024-08-18T23:57:15.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b12ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0b140d4bc0 0x7f0b140d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f5ceefb2640 1 Processor -- start 2024-08-18T23:57:15.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f5ceefb2640 1 -- start start 2024-08-18T23:57:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b12ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0b140d4bc0 0x7f0b140d2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38370/0 (socket says 172.21.15.103:38370) 2024-08-18T23:57:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b12ffd640 1 -- 172.21.15.103:0/3089906113 learned_addr learned my addr 172.21.15.103:0/3089906113 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.620+0000 7f0b13fff640 1 --2- 172.21.15.103:0/3089906113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b3da0 0x7f0b140b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0b12ffd640 1 -- 172.21.15.103:0/3089906113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b3da0 msgr2=0x7f0b140b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f52a609a640 1 Processor -- start 2024-08-18T23:57:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0b12ffd640 1 --2- 172.21.15.103:0/3089906113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b3da0 0x7f0b140b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0b12ffd640 1 -- 172.21.15.103:0/3089906113 >> v1:172.21.15.103:6789/0 conn(0x7f0b140b32f0 legacy=0x7f0b140d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0b12ffd640 1 -- 172.21.15.103:0/3089906113 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b140cfa00 con 0x7f0b140d4bc0 2024-08-18T23:57:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f821fbb2640 1 Processor -- start 2024-08-18T23:57:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0e291e0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c006500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0e291e0640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c01c5c0 con 0x7f0e1c009af0 2024-08-18T23:57:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0e291e0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c01c830 con 0x7f0e1c0323c0 2024-08-18T23:57:15.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0e291e0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c01cb10 con 0x7f0e1c0dec70 2024-08-18T23:57:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f52a609a640 1 -- start start 2024-08-18T23:57:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f0e23fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c006500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f0e23fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c006500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43572/0 (socket says 172.21.15.103:43572) 2024-08-18T23:57:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f0e23fff640 1 -- 172.21.15.103:0/1521264716 learned_addr learned my addr 172.21.15.103:0/1521264716 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ceefb2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ce8162370 0x7f5ce80ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ceefb2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5ce80cd140 0x7f5ce80aec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ceefb2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ce80b5c10 con 0x7f5ce806d530 2024-08-18T23:57:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ceefb2640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce80b4770 con 0x7f5ce8162370 2024-08-18T23:57:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ceefb2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5ce806e530 con 0x7f5ce80cd140 2024-08-18T23:57:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f1ff0822640 1 Processor -- start 2024-08-18T23:57:15.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7fb5bb7fe640 1 --2- 172.21.15.103:0/3500761429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0d0630 0x7fb5bc142a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009e80 tx=0x7fb5b402a7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5120f38e5029ac82 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f0e23fff640 1 -- 172.21.15.103:0/1521264716 >> v1:172.21.15.190:6789/0 conn(0x7f0e1c0323c0 legacy=0x7f0e1c052350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f0e23fff640 1 -- 172.21.15.103:0/1521264716 >> v1:172.21.15.103:6789/0 conn(0x7f0e1c009af0 legacy=0x7f0e1c01d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f1ff0822640 1 -- start start 2024-08-18T23:57:15.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.621+0000 7f821fbb2640 1 -- start start 2024-08-18T23:57:15.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f0b12ffd640 1 --2- 172.21.15.103:0/3089906113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b140d4bc0 0x7f0b140d2a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b0402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3780a5bde000df27 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ce7fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f5ce806d530 0x7f5ce8165fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45762/0 (socket says 172.21.15.103:45762) 2024-08-18T23:57:15.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ce7fff640 1 -- 172.21.15.103:0/1641221240 learned_addr learned my addr 172.21.15.103:0/1641221240 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:15.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5cecd4e640 1 --2- 172.21.15.103:0/1641221240 >> v2:172.21.15.103:3300/0 conn(0x7f5ce8162370 0x7f5ce80ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7fb5ba7fc640 1 -- 172.21.15.103:0/3500761429 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4036070 con 0x7fb5bc0d0630 2024-08-18T23:57:15.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7fb5ba7fc640 1 -- 172.21.15.103:0/3500761429 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4031600 con 0x7fb5bc0d0630 2024-08-18T23:57:15.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ced54f640 1 --2- 172.21.15.103:0/1641221240 >> v2:172.21.15.190:3300/0 conn(0x7f5ce80cd140 0x7f5ce80aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f52a609a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529800a4f0 0x7f5298036020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7fb5ba7fc640 1 -- 172.21.15.103:0/3500761429 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b40319d0 con 0x7fb5bc0d0630 2024-08-18T23:57:15.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f5ce77fe640 1 -- 172.21.15.103:0/1641221240 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729330329 0 0) 0x7f5ce80b5c10 con 0x7f5ce806d530 2024-08-18T23:57:15.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.622+0000 7f52a609a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f52980551b0 0x7f5298036560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f0b127fc640 1 -- 172.21.15.103:0/3089906113 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04037070 con 0x7f0b140d4bc0 2024-08-18T23:57:15.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f52a609a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5298007070 0x7f5298005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f0b127fc640 1 -- 172.21.15.103:0/3089906113 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b04032440 con 0x7f0b140d4bc0 2024-08-18T23:57:15.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f0b127fc640 1 -- 172.21.15.103:0/3089906113 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b04032810 con 0x7f0b140d4bc0 2024-08-18T23:57:15.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f52a5098640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529800a4f0 0x7f5298036020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f52a5098640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529800a4f0 0x7f5298036020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43588/0 (socket says 172.21.15.103:43588) 2024-08-18T23:57:15.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821fbb2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8218073930 0x7f821806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f52a5098640 1 -- 172.21.15.103:0/3679951358 learned_addr learned my addr 172.21.15.103:0/3679951358 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821fbb2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f821806f150 0x7f82180b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821e14f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f821806f150 0x7f82180b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f52a5899640 1 --2- 172.21.15.103:0/3679951358 >> v2:172.21.15.190:3300/0 conn(0x7f5298007070 0x7f5298005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821e14f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f821806f150 0x7f82180b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43598/0 (socket says 172.21.15.103:43598) 2024-08-18T23:57:15.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7fb5c0931640 1 -- 172.21.15.103:0/3500761429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0d0630 msgr2=0x7fb5bc142a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f1ff0822640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1fec161820 0x7f1fec0b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7fb5c0931640 1 --2- 172.21.15.103:0/3500761429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0d0630 0x7fb5bc142a00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009e80 tx=0x7fb5b402a7e0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821e14f640 1 -- 172.21.15.103:0/2979620779 learned_addr learned my addr 172.21.15.103:0/2979620779 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821fbb2640 1 -- 172.21.15.103:0/2979620779 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8218073d50 con 0x7f82180b4ac0 2024-08-18T23:57:15.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821d14d640 1 --2- 172.21.15.103:0/2979620779 >> v2:172.21.15.190:3300/0 conn(0x7f8218073930 0x7f821806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f1ff0822640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1fec06edb0 0x7f1fec0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821fbb2640 1 -- 172.21.15.103:0/2979620779 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f82181629e0 con 0x7f8218073930 2024-08-18T23:57:15.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f821fbb2640 1 -- 172.21.15.103:0/2979620779 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8218162cc0 con 0x7f821806f150 2024-08-18T23:57:15.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7fb5c0931640 1 -- 172.21.15.103:0/3500761429 shutdown_connections 2024-08-18T23:57:15.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7fb5c0931640 1 --2- 172.21.15.103:0/3500761429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0d0630 0x7fb5bc142a00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7fb5c0931640 1 -- 172.21.15.103:0/3500761429 >> 172.21.15.103:0/3500761429 conn(0x7fb5bc0cfb10 msgr2=0x7fb5bc0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0b19d8f640 1 -- 172.21.15.103:0/3089906113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b140d4bc0 msgr2=0x7f0b140d2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/3089906113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b140d4bc0 0x7f0b140d2a50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b0402a250 comp rx=0 tx=0).stop 2024-08-18T23:57:15.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f821c94c640 1 -- 172.21.15.103:0/2979620779 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225260892 0 0) 0x7f8210001110 con 0x7f82180b4ac0 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f821c94c640 1 -- 172.21.15.103:0/2979620779 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8200003520 con 0x7f82180b4ac0 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1febfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1fec06edb0 0x7f1fec0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1feb7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1fec161820 0x7f1fec0b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1ff0822640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec0b2d60 con 0x7f1fec0b53c0 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1febfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1fec06edb0 0x7f1fec0ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38400/0 (socket says 172.21.15.103:38400) 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1febfff640 1 -- 172.21.15.103:0/3820322815 learned_addr learned my addr 172.21.15.103:0/3820322815 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1fe2ffd640 1 --1- 172.21.15.103:0/3820322815 >> v1:172.21.15.190:6789/0 conn(0x7f1fec0b53c0 0x7f1fec06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45770/0 (socket says 172.21.15.103:45770) 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1ff0822640 1 -- 172.21.15.103:0/3820322815 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec06c9c0 con 0x7f1fec06edb0 2024-08-18T23:57:15.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1ff0822640 1 -- 172.21.15.103:0/3820322815 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec06c010 con 0x7f1fec161820 2024-08-18T23:57:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f5cecd4e640 1 -- 172.21.15.103:0/1641221240 >> v2:172.21.15.190:3300/0 conn(0x7f5ce80cd140 msgr2=0x7f5ce80aec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f5cecd4e640 1 --2- 172.21.15.103:0/1641221240 >> v2:172.21.15.190:3300/0 conn(0x7f5ce80cd140 0x7f5ce80aec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f5cecd4e640 1 -- 172.21.15.103:0/1641221240 >> v1:172.21.15.190:6789/0 conn(0x7f5ce806d530 legacy=0x7f5ce8165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f5cecd4e640 1 -- 172.21.15.103:0/1641221240 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce806da10 con 0x7f5ce8162370 2024-08-18T23:57:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0b19d8f640 1 -- 172.21.15.103:0/3089906113 shutdown_connections 2024-08-18T23:57:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/3089906113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b3da0 0x7f0b140b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/3089906113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b140d4bc0 0x7f0b140d2a50 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009870 tx=0x7f0b0402a250 comp rx=0 tx=0).stop 2024-08-18T23:57:15.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0b19d8f640 1 -- 172.21.15.103:0/3089906113 >> 172.21.15.103:0/3089906113 conn(0x7f0b140d40a0 msgr2=0x7f0b140d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f52a609a640 1 -- 172.21.15.103:0/3679951358 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5298039630 con 0x7f52980551b0 2024-08-18T23:57:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f52a609a640 1 -- 172.21.15.103:0/3679951358 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5298039910 con 0x7f5298007070 2024-08-18T23:57:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f52a609a640 1 -- 172.21.15.103:0/3679951358 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5298039bf0 con 0x7f529800a4f0 2024-08-18T23:57:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0b19d8f640 1 -- 172.21.15.103:0/3089906113 shutdown_connections 2024-08-18T23:57:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f821c94c640 1 -- 172.21.15.103:0/2979620779 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2835965842 0 0) 0x7f8200003520 con 0x7f82180b4ac0 2024-08-18T23:57:15.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f821d14d640 1 -- 172.21.15.103:0/2979620779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f821806f150 msgr2=0x7f82180b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f821d14d640 1 --2- 172.21.15.103:0/2979620779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f821806f150 0x7f82180b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f821d14d640 1 -- 172.21.15.103:0/2979620779 >> v1:172.21.15.103:6789/0 conn(0x7f82180b4ac0 legacy=0x7f821806fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f52a4897640 1 --2- 172.21.15.103:0/3679951358 >> v2:172.21.15.103:3300/0 conn(0x7f52980551b0 0x7f5298036560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.623+0000 7f0e23fff640 1 -- 172.21.15.103:0/1521264716 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c01cdf0 con 0x7f0e1c0dec70 2024-08-18T23:57:15.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7fb5c0931640 1 -- 172.21.15.103:0/3500761429 shutdown_connections 2024-08-18T23:57:15.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1feaffd640 1 -- 172.21.15.103:0/3820322815 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096409999 0 0) 0x7f1fec0b2d60 con 0x7f1fec0b53c0 2024-08-18T23:57:15.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1feaffd640 1 -- 172.21.15.103:0/3820322815 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fd8003520 con 0x7f1fec0b53c0 2024-08-18T23:57:15.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f821d14d640 1 -- 172.21.15.103:0/2979620779 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8218162fa0 con 0x7f8218073930 2024-08-18T23:57:15.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f821e14f640 1 --2- 172.21.15.103:0/2979620779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f821806f150 0x7f82180b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:15.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7fb5c0931640 1 -- 172.21.15.103:0/3500761429 wait complete. 2024-08-18T23:57:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f52a5899640 1 -- 172.21.15.103:0/3679951358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529800a4f0 msgr2=0x7f5298036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f52a5899640 1 --2- 172.21.15.103:0/3679951358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529800a4f0 0x7f5298036020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f52a5899640 1 -- 172.21.15.103:0/3679951358 >> v2:172.21.15.103:3300/0 conn(0x7f52980551b0 msgr2=0x7f5298036560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f52a5899640 1 --2- 172.21.15.103:0/3679951358 >> v2:172.21.15.103:3300/0 conn(0x7f52980551b0 0x7f5298036560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f52a5899640 1 -- 172.21.15.103:0/3679951358 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5298039ed0 con 0x7f5298007070 2024-08-18T23:57:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0e23fff640 1 --2- 172.21.15.103:0/1521264716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c006500 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009880 tx=0x7f0e1802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=567ba9a7c79161df server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f0e22ffd640 1 -- 172.21.15.103:0/1521264716 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18037070 con 0x7f0e1c0dec70 2024-08-18T23:57:15.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f0e22ffd640 1 -- 172.21.15.103:0/1521264716 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e18032440 con 0x7f0e1c0dec70 2024-08-18T23:57:15.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f0e22ffd640 1 -- 172.21.15.103:0/1521264716 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18032870 con 0x7f0e1c0dec70 2024-08-18T23:57:15.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f7ea974d640 1 Processor -- start 2024-08-18T23:57:15.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f7ea974d640 1 -- start start 2024-08-18T23:57:15.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f821d14d640 1 --2- 172.21.15.103:0/2979620779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 0x7f821806ec10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8208009d90 tx=0x7f820802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e67ca5a468e24af server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1febfff640 1 -- 172.21.15.103:0/3820322815 >> v2:172.21.15.190:3300/0 conn(0x7f1fec161820 msgr2=0x7f1fec0b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1febfff640 1 --2- 172.21.15.103:0/3820322815 >> v2:172.21.15.190:3300/0 conn(0x7f1fec161820 0x7f1fec0b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1febfff640 1 -- 172.21.15.103:0/3820322815 >> v1:172.21.15.190:6789/0 conn(0x7f1fec0b53c0 legacy=0x7f1fec06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1febfff640 1 -- 172.21.15.103:0/3820322815 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec06c440 con 0x7f1fec06edb0 2024-08-18T23:57:15.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f1feb7fe640 1 --2- 172.21.15.103:0/3820322815 >> v2:172.21.15.190:3300/0 conn(0x7f1fec161820 0x7f1fec0b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:15.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f821c94c640 1 -- 172.21.15.103:0/2979620779 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210001840 con 0x7f8218073930 2024-08-18T23:57:15.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f821c94c640 1 -- 172.21.15.103:0/2979620779 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8208007540 con 0x7f8218073930 2024-08-18T23:57:15.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f52a5899640 1 --2- 172.21.15.103:0/3679951358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5298007070 0x7f5298005a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f52a0050a90 tx=0x7f52a00a5980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edabb4e511373f1f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.625+0000 7f821c94c640 1 -- 172.21.15.103:0/2979620779 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208007910 con 0x7f8218073930 2024-08-18T23:57:15.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f1febfff640 1 --2- 172.21.15.103:0/3820322815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec06edb0 0x7f1fec0ccbb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0715c0 tx=0x7f1fe402a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c43aff62e9e1a87 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f5cecd4e640 1 --2- 172.21.15.103:0/1641221240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce8162370 0x7f5ce80ae6e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ce806e0d0 tx=0x7f5cdc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde0c2f866c15be2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.624+0000 7f0b19d8f640 1 -- 172.21.15.103:0/3089906113 wait complete. 2024-08-18T23:57:15.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f0b19d8f640 1 Processor -- start 2024-08-18T23:57:15.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f1feaffd640 1 -- 172.21.15.103:0/3820322815 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4036070 con 0x7f1fec06edb0 2024-08-18T23:57:15.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f0b19d8f640 1 -- start start 2024-08-18T23:57:15.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f5297fff640 1 -- 172.21.15.103:0/3679951358 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00af020 con 0x7f5298007070 2024-08-18T23:57:15.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f5ce77fe640 1 -- 172.21.15.103:0/1641221240 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc037070 con 0x7f5ce8162370 2024-08-18T23:57:15.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f1feaffd640 1 -- 172.21.15.103:0/3820322815 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe4031600 con 0x7f1fec06edb0 2024-08-18T23:57:15.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f1feaffd640 1 -- 172.21.15.103:0/3820322815 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe402ae60 con 0x7f1fec06edb0 2024-08-18T23:57:15.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f5ce77fe640 1 -- 172.21.15.103:0/1641221240 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc032440 con 0x7f5ce8162370 2024-08-18T23:57:15.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f5297fff640 1 -- 172.21.15.103:0/3679951358 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a00ab940 con 0x7f5298007070 2024-08-18T23:57:15.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f5ce77fe640 1 -- 172.21.15.103:0/1641221240 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc032810 con 0x7f5ce8162370 2024-08-18T23:57:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f821fbb2640 1 -- 172.21.15.103:0/2979620779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 msgr2=0x7f821806ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f821fbb2640 1 --2- 172.21.15.103:0/2979620779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 0x7f821806ec10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8208009d90 tx=0x7f820802a5f0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7fb5c0931640 1 Processor -- start 2024-08-18T23:57:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7fb5c0931640 1 -- start start 2024-08-18T23:57:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f7ea974d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7ea415e170 0x7f7ea415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f7ea974d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea40ce260 0x7f7ea40ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f7ea974d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea40cec00 con 0x7f7ea415a5f0 2024-08-18T23:57:15.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f7ea974d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea415eb00 con 0x7f7ea415e170 2024-08-18T23:57:15.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.626+0000 7f7ea974d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea40ceeb0 con 0x7f7ea40ce260 2024-08-18T23:57:15.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f7ea27fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7ea415e170 0x7f7ea415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f7ea27fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7ea415e170 0x7f7ea415e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55302/0 (socket says 172.21.15.103:55302) 2024-08-18T23:57:15.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f7ea27fc640 1 -- 172.21.15.103:0/3914021085 learned_addr learned my addr 172.21.15.103:0/3914021085 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f0e291e0640 1 -- 172.21.15.103:0/1521264716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 msgr2=0x7f0e1c006500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f0e291e0640 1 --2- 172.21.15.103:0/1521264716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c006500 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009880 tx=0x7f0e1802a200 comp rx=0 tx=0).stop 2024-08-18T23:57:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f7ea37fe640 1 --2- 172.21.15.103:0/3914021085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea40ce260 0x7f7ea40ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f821fbb2640 1 -- 172.21.15.103:0/2979620779 shutdown_connections 2024-08-18T23:57:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f821fbb2640 1 --2- 172.21.15.103:0/2979620779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f821806f150 0x7f82180b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f821fbb2640 1 --2- 172.21.15.103:0/2979620779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 0x7f821806ec10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f821fbb2640 1 -- 172.21.15.103:0/2979620779 >> 172.21.15.103:0/2979620779 conn(0x7f82180cff20 msgr2=0x7f82180d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f821fbb2640 1 -- 172.21.15.103:0/2979620779 shutdown_connections 2024-08-18T23:57:15.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f0e291e0640 1 -- 172.21.15.103:0/1521264716 shutdown_connections 2024-08-18T23:57:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f0e291e0640 1 --2- 172.21.15.103:0/1521264716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c006500 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f0e291e0640 1 -- 172.21.15.103:0/1521264716 >> 172.21.15.103:0/1521264716 conn(0x7f0e1c036090 msgr2=0x7f0e1c0364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f7ea27fc640 1 -- 172.21.15.103:0/3914021085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea40ce260 msgr2=0x7f7ea40ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f7ea27fc640 1 --2- 172.21.15.103:0/3914021085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea40ce260 0x7f7ea40ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f7ea27fc640 1 -- 172.21.15.103:0/3914021085 >> v1:172.21.15.190:6789/0 conn(0x7f7ea415a5f0 legacy=0x7f7ea4071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:15.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f7ea27fc640 1 -- 172.21.15.103:0/3914021085 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea40c4b20 con 0x7f7ea415e170 2024-08-18T23:57:15.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f5297fff640 1 -- 172.21.15.103:0/3679951358 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00abdb0 con 0x7f5298007070 2024-08-18T23:57:15.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f1ff0822640 1 -- 172.21.15.103:0/3820322815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec06edb0 msgr2=0x7f1fec0ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f1ff0822640 1 --2- 172.21.15.103:0/3820322815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec06edb0 0x7f1fec0ccbb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0715c0 tx=0x7f1fe402a640 comp rx=0 tx=0).stop 2024-08-18T23:57:15.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f5ceefb2640 1 -- 172.21.15.103:0/1641221240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce8162370 msgr2=0x7f5ce80ae6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f52a609a640 1 -- 172.21.15.103:0/3679951358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5298007070 msgr2=0x7f5298005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f52a609a640 1 --2- 172.21.15.103:0/3679951358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5298007070 0x7f5298005a00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f52a0050a90 tx=0x7f52a00a5980 comp rx=0 tx=0).stop 2024-08-18T23:57:15.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/1641221240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce8162370 0x7f5ce80ae6e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5ce806e0d0 tx=0x7f5cdc02a1a0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f52a609a640 1 -- 172.21.15.103:0/3679951358 shutdown_connections 2024-08-18T23:57:15.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f52a609a640 1 --2- 172.21.15.103:0/3679951358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5298007070 0x7f5298005a00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f52a609a640 1 --2- 172.21.15.103:0/3679951358 >> v2:172.21.15.103:3300/0 conn(0x7f52980551b0 0x7f5298036560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f52a609a640 1 --2- 172.21.15.103:0/3679951358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f529800a4f0 0x7f5298036020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f52a609a640 1 -- 172.21.15.103:0/3679951358 >> 172.21.15.103:0/3679951358 conn(0x7f529801d930 msgr2=0x7f52980545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.627+0000 7f821fbb2640 1 -- 172.21.15.103:0/2979620779 wait complete. 2024-08-18T23:57:15.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f5ceefb2640 1 -- 172.21.15.103:0/1641221240 shutdown_connections 2024-08-18T23:57:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/1641221240 >> v2:172.21.15.190:3300/0 conn(0x7f5ce80cd140 0x7f5ce80aec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/1641221240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce8162370 0x7f5ce80ae6e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f5ceefb2640 1 -- 172.21.15.103:0/1641221240 >> 172.21.15.103:0/1641221240 conn(0x7f5ce806ca10 msgr2=0x7f5ce806ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0b19d8f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b32f0 0x7f0b140ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f5ceefb2640 1 -- 172.21.15.103:0/1641221240 shutdown_connections 2024-08-18T23:57:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f52a609a640 1 -- 172.21.15.103:0/3679951358 shutdown_connections 2024-08-18T23:57:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f52a609a640 1 -- 172.21.15.103:0/3679951358 wait complete. 2024-08-18T23:57:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f5ceefb2640 1 -- 172.21.15.103:0/1641221240 wait complete. 2024-08-18T23:57:15.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5c0931640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0b42a0 0x7fb5bc168e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0b19d8f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b140b3da0 0x7f0b14162520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5c0931640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5bc0d0630 0x7fb5bc16cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0e291e0640 1 -- 172.21.15.103:0/1521264716 shutdown_connections 2024-08-18T23:57:15.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0e291e0640 1 -- 172.21.15.103:0/1521264716 wait complete. 2024-08-18T23:57:15.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0b137fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b32f0 0x7f0b140ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5c0931640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5bc143760 0x7fb5bc1380e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5c0931640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc143210 con 0x7fb5bc0d0630 2024-08-18T23:57:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5c0931640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc142f40 con 0x7fb5bc143760 2024-08-18T23:57:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5c0931640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc143390 con 0x7fb5bc0b42a0 2024-08-18T23:57:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5bbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5bc143760 0x7fb5bc1380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0b137fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b32f0 0x7f0b140ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43624/0 (socket says 172.21.15.103:43624) 2024-08-18T23:57:15.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0b137fe640 1 -- 172.21.15.103:0/2240569459 learned_addr learned my addr 172.21.15.103:0/2240569459 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f7ea27fc640 1 --2- 172.21.15.103:0/3914021085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415e170 0x7f7ea415e5c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ea406fb10 tx=0x7f7e9402c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff16cb7d66bbe292 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0b12ffd640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b140b3da0 0x7f0b14162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b1406cf70 0x7f0b1406d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5bb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0b42a0 0x7fb5bc168e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5bb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0b42a0 0x7fb5bc168e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43626/0 (socket says 172.21.15.103:43626) 2024-08-18T23:57:15.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f7ea1ffb640 1 -- 172.21.15.103:0/3914021085 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9403a070 con 0x7f7ea415e170 2024-08-18T23:57:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140b36d0 con 0x7f0b1406cf70 2024-08-18T23:57:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140cffc0 con 0x7f0b140b3da0 2024-08-18T23:57:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f7ea1ffb640 1 -- 172.21.15.103:0/3914021085 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9402ce50 con 0x7f7ea415e170 2024-08-18T23:57:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0b140d3250 con 0x7f0b140b32f0 2024-08-18T23:57:15.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f7ea1ffb640 1 -- 172.21.15.103:0/3914021085 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9403a070 con 0x7f7ea415e170 2024-08-18T23:57:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b13fff640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b1406cf70 0x7f0b1406d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5bbfff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5bc143760 0x7fb5bc1380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55326/0 (socket says 172.21.15.103:55326) 2024-08-18T23:57:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5bb7fe640 1 -- 172.21.15.103:0/2476929344 learned_addr learned my addr 172.21.15.103:0/2476929344 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.628+0000 7fb5baffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5bc0d0630 0x7fb5bc16cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b137fe640 1 -- 172.21.15.103:0/2240569459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b140b3da0 msgr2=0x7f0b14162520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b137fe640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b140b3da0 0x7f0b14162520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b137fe640 1 -- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b1406cf70 msgr2=0x7f0b1406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b137fe640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b1406cf70 0x7f0b1406d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f0b137fe640 1 -- 172.21.15.103:0/2240569459 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b140c8dd0 con 0x7f0b140b32f0 2024-08-18T23:57:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7fb5baffd640 1 -- 172.21.15.103:0/2476929344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0b42a0 msgr2=0x7fb5bc168e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7fb5baffd640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0b42a0 0x7fb5bc168e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7fb5baffd640 1 -- 172.21.15.103:0/2476929344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5bc143760 msgr2=0x7fb5bc1380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7fb5baffd640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5bc143760 0x7fb5bc1380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7fb5baffd640 1 -- 172.21.15.103:0/2476929344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc138ac0 con 0x7fb5bc0d0630 2024-08-18T23:57:15.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f821fbb2640 1 Processor -- start 2024-08-18T23:57:15.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7fb5baffd640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5bc0d0630 0x7fb5bc16cc20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c780 tx=0x7fb5ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f52a609a640 1 Processor -- start 2024-08-18T23:57:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f0b137fe640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b32f0 0x7f0b140ca340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c870 tx=0x7f0b0c00cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f1ff0822640 1 -- 172.21.15.103:0/3820322815 shutdown_connections 2024-08-18T23:57:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f1ff0822640 1 --2- 172.21.15.103:0/3820322815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec06edb0 0x7f1fec0ccbb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f1ff0822640 1 --2- 172.21.15.103:0/3820322815 >> v2:172.21.15.190:3300/0 conn(0x7f1fec161820 0x7f1fec0b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f1ff0822640 1 -- 172.21.15.103:0/3820322815 >> 172.21.15.103:0/3820322815 conn(0x7f1fec0b1e60 msgr2=0x7f1fec0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f7ea974d640 1 -- 172.21.15.103:0/3914021085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415e170 msgr2=0x7f7ea415e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f7ea974d640 1 --2- 172.21.15.103:0/3914021085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415e170 0x7f7ea415e5c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ea406fb10 tx=0x7f7e9402c670 comp rx=0 tx=0).stop 2024-08-18T23:57:15.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.629+0000 7f821fbb2640 1 -- start start 2024-08-18T23:57:15.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7fb5a3fff640 1 -- 172.21.15.103:0/2476929344 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0050d0 con 0x7fb5bc0d0630 2024-08-18T23:57:15.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f0afbfff640 1 -- 172.21.15.103:0/2240569459 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c003b70 con 0x7f0b140b32f0 2024-08-18T23:57:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7fb5a3fff640 1 -- 172.21.15.103:0/2476929344 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5ac005270 con 0x7fb5bc0d0630 2024-08-18T23:57:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7fb5a3fff640 1 -- 172.21.15.103:0/2476929344 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00a640 con 0x7fb5bc0d0630 2024-08-18T23:57:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7fb5c0931640 1 -- 172.21.15.103:0/2476929344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc1f8250 con 0x7fb5bc0d0630 2024-08-18T23:57:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f0e291e0640 1 Processor -- start 2024-08-18T23:57:15.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7fb5c0931640 1 -- 172.21.15.103:0/2476929344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc169800 con 0x7fb5bc0d0630 2024-08-18T23:57:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f821fbb2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f821806f150 0x7f821815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f5ceefb2640 1 Processor -- start 2024-08-18T23:57:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f5ceefb2640 1 -- start start 2024-08-18T23:57:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821d94e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f821806f150 0x7f821815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f52a609a640 1 -- start start 2024-08-18T23:57:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a609a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5298007070 0x7f52980d6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a609a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52980551b0 0x7f5298031a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a609a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52980d79f0 0x7f5298031f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a609a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5298054e30 con 0x7f52980551b0 2024-08-18T23:57:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a609a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5298054cb0 con 0x7f52980d79f0 2024-08-18T23:57:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a609a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5298005f40 con 0x7f5298007070 2024-08-18T23:57:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f0afbfff640 1 -- 172.21.15.103:0/2240569459 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c003d10 con 0x7f0b140b32f0 2024-08-18T23:57:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b140c90b0 con 0x7f0b140b32f0 2024-08-18T23:57:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b140c9670 con 0x7f0b140b32f0 2024-08-18T23:57:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f7ea974d640 1 -- 172.21.15.103:0/3914021085 shutdown_connections 2024-08-18T23:57:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f0afbfff640 1 -- 172.21.15.103:0/2240569459 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c003b70 con 0x7f0b140b32f0 2024-08-18T23:57:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f7ea974d640 1 --2- 172.21.15.103:0/3914021085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea40ce260 0x7f7ea40ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f7ea974d640 1 --2- 172.21.15.103:0/3914021085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415e170 0x7f7ea415e5c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f7ea974d640 1 -- 172.21.15.103:0/3914021085 >> 172.21.15.103:0/3914021085 conn(0x7f7ea40cc6e0 msgr2=0x7f7ea40ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a5899640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52980d79f0 0x7f5298031f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a5899640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52980d79f0 0x7f5298031f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55340/0 (socket says 172.21.15.103:55340) 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a5899640 1 -- 172.21.15.103:0/26691988 learned_addr learned my addr 172.21.15.103:0/26691988 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821d94e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f821806f150 0x7f821815f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38426/0 (socket says 172.21.15.103:38426) 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821fbb2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 0x7f82181f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821fbb2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82180b4ac0 0x7f821815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821fbb2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f82180b3470 con 0x7f821806f150 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821fbb2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f82180b4ea0 con 0x7f8218073930 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821fbb2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f82180b35f0 con 0x7f82180b4ac0 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821d94e640 1 -- 172.21.15.103:0/1006085198 learned_addr learned my addr 172.21.15.103:0/1006085198 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f7ea974d640 1 -- 172.21.15.103:0/3914021085 shutdown_connections 2024-08-18T23:57:15.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f52a5098640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5298007070 0x7f52980d6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f7ea974d640 1 -- 172.21.15.103:0/3914021085 wait complete. 2024-08-18T23:57:15.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.630+0000 7f0e291e0640 1 -- start start 2024-08-18T23:57:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821d14d640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 0x7f82181f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821e14f640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82180b4ac0 0x7f821815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.631+0000 7f821d94e640 1 -- 172.21.15.103:0/1006085198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82180b4ac0 msgr2=0x7f821815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f821d94e640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82180b4ac0 0x7f821815cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f821d94e640 1 -- 172.21.15.103:0/1006085198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 msgr2=0x7f82181f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f821d94e640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 0x7f82181f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f821d94e640 1 -- 172.21.15.103:0/1006085198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821815d4b0 con 0x7f821806f150 2024-08-18T23:57:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5ceefb2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ce806d530 0x7f5ce81e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f52a4897640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52980551b0 0x7f5298031a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5ceefb2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce80cd140 0x7f5ce81e8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f52a5899640 1 -- 172.21.15.103:0/26691988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5298007070 msgr2=0x7f52980d6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f52a5899640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5298007070 0x7f52980d6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f52a5899640 1 -- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52980551b0 msgr2=0x7f5298031a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f52a5899640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52980551b0 0x7f5298031a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f52a5899640 1 -- 172.21.15.103:0/26691988 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52980d72a0 con 0x7f52980d79f0 2024-08-18T23:57:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f52a4897640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52980551b0 0x7f5298031a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5cecd4e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ce806d530 0x7f5ce81e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f1ff0822640 1 -- 172.21.15.103:0/3820322815 shutdown_connections 2024-08-18T23:57:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f821d94e640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f821806f150 0x7f821815f180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f821000c520 tx=0x7f821000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5cecd4e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ce806d530 0x7f5ce81e7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55346/0 (socket says 172.21.15.103:55346) 2024-08-18T23:57:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5ce7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce80cd140 0x7f5ce81e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5ceefb2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ce8162370 0x7f5ce81e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f1ff0822640 1 -- 172.21.15.103:0/3820322815 wait complete. 2024-08-18T23:57:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5cecd4e640 1 -- 172.21.15.103:0/2861138243 learned_addr learned my addr 172.21.15.103:0/2861138243 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f52a5899640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52980d79f0 0x7f5298031f70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52a002db70 tx=0x7f52a00696e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce80b4400 con 0x7f5ce80cd140 2024-08-18T23:57:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce80b4120 con 0x7f5ce806d530 2024-08-18T23:57:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f82167fc640 1 -- 172.21.15.103:0/1006085198 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210012830 con 0x7f821806f150 2024-08-18T23:57:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5ced54f640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ce8162370 0x7f5ce81e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ce8162750 con 0x7f5ce8162370 2024-08-18T23:57:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b140c7790 con 0x7f0b140b32f0 2024-08-18T23:57:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7fb5c0931640 1 -- 172.21.15.103:0/2476929344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc150a20 con 0x7fb5bc0d0630 2024-08-18T23:57:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f82167fc640 1 -- 172.21.15.103:0/1006085198 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8210017070 con 0x7f821806f150 2024-08-18T23:57:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f82167fc640 1 -- 172.21.15.103:0/1006085198 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210012cb0 con 0x7f821806f150 2024-08-18T23:57:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f821fbb2640 1 -- 172.21.15.103:0/1006085198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821815f880 con 0x7f821806f150 2024-08-18T23:57:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.632+0000 7f821fbb2640 1 -- 172.21.15.103:0/1006085198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821815fe40 con 0x7f821806f150 2024-08-18T23:57:15.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0afbfff640 1 -- 172.21.15.103:0/2240569459 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b0c00a850 con 0x7f0b140b32f0 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e291e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1c009af0 0x7f0e1c0e19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e291e0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e1c0323c0 0x7f0e1c049990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e291e0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c049ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e291e0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c032980 con 0x7f0e1c009af0 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e291e0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c0df050 con 0x7f0e1c0323c0 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e291e0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c00bb70 con 0x7f0e1c0dec70 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e289df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c049ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e289df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c049ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43656/0 (socket says 172.21.15.103:43656) 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f0e289df640 1 -- 172.21.15.103:0/2263977194 learned_addr learned my addr 172.21.15.103:0/2263977194 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f5cecd4e640 1 -- 172.21.15.103:0/2861138243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ce8162370 msgr2=0x7f5ce81e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f5cecd4e640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ce8162370 0x7f5ce81e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f5cecd4e640 1 -- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce80cd140 msgr2=0x7f5ce81e8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f5cecd4e640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce80cd140 0x7f5ce81e8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.633+0000 7f5cecd4e640 1 -- 172.21.15.103:0/2861138243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce81f8880 con 0x7f5ce806d530 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0e289df640 1 -- 172.21.15.103:0/2263977194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e1c0323c0 msgr2=0x7f0e1c049990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0e289df640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e1c0323c0 0x7f0e1c049990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0e289df640 1 -- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1c009af0 msgr2=0x7f0e1c0e19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0e289df640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1c009af0 0x7f0e1c0e19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0e289df640 1 -- 172.21.15.103:0/2263977194 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c047dc0 con 0x7f0e1c0dec70 2024-08-18T23:57:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0afbfff640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0b0006c230 0x7f0b0006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f7ea974d640 1 Processor -- start 2024-08-18T23:57:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f5cecd4e640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ce806d530 0x7f5ce81e7ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009890 tx=0x7f5cdc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f5295ffb640 1 -- 172.21.15.103:0/26691988 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00af040 con 0x7f52980d79f0 2024-08-18T23:57:15.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f52a609a640 1 -- 172.21.15.103:0/26691988 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52980d7780 con 0x7f52980d79f0 2024-08-18T23:57:15.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f52a609a640 1 -- 172.21.15.103:0/26691988 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5298035d90 con 0x7f52980d79f0 2024-08-18T23:57:15.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7f5295ffb640 1 -- 172.21.15.103:0/26691988 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a00c0480 con 0x7f52980d79f0 2024-08-18T23:57:15.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0afbfff640 1 -- 172.21.15.103:0/2240569459 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0b0c003970 con 0x7f0b140b32f0 2024-08-18T23:57:15.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0b12ffd640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0b0006c230 0x7f0b0006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0e289df640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c049ed0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0e24050f50 tx=0x7f0e24069440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f5ce57fa640 1 -- 172.21.15.103:0/2861138243 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc040020 con 0x7f5ce806d530 2024-08-18T23:57:15.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f5ce57fa640 1 -- 172.21.15.103:0/2861138243 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc038040 con 0x7f5ce806d530 2024-08-18T23:57:15.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7fb5a3fff640 1 -- 172.21.15.103:0/2476929344 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5ac00a7e0 con 0x7fb5bc0d0630 2024-08-18T23:57:15.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f1ff0822640 1 Processor -- start 2024-08-18T23:57:15.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7f1ff0822640 1 -- start start 2024-08-18T23:57:15.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f81fffff640 1 -- 172.21.15.103:0/1006085198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82180b2f30 con 0x7f821806f150 2024-08-18T23:57:15.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7f0b12ffd640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0b0006c230 0x7f0b0006e6f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b04034000 tx=0x7f0b0402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7fb5a3fff640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb5a806bf00 0x7fb5a806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7fb5a3fff640 1 -- 172.21.15.103:0/2476929344 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb5ac08abb0 con 0x7fb5bc0d0630 2024-08-18T23:57:15.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7f5295ffb640 1 -- 172.21.15.103:0/26691988 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a00c0830 con 0x7f52980d79f0 2024-08-18T23:57:15.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7f5ce57fa640 1 -- 172.21.15.103:0/2861138243 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc037070 con 0x7f5ce806d530 2024-08-18T23:57:15.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0e20ff9640 1 -- 172.21.15.103:0/2263977194 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e24074c20 con 0x7f0e1c0dec70 2024-08-18T23:57:15.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f0e20ff9640 1 -- 172.21.15.103:0/2263977194 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e2408f070 con 0x7f0e1c0dec70 2024-08-18T23:57:15.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7fb5bb7fe640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb5a806bf00 0x7fb5a806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7f0e20ff9640 1 -- 172.21.15.103:0/2263977194 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e240750a0 con 0x7f0e1c0dec70 2024-08-18T23:57:15.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.635+0000 7f0e291e0640 1 -- 172.21.15.103:0/2263977194 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c0480a0 con 0x7f0e1c0dec70 2024-08-18T23:57:15.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce81f8b60 con 0x7f5ce806d530 2024-08-18T23:57:15.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f0e291e0640 1 -- 172.21.15.103:0/2263977194 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c04a8f0 con 0x7f0e1c0dec70 2024-08-18T23:57:15.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce81f9120 con 0x7f5ce806d530 2024-08-18T23:57:15.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.634+0000 7f7ea974d640 1 -- start start 2024-08-18T23:57:15.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7fb5bb7fe640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb5a806bf00 0x7fb5a806e3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4000f80 tx=0x7fb5b4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1ff0822640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fec06edb0 0x7f1fec156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1ff0822640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec0b53c0 0x7f1fec0b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1ff0822640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fec161820 0x7f1fec0b10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1ff0822640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0b61d0 con 0x7f1fec0b53c0 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1ff0822640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec06c6e0 con 0x7f1fec06edb0 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1ff0822640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec0b6350 con 0x7f1fec161820 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1fe2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec0b53c0 0x7f1fec0b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1fe2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec0b53c0 0x7f1fec0b0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38464/0 (socket says 172.21.15.103:38464) 2024-08-18T23:57:15.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.636+0000 7f1fe2ffd640 1 -- 172.21.15.103:0/489355828 learned_addr learned my addr 172.21.15.103:0/489355828 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f5295ffb640 1 -- 172.21.15.103:0/26691988 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52a00b2020 con 0x7f52980d79f0 2024-08-18T23:57:15.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea974d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ea40ce260 0x7f7ea409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea974d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415a5f0 0x7f7ea40b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f1fe2ffd640 1 -- 172.21.15.103:0/489355828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fec161820 msgr2=0x7f1fec0b10c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T23:57:15.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f1fe2ffd640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fec161820 0x7f1fec0b10c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f1fe2ffd640 1 -- 172.21.15.103:0/489355828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fec06edb0 msgr2=0x7f1fec156590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-18T23:57:15.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f1fe2ffd640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fec06edb0 0x7f1fec156590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f1fe2ffd640 1 -- 172.21.15.103:0/489355828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec0ae5e0 con 0x7f1fec0b53c0 2024-08-18T23:57:15.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f0e291e0640 1 -- 172.21.15.103:0/2263977194 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c04a410 con 0x7f0e1c0dec70 2024-08-18T23:57:15.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea974d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea415e170 0x7f7ea40b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ea40ce260 0x7f7ea409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ea40ce260 0x7f7ea409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38470/0 (socket says 172.21.15.103:38470) 2024-08-18T23:57:15.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f1fe2ffd640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec0b53c0 0x7f1fec0b0b80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c410 tx=0x7f1fd400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f52a609a640 1 -- 172.21.15.103:0/26691988 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5280005290 con 0x7f52980d79f0 2024-08-18T23:57:15.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea27fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415a5f0 0x7f7ea40b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea27fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415a5f0 0x7f7ea40b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55364/0 (socket says 172.21.15.103:55364) 2024-08-18T23:57:15.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea974d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea40c53c0 con 0x7f7ea40ce260 2024-08-18T23:57:15.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea974d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea40c50e0 con 0x7f7ea415a5f0 2024-08-18T23:57:15.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f5295ffb640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f528406bf00 0x7f528406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.637+0000 7f7ea974d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea415a9d0 con 0x7f7ea415e170 2024-08-18T23:57:15.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce80685b0 con 0x7f5ce806d530 2024-08-18T23:57:15.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f52a5098640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f528406bf00 0x7f528406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea415e170 0x7f7ea40b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea415e170 0x7f7ea40b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43670/0 (socket says 172.21.15.103:43670) 2024-08-18T23:57:15.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 -- 172.21.15.103:0/1546921125 learned_addr learned my addr 172.21.15.103:0/1546921125 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:15.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f5ce57fa640 1 -- 172.21.15.103:0/2861138243 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cdc043020 con 0x7f5ce806d530 2024-08-18T23:57:15.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f5295ffb640 1 -- 172.21.15.103:0/26691988 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f52a0127620 con 0x7f52980d79f0 2024-08-18T23:57:15.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f52a5098640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f528406bf00 0x7f528406e3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5290006c60 tx=0x7f5290009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f5ce57fa640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ccc06be80 0x7f5ccc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 -- 172.21.15.103:0/1546921125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415a5f0 msgr2=0x7f7ea40b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415a5f0 0x7f7ea40b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 -- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ea40ce260 msgr2=0x7f7ea409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ea40ce260 0x7f7ea409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 -- 172.21.15.103:0/1546921125 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea409b420 con 0x7f7ea415e170 2024-08-18T23:57:15.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f7ea37fe640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea415e170 0x7f7ea40b22e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00efc0 tx=0x7f7e9c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f5ce57fa640 1 -- 172.21.15.103:0/2861138243 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5cdc0ab620 con 0x7f5ce806d530 2024-08-18T23:57:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.638+0000 7f5ce7fff640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ccc06be80 0x7f5ccc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.639+0000 7f5ce7fff640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ccc06be80 0x7f5ccc06e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40011e0 tx=0x7f5cd4001130 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.640+0000 7fb5a3fff640 1 -- 172.21.15.103:0/2476929344 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb5bc150a20 con 0x7fb5bc0d0630 2024-08-18T23:57:15.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.640+0000 7f0afbfff640 1 -- 172.21.15.103:0/2240569459 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0b0c059020 con 0x7f0b140b32f0 2024-08-18T23:57:15.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.640+0000 7f7e8b7fe640 1 -- 172.21.15.103:0/1546921125 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c018020 con 0x7f7ea415e170 2024-08-18T23:57:15.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.640+0000 7f7e8b7fe640 1 -- 172.21.15.103:0/1546921125 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c014480 con 0x7f7ea415e170 2024-08-18T23:57:15.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.640+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea409b700 con 0x7f7ea415e170 2024-08-18T23:57:15.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.641+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea409b9e0 con 0x7f7ea415e170 2024-08-18T23:57:15.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.641+0000 7f1fe8ff9640 1 -- 172.21.15.103:0/489355828 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40074e0 con 0x7f1fec0b53c0 2024-08-18T23:57:15.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.641+0000 7f1fe8ff9640 1 -- 172.21.15.103:0/489355828 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fd4007680 con 0x7f1fec0b53c0 2024-08-18T23:57:15.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.641+0000 7f1fe8ff9640 1 -- 172.21.15.103:0/489355828 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd40049e0 con 0x7f1fec0b53c0 2024-08-18T23:57:15.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.641+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec0ae8c0 con 0x7f1fec0b53c0 2024-08-18T23:57:15.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.641+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec0aee80 con 0x7f1fec0b53c0 2024-08-18T23:57:15.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.642+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea40ce6c0 con 0x7f7ea415e170 2024-08-18T23:57:15.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.642+0000 7f7e8b7fe640 1 -- 172.21.15.103:0/1546921125 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c014870 con 0x7f7ea415e170 2024-08-18T23:57:15.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.642+0000 7f0e20ff9640 1 -- 172.21.15.103:0/2263977194 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e24075240 con 0x7f0e1c0dec70 2024-08-18T23:57:15.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.642+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec15ec40 con 0x7f1fec0b53c0 2024-08-18T23:57:15.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.643+0000 7f82167fc640 1 -- 172.21.15.103:0/1006085198 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f821001c460 con 0x7f821806f150 2024-08-18T23:57:15.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.643+0000 7f5295ffb640 1 -- 172.21.15.103:0/26691988 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f52980d72a0 con 0x7f52980d79f0 2024-08-18T23:57:15.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.643+0000 7f0e20ff9640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0e0806bf00 0x7f0e0806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.643+0000 7f0e20ff9640 1 -- 172.21.15.103:0/2263977194 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0e241067e0 con 0x7f0e1c0dec70 2024-08-18T23:57:15.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.643+0000 7f82167fc640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f820406bf00 0x7f820406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.643+0000 7f82167fc640 1 -- 172.21.15.103:0/1006085198 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f821008bb90 con 0x7f821806f150 2024-08-18T23:57:15.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.643+0000 7f821d14d640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f820406bf00 0x7f820406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.643+0000 7f0e23fff640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0e0806bf00 0x7f0e0806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.644+0000 7f0e23fff640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0e0806bf00 0x7f0e0806e3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e18034000 tx=0x7f0e1802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.644+0000 7f821d14d640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f820406bf00 0x7f820406e3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8208034000 tx=0x7f820802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.646+0000 7f0e20ff9640 1 -- 172.21.15.103:0/2263977194 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0e240a3080 con 0x7f0e1c0dec70 2024-08-18T23:57:15.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.647+0000 7f7e8b7fe640 1 -- 172.21.15.103:0/1546921125 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e9c005d10 con 0x7f7ea415e170 2024-08-18T23:57:15.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.648+0000 7f7e8b7fe640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e9006be30 0x7f7e9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.648+0000 7f5ce57fa640 1 -- 172.21.15.103:0/2861138243 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5cdc04a030 con 0x7f5ce806d530 2024-08-18T23:57:15.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.648+0000 7f7ea2ffd640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e9006be30 0x7f7e9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.649+0000 7f7e8b7fe640 1 -- 172.21.15.103:0/1546921125 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e9c08c470 con 0x7f7ea415e170 2024-08-18T23:57:15.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.650+0000 7f7ea2ffd640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e9006be30 0x7f7e9006e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e98004f60 tx=0x7f7e98007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.650+0000 7f82167fc640 1 -- 172.21.15.103:0/1006085198 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8218073d50 con 0x7f821806f150 2024-08-18T23:57:15.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.651+0000 7f7e8b7fe640 1 -- 172.21.15.103:0/1546921125 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7e9c022030 con 0x7f7ea415e170 2024-08-18T23:57:15.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.650+0000 7f1fe8ff9640 1 -- 172.21.15.103:0/489355828 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fd401a020 con 0x7f1fec0b53c0 2024-08-18T23:57:15.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.651+0000 7f1fe8ff9640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1fcc06bf00 0x7f1fcc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:15.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.651+0000 7f1fe8ff9640 1 -- 172.21.15.103:0/489355828 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1fd408b240 con 0x7f1fec0b53c0 2024-08-18T23:57:15.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.652+0000 7f1feb7fe640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1fcc06bf00 0x7f1fcc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:15.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.653+0000 7f1feb7fe640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1fcc06bf00 0x7f1fcc06e3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00a900 tx=0x7f1fdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:15.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:15.657+0000 7f1fe8ff9640 1 -- 172.21.15.103:0/489355828 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f1fd4021070 con 0x7f1fec0b53c0 2024-08-18T23:57:16.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.037+0000 7fb5c0931640 1 -- 172.21.15.103:0/2476929344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb5bc142a00 con 0x7fb5bc0d0630 2024-08-18T23:57:16.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.038+0000 7fb5a3fff640 1 -- 172.21.15.103:0/2476929344 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5bc138ac0 con 0x7fb5bc0d0630 2024-08-18T23:57:16.039 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-08-18T23:57:16.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.042+0000 7fb5a1ffb640 1 -- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb5a806bf00 msgr2=0x7fb5a806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.042+0000 7fb5a1ffb640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb5a806bf00 0x7fb5a806e3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4000f80 tx=0x7fb5b4009000 comp rx=0 tx=0).stop 2024-08-18T23:57:16.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.042+0000 7fb5a1ffb640 1 -- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5bc0d0630 msgr2=0x7fb5bc16cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.042+0000 7fb5a1ffb640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5bc0d0630 0x7fb5bc16cc20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac00c780 tx=0x7fb5ac00cc40 comp rx=0 tx=0).stop 2024-08-18T23:57:16.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.042+0000 7fb5a1ffb640 1 -- 172.21.15.103:0/2476929344 shutdown_connections 2024-08-18T23:57:16.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.042+0000 7fb5a1ffb640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb5a806bf00 0x7fb5a806e3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.043+0000 7fb5a1ffb640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb5bc143760 0x7fb5bc1380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.043+0000 7fb5a1ffb640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5bc0d0630 0x7fb5bc16cc20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.043+0000 7fb5a1ffb640 1 --2- 172.21.15.103:0/2476929344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb5bc0b42a0 0x7fb5bc168e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.043+0000 7fb5a1ffb640 1 -- 172.21.15.103:0/2476929344 >> 172.21.15.103:0/2476929344 conn(0x7fb5bc0cfb10 msgr2=0x7fb5bc13f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:16.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.043+0000 7fb5a1ffb640 1 -- 172.21.15.103:0/2476929344 shutdown_connections 2024-08-18T23:57:16.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.043+0000 7fb5a1ffb640 1 -- 172.21.15.103:0/2476929344 wait complete. 2024-08-18T23:57:16.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.049+0000 7f52a609a640 1 -- 172.21.15.103:0/26691988 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5280005580 con 0x7f52980d79f0 2024-08-18T23:57:16.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.049+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0b14068df0 con 0x7f0b140b32f0 2024-08-18T23:57:16.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.049+0000 7f5295ffb640 1 -- 172.21.15.103:0/26691988 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52a00f5c70 con 0x7f52980d79f0 2024-08-18T23:57:16.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.049+0000 7f0afbfff640 1 -- 172.21.15.103:0/2240569459 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0b0c059020 con 0x7f0b140b32f0 2024-08-18T23:57:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:16.051 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-08-18T23:57:16.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.050+0000 7f0e291e0640 1 -- 172.21.15.103:0/2263977194 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0e1c006500 con 0x7f0e1c0dec70 2024-08-18T23:57:16.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.050+0000 7f0e20ff9640 1 -- 172.21.15.103:0/2263977194 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0e240d4ec0 con 0x7f0e1c0dec70 2024-08-18T23:57:16.052 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-08-18T23:57:16.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.053+0000 7f528b7fe640 1 -- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f528406bf00 msgr2=0x7f528406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.053+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0b0006c230 msgr2=0x7f0b0006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.053+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0b0006c230 0x7f0b0006e6f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0b04034000 tx=0x7f0b0402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:16.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.053+0000 7f528b7fe640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f528406bf00 0x7f528406e3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5290006c60 tx=0x7f5290009210 comp rx=0 tx=0).stop 2024-08-18T23:57:16.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b32f0 msgr2=0x7f0b140ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 -- 172.21.15.103:0/26691988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52980d79f0 msgr2=0x7f5298031f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52980d79f0 0x7f5298031f70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52a002db70 tx=0x7f52a00696e0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b32f0 0x7f0b140ca340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00c870 tx=0x7f0b0c00cd30 comp rx=0 tx=0).stop 2024-08-18T23:57:16.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 -- 172.21.15.103:0/26691988 shutdown_connections 2024-08-18T23:57:16.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f528406bf00 0x7f528406e3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f52980d79f0 0x7f5298031f70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52980551b0 0x7f5298031a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 --2- 172.21.15.103:0/26691988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5298007070 0x7f52980d6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 -- 172.21.15.103:0/26691988 >> 172.21.15.103:0/26691988 conn(0x7f529801d930 msgr2=0x7f52980520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:16.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5ce806c310 con 0x7f5ce806d530 2024-08-18T23:57:16.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 -- 172.21.15.103:0/26691988 shutdown_connections 2024-08-18T23:57:16.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f528b7fe640 1 -- 172.21.15.103:0/26691988 wait complete. 2024-08-18T23:57:16.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0e0e7fc640 1 -- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0e0806bf00 msgr2=0x7f0e0806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0e0e7fc640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0e0806bf00 0x7f0e0806e3c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e18034000 tx=0x7f0e1802c000 comp rx=0 tx=0).stop 2024-08-18T23:57:16.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0e0e7fc640 1 -- 172.21.15.103:0/2263977194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 msgr2=0x7f0e1c049ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 shutdown_connections 2024-08-18T23:57:16.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0b0006c230 0x7f0b0006e6f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0b1406cf70 0x7f0b1406d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b140b3da0 0x7f0b14162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 --2- 172.21.15.103:0/2240569459 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b140b32f0 0x7f0b140ca340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 >> 172.21.15.103:0/2240569459 conn(0x7f0b140d40a0 msgr2=0x7f0b140b8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:16.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 shutdown_connections 2024-08-18T23:57:16.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.054+0000 7f0e0e7fc640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c049ed0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0e24050f50 tx=0x7f0e24069440 comp rx=0 tx=0).stop 2024-08-18T23:57:16.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0b19d8f640 1 -- 172.21.15.103:0/2240569459 wait complete. 2024-08-18T23:57:16.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f5ce57fa640 1 -- 172.21.15.103:0/2861138243 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5cdc032e20 con 0x7f5ce806d530 2024-08-18T23:57:16.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0e0e7fc640 1 -- 172.21.15.103:0/2263977194 shutdown_connections 2024-08-18T23:57:16.062 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:16.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0e0e7fc640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0e0806bf00 0x7f0e0806e3c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0e0e7fc640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e1c0dec70 0x7f0e1c049ed0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0e0e7fc640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e1c0323c0 0x7f0e1c049990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0e0e7fc640 1 --2- 172.21.15.103:0/2263977194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e1c009af0 0x7f0e1c0e19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0e0e7fc640 1 -- 172.21.15.103:0/2263977194 >> 172.21.15.103:0/2263977194 conn(0x7f0e1c036090 msgr2=0x7f0e1c052830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:16.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0e0e7fc640 1 -- 172.21.15.103:0/2263977194 shutdown_connections 2024-08-18T23:57:16.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.055+0000 7f0e0e7fc640 1 -- 172.21.15.103:0/2263977194 wait complete. 2024-08-18T23:57:16.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.057+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7ea40c5bc0 con 0x7f7ea415e170 2024-08-18T23:57:16.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.058+0000 7f7e8b7fe640 1 -- 172.21.15.103:0/1546921125 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e9c010040 con 0x7f7ea415e170 2024-08-18T23:57:16.064 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:16.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.058+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ccc06be80 msgr2=0x7f5ccc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.058+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ccc06be80 0x7f5ccc06e340 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40011e0 tx=0x7f5cd4001130 comp rx=0 tx=0).stop 2024-08-18T23:57:16.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.058+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ce806d530 msgr2=0x7f5ce81e7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.058+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ce806d530 0x7f5ce81e7ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009890 tx=0x7f5cdc0046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.058+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 shutdown_connections 2024-08-18T23:57:16.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.059+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ccc06be80 0x7f5ccc06e340 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.059+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ce8162370 0x7f5ce81e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.059+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce80cd140 0x7f5ce81e8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.059+0000 7f5ceefb2640 1 --2- 172.21.15.103:0/2861138243 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ce806d530 0x7f5ce81e7ba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.059+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 >> 172.21.15.103:0/2861138243 conn(0x7f5ce806ca10 msgr2=0x7f5ce806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:16.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.059+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 shutdown_connections 2024-08-18T23:57:16.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.059+0000 7f5ceefb2640 1 -- 172.21.15.103:0/2861138243 wait complete. 2024-08-18T23:57:16.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.061+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e9006be30 msgr2=0x7f7e9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.061+0000 7f7ea974d640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e9006be30 0x7f7e9006e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e98004f60 tx=0x7f7e98007e30 comp rx=0 tx=0).stop 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.061+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea415e170 msgr2=0x7f7ea40b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.061+0000 7f7ea974d640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea415e170 0x7f7ea40b22e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00efc0 tx=0x7f7e9c00c490 comp rx=0 tx=0).stop 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 shutdown_connections 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f7ea974d640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7e9006be30 0x7f7e9006e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f7ea974d640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ea415e170 0x7f7ea40b22e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f7ea974d640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ea415a5f0 0x7f7ea40b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f7ea974d640 1 --2- 172.21.15.103:0/1546921125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7ea40ce260 0x7f7ea409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 >> 172.21.15.103:0/1546921125 conn(0x7f7ea40cc6e0 msgr2=0x7f7ea4072880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 shutdown_connections 2024-08-18T23:57:16.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f7ea974d640 1 -- 172.21.15.103:0/1546921125 wait complete. 2024-08-18T23:57:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.062+0000 7f81fffff640 1 -- 172.21.15.103:0/1006085198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8218160080 con 0x7f821806f150 2024-08-18T23:57:16.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.063+0000 7f82167fc640 1 -- 172.21.15.103:0/1006085198 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f821005a1e0 con 0x7f821806f150 2024-08-18T23:57:16.070 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-08-18T23:57:16.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.063+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1fec06bc80 con 0x7f1fec0b53c0 2024-08-18T23:57:16.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.064+0000 7f1fe8ff9640 1 -- 172.21.15.103:0/489355828 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1fd40222a0 con 0x7f1fec0b53c0 2024-08-18T23:57:16.071 INFO:teuthology.orchestra.run.smithi103.stdout:55834574856 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 -- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f820406bf00 msgr2=0x7f820406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f820406bf00 0x7f820406e3c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8208034000 tx=0x7f820802f000 comp rx=0 tx=0).stop 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 -- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f821806f150 msgr2=0x7f821815f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f821806f150 0x7f821815f180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f821000c520 tx=0x7f821000c9e0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 -- 172.21.15.103:0/1006085198 shutdown_connections 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f820406bf00 0x7f820406e3c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82180b4ac0 0x7f821815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8218073930 0x7f82181f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 --2- 172.21.15.103:0/1006085198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f821806f150 0x7f821815f180 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.066+0000 7f81fffff640 1 -- 172.21.15.103:0/1006085198 >> 172.21.15.103:0/1006085198 conn(0x7f82180cff20 msgr2=0x7f8218161710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.067+0000 7f81fffff640 1 -- 172.21.15.103:0/1006085198 shutdown_connections 2024-08-18T23:57:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f81fffff640 1 -- 172.21.15.103:0/1006085198 wait complete. 2024-08-18T23:57:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1fcc06bf00 msgr2=0x7f1fcc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1fcc06bf00 0x7f1fcc06e3c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00a900 tx=0x7f1fdc008040 comp rx=0 tx=0).stop 2024-08-18T23:57:16.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec0b53c0 msgr2=0x7f1fec0b0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec0b53c0 0x7f1fec0b0b80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c410 tx=0x7f1fd400c8d0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 shutdown_connections 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f1fcc06bf00 0x7f1fcc06e3c0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00a900 tx=0x7f1fdc008040 comp rx=0 tx=0).stop 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fec161820 0x7f1fec0b10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1fec0b53c0 0x7f1fec0b0b80 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c410 tx=0x7f1fd400c8d0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 --2- 172.21.15.103:0/489355828 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fec06edb0 0x7f1fec156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 >> 172.21.15.103:0/489355828 conn(0x7f1fec0b1e60 msgr2=0x7f1fec0ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 shutdown_connections 2024-08-18T23:57:16.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:16.068+0000 7f1ff0822640 1 -- 172.21.15.103:0/489355828 wait complete. 2024-08-18T23:57:16.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-08-18T23:57:16.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-08-18T23:57:16.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-08-18T23:57:16.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-08-18T23:57:16.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-08-18T23:57:16.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-08-18T23:57:16.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-08-18T23:57:17.069 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-18T23:57:17.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-18T23:57:17.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-18T23:57:17.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-18T23:57:17.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-18T23:57:17.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-18T23:57:17.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-18T23:57:17.088 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-18T23:57:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.216+0000 7fdaab43b640 1 Processor -- start 2024-08-18T23:57:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.216+0000 7fdaab43b640 1 -- start start 2024-08-18T23:57:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.217+0000 7fdaab43b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdaa4165f90 0x7fdaa40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaab43b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdaa4071410 0x7fdaa4166370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaab43b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa40b2d20 con 0x7fdaa41668b0 2024-08-18T23:57:17.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaab43b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa414c1a0 con 0x7fdaa4071410 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaab43b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa4071940 con 0x7fdaa4165f90 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaa89d6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdaa4071410 0x7fdaa4166370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaa89d6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdaa4071410 0x7fdaa4166370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38484/0 (socket says 172.21.15.103:38484) 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaa89d6640 1 -- 172.21.15.103:0/3367330581 learned_addr learned my addr 172.21.15.103:0/3367330581 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaa91d7640 1 --2- 172.21.15.103:0/3367330581 >> v2:172.21.15.190:3300/0 conn(0x7fdaa4165f90 0x7fdaa40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaa89d6640 1 -- 172.21.15.103:0/3367330581 >> v2:172.21.15.190:3300/0 conn(0x7fdaa4165f90 msgr2=0x7fdaa40b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaa89d6640 1 --2- 172.21.15.103:0/3367330581 >> v2:172.21.15.190:3300/0 conn(0x7fdaa4165f90 0x7fdaa40b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaa89d6640 1 -- 172.21.15.103:0/3367330581 >> v1:172.21.15.190:6789/0 conn(0x7fdaa41668b0 legacy=0x7fdaa40cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.218+0000 7fdaa89d6640 1 -- 172.21.15.103:0/3367330581 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa40b2fc0 con 0x7fdaa4071410 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.219+0000 7fdaa89d6640 1 --2- 172.21.15.103:0/3367330581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa4071410 0x7fdaa4166370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdaa406ce40 tx=0x7fdaa002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c982a4ec1b3c27 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.220+0000 7fda9bfff640 1 -- 172.21.15.103:0/3367330581 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0037070 con 0x7fdaa4071410 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.220+0000 7fda9bfff640 1 -- 172.21.15.103:0/3367330581 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa0032440 con 0x7fdaa4071410 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fda9bfff640 1 -- 172.21.15.103:0/3367330581 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0032850 con 0x7fdaa4071410 2024-08-18T23:57:17.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fdaab43b640 1 -- 172.21.15.103:0/3367330581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa4071410 msgr2=0x7fdaa4166370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fdaab43b640 1 --2- 172.21.15.103:0/3367330581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa4071410 0x7fdaa4166370 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdaa406ce40 tx=0x7fdaa002a1c0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fdaab43b640 1 -- 172.21.15.103:0/3367330581 shutdown_connections 2024-08-18T23:57:17.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fdaab43b640 1 --2- 172.21.15.103:0/3367330581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa4071410 0x7fdaa4166370 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fdaab43b640 1 --2- 172.21.15.103:0/3367330581 >> v2:172.21.15.190:3300/0 conn(0x7fdaa4165f90 0x7fdaa40b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fdaab43b640 1 -- 172.21.15.103:0/3367330581 >> 172.21.15.103:0/3367330581 conn(0x7fdaa40cfb10 msgr2=0x7fdaa40cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fdaab43b640 1 -- 172.21.15.103:0/3367330581 shutdown_connections 2024-08-18T23:57:17.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.221+0000 7fdaab43b640 1 -- 172.21.15.103:0/3367330581 wait complete. 2024-08-18T23:57:17.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.223+0000 7fdaab43b640 1 Processor -- start 2024-08-18T23:57:17.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.223+0000 7fdaab43b640 1 -- start start 2024-08-18T23:57:17.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.224+0000 7fdaab43b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaa4071410 0x7fdaa413c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.224+0000 7fdaab43b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaa4165f90 0x7fdaa41602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.224+0000 7fdaab43b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa41668b0 0x7fdaa413b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.224+0000 7fdaab43b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40b4da0 con 0x7fdaa41668b0 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.224+0000 7fdaab43b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa40b3580 con 0x7fdaa4071410 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.224+0000 7fdaab43b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa4166d40 con 0x7fdaa4165f90 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa41668b0 0x7fdaa413b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa41668b0 0x7fdaa413b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38500/0 (socket says 172.21.15.103:38500) 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 -- 172.21.15.103:0/1361812583 learned_addr learned my addr 172.21.15.103:0/1361812583 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa91d7640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaa4071410 0x7fdaa413c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa89d6640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaa4165f90 0x7fdaa41602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 -- 172.21.15.103:0/1361812583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaa4165f90 msgr2=0x7fdaa41602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaa4165f90 0x7fdaa41602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 -- 172.21.15.103:0/1361812583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaa4071410 msgr2=0x7fdaa413c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaa4071410 0x7fdaa413c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 -- 172.21.15.103:0/1361812583 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa4149d30 con 0x7fdaa41668b0 2024-08-18T23:57:17.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.225+0000 7fdaa99d8640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa41668b0 0x7fdaa413b9d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00b970 tx=0x7fda9c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.228+0000 7fda99ffb640 1 -- 172.21.15.103:0/1361812583 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c019070 con 0x7fdaa41668b0 2024-08-18T23:57:17.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.228+0000 7fdaab43b640 1 -- 172.21.15.103:0/1361812583 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa41361a0 con 0x7fdaa41668b0 2024-08-18T23:57:17.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.228+0000 7fdaab43b640 1 -- 172.21.15.103:0/1361812583 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa4136760 con 0x7fdaa41668b0 2024-08-18T23:57:17.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.229+0000 7fda99ffb640 1 -- 172.21.15.103:0/1361812583 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9c00cb40 con 0x7fdaa41668b0 2024-08-18T23:57:17.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.230+0000 7fda99ffb640 1 -- 172.21.15.103:0/1361812583 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c014440 con 0x7fdaa41668b0 2024-08-18T23:57:17.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.231+0000 7fdaab43b640 1 -- 172.21.15.103:0/1361812583 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda84005290 con 0x7fdaa41668b0 2024-08-18T23:57:17.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.240+0000 7fda99ffb640 1 -- 172.21.15.103:0/1361812583 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda9c01c070 con 0x7fdaa41668b0 2024-08-18T23:57:17.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.241+0000 7fda99ffb640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fda8806bf00 0x7fda8806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.241+0000 7fda99ffb640 1 -- 172.21.15.103:0/1361812583 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fda9c08b350 con 0x7fdaa41668b0 2024-08-18T23:57:17.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.241+0000 7fda99ffb640 1 -- 172.21.15.103:0/1361812583 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fda9c023020 con 0x7fdaa41668b0 2024-08-18T23:57:17.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.249+0000 7fdaa91d7640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fda8806bf00 0x7fda8806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.250+0000 7fdaa91d7640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fda8806bf00 0x7fda8806e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40af640 tx=0x7fda94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.277+0000 7ff39ae8b640 1 Processor -- start 2024-08-18T23:57:17.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.277+0000 7ff39ae8b640 1 -- start start 2024-08-18T23:57:17.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.278+0000 7fb803c42640 1 Processor -- start 2024-08-18T23:57:17.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7ff39ae8b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff3940b33e0 0x7ff3940b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7ff39ae8b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39406db60 con 0x7ff39415dd30 2024-08-18T23:57:17.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7ff39ae8b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3940aebf0 con 0x7ff3940b3f10 2024-08-18T23:57:17.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7ff39ae8b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff3940ae9d0 con 0x7ff3940b33e0 2024-08-18T23:57:17.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7ff399e89640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff39415dd30 0x7ff3940ae2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56502/0 (socket says 172.21.15.103:56502) 2024-08-18T23:57:17.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7ff399e89640 1 -- 172.21.15.103:0/816690299 learned_addr learned my addr 172.21.15.103:0/816690299 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:17.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491810453 0 0) 0x7ff384001110 con 0x7ff39415dd30 2024-08-18T23:57:17.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff380003520 con 0x7ff39415dd30 2024-08-18T23:57:17.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.278+0000 7fb803c42640 1 -- start start 2024-08-18T23:57:17.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2103928989 0 0) 0x7ff380003520 con 0x7ff39415dd30 2024-08-18T23:57:17.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 >> v2:172.21.15.190:3300/0 conn(0x7ff3940b33e0 msgr2=0x7ff3940b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 --2- 172.21.15.103:0/816690299 >> v2:172.21.15.190:3300/0 conn(0x7ff3940b33e0 0x7ff3940b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7fb803c42640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb7f40551b0 0x7fb7f404f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7fb803c42640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f4039630 con 0x7fb7f400a4f0 2024-08-18T23:57:17.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7fb803c42640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f4039910 con 0x7fb7f4036730 2024-08-18T23:57:17.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7fb803c42640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb7f4039bf0 con 0x7fb7f40551b0 2024-08-18T23:57:17.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 >> v1:172.21.15.190:6789/0 conn(0x7ff3940b3f10 legacy=0x7ff3940720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7fb8021df640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb7f40551b0 0x7fb7f404f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7fb8021df640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb7f40551b0 0x7fb7f404f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55392/0 (socket says 172.21.15.103:55392) 2024-08-18T23:57:17.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7fb8021df640 1 -- 172.21.15.103:0/2156408162 learned_addr learned my addr 172.21.15.103:0/2156408162 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3940aeed0 con 0x7ff39415dd30 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7ff384001840 con 0x7ff39415dd30 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 >> v1:172.21.15.103:6789/0 conn(0x7ff39415dd30 legacy=0x7ff3940ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3800039b0 0x7ff380003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff380004800 0x7ff380004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff3800141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940ae9d0 con 0x7ff3800052e0 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff3800149c0 con 0x7ff380004800 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff380014bc0 con 0x7ff3800039b0 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff399e89640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3800039b0 0x7ff380003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7ff39a68a640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff3800141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.280+0000 7fb8009dc640 1 -- 172.21.15.103:0/2156408162 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989055451 0 0) 0x7fb7f4039910 con 0x7fb7f4036730 2024-08-18T23:57:17.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.281+0000 7fb8021df640 1 -- 172.21.15.103:0/2156408162 >> v1:172.21.15.190:6789/0 conn(0x7fb7f4036730 legacy=0x7fb7f404ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.281+0000 7fb8021df640 1 -- 172.21.15.103:0/2156408162 >> v1:172.21.15.103:6789/0 conn(0x7fb7f400a4f0 legacy=0x7fb7f4036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.281+0000 7ff39a68a640 1 -- 172.21.15.103:0/816690299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3800039b0 msgr2=0x7ff380003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.281+0000 7ff39a68a640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3800039b0 0x7ff380003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.281+0000 7ff39a68a640 1 -- 172.21.15.103:0/816690299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff380004800 msgr2=0x7ff380004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T23:57:17.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.281+0000 7ff39a68a640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff380004800 0x7ff380004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.281+0000 7fb8021df640 1 -- 172.21.15.103:0/2156408162 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f4039ed0 con 0x7fb7f40551b0 2024-08-18T23:57:17.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.281+0000 7ff39a68a640 1 -- 172.21.15.103:0/816690299 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3940aeed0 con 0x7ff3800052e0 2024-08-18T23:57:17.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.279+0000 7f08f21bf640 1 Processor -- start 2024-08-18T23:57:17.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7ff39a68a640 1 -- 172.21.15.103:0/816690299 reap_dead start 2024-08-18T23:57:17.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7ff39a68a640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff3800141d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff390001700 tx=0x7ff380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f043584be9af953 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7fb8021df640 1 --2- 172.21.15.103:0/2156408162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f40551b0 0x7fb7f404f650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec008870 tx=0x7fb7ec02c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894a2772a1a156f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7f08f21bf640 1 -- start start 2024-08-18T23:57:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7fb8009dc640 1 -- 172.21.15.103:0/2156408162 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec03a070 con 0x7fb7f40551b0 2024-08-18T23:57:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7fb8009dc640 1 -- 172.21.15.103:0/2156408162 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec032480 con 0x7fb7f40551b0 2024-08-18T23:57:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7fb8009dc640 1 -- 172.21.15.103:0/2156408162 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec032850 con 0x7fb7f40551b0 2024-08-18T23:57:17.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390001350 con 0x7ff3800052e0 2024-08-18T23:57:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3900052d0 con 0x7ff3800052e0 2024-08-18T23:57:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.282+0000 7ff398e87640 1 -- 172.21.15.103:0/816690299 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390001350 con 0x7ff3800052e0 2024-08-18T23:57:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.283+0000 7f08f21bf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f08ec0cb580 0x7f08ec06f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.283+0000 7f08f21bf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08ec0ce6e0 con 0x7f08ec159da0 2024-08-18T23:57:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.283+0000 7f08f21bf640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08ec0ce9c0 con 0x7f08ec0b23a0 2024-08-18T23:57:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.283+0000 7f08f21bf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f08ec0cf010 con 0x7f08ec0cb580 2024-08-18T23:57:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08eb7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f08ec0b23a0 0x7f08ec0cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45830/0 (socket says 172.21.15.103:45830) 2024-08-18T23:57:17.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08eb7fe640 1 -- 172.21.15.103:0/2204131242 learned_addr learned my addr 172.21.15.103:0/2204131242 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:17.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.283+0000 7ff39ae8b640 1 -- 172.21.15.103:0/816690299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 msgr2=0x7ff3800141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.283+0000 7ff39ae8b640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff3800141d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff390001700 tx=0x7ff380005830 comp rx=0 tx=0).stop 2024-08-18T23:57:17.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08eaffd640 1 --2- 172.21.15.103:0/2204131242 >> v2:172.21.15.103:3300/0 conn(0x7f08ec0cb580 0x7f08ec06f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506418785 0 0) 0x7f08ec0ce9c0 con 0x7f08ec0b23a0 2024-08-18T23:57:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7ff39ae8b640 1 -- 172.21.15.103:0/816690299 shutdown_connections 2024-08-18T23:57:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7ff39ae8b640 1 --2- 172.21.15.103:0/816690299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff3800141d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7ff39ae8b640 1 -- 172.21.15.103:0/816690299 >> 172.21.15.103:0/816690299 conn(0x7ff39406c3f0 msgr2=0x7ff3940b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f60f1677640 1 Processor -- start 2024-08-18T23:57:17.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08d4003520 con 0x7f08ec0b23a0 2024-08-18T23:57:17.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.283+0000 7fb803c42640 1 -- 172.21.15.103:0/2156408162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f40551b0 msgr2=0x7fb7f404f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7fb803c42640 1 --2- 172.21.15.103:0/2156408162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f40551b0 0x7fb7f404f650 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec008870 tx=0x7fb7ec02c710 comp rx=0 tx=0).stop 2024-08-18T23:57:17.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2357050766 0 0) 0x7f08d4003520 con 0x7f08ec0b23a0 2024-08-18T23:57:17.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 >> v2:172.21.15.103:3300/0 conn(0x7f08ec0cb580 msgr2=0x7f08ec06f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 --2- 172.21.15.103:0/2204131242 >> v2:172.21.15.103:3300/0 conn(0x7f08ec0cb580 0x7f08ec06f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 >> v1:172.21.15.103:6789/0 conn(0x7f08ec159da0 legacy=0x7f08ec15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ec0ceca0 con 0x7f08ec0b23a0 2024-08-18T23:57:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f08dc001670 con 0x7f08ec0b23a0 2024-08-18T23:57:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 >> v1:172.21.15.190:6789/0 conn(0x7f08ec0b23a0 legacy=0x7f08ec0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7fb803c42640 1 -- 172.21.15.103:0/2156408162 shutdown_connections 2024-08-18T23:57:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08d40039b0 0x7f08d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f5776f6f640 1 Processor -- start 2024-08-18T23:57:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d4004800 0x7f08d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7f08ea7fc640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d40051c0 0x7f08d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec0cf010 con 0x7f08d40039b0 2024-08-18T23:57:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08eb7fe640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08d40039b0 0x7f08d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f08d400c0c0 con 0x7f08d40051c0 2024-08-18T23:57:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f08d400c2c0 con 0x7f08d4004800 2024-08-18T23:57:17.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7fb803c42640 1 --2- 172.21.15.103:0/2156408162 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f40551b0 0x7fb7f404f650 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f5776f6f640 1 -- start start 2024-08-18T23:57:17.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.284+0000 7fb803c42640 1 -- 172.21.15.103:0/2156408162 >> 172.21.15.103:0/2156408162 conn(0x7fb7f401d930 msgr2=0x7fb7f40545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7ff39ae8b640 1 -- 172.21.15.103:0/816690299 shutdown_connections 2024-08-18T23:57:17.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7fb803c42640 1 -- 172.21.15.103:0/2156408162 shutdown_connections 2024-08-18T23:57:17.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08eb7fe640 1 -- 172.21.15.103:0/2204131242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d4004800 msgr2=0x7f08d4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T23:57:17.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08eb7fe640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d4004800 0x7f08d4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08eb7fe640 1 -- 172.21.15.103:0/2204131242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d40051c0 msgr2=0x7f08d400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T23:57:17.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08eb7fe640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08d40051c0 0x7f08d400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08eb7fe640 1 -- 172.21.15.103:0/2204131242 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d4003520 con 0x7f08d40039b0 2024-08-18T23:57:17.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f08ebfff640 1 -- 172.21.15.103:0/2204131242 reap_dead start 2024-08-18T23:57:17.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7ff39ae8b640 1 -- 172.21.15.103:0/816690299 wait complete. 2024-08-18T23:57:17.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f07c4010640 1 Processor -- start 2024-08-18T23:57:17.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7fb803c42640 1 -- 172.21.15.103:0/2156408162 wait complete. 2024-08-18T23:57:17.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f07c4010640 1 -- start start 2024-08-18T23:57:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f60f1677640 1 -- start start 2024-08-18T23:57:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f60f1677640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f60ec0736e0 0x7f60ec0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f08eb7fe640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08d40039b0 0x7f08d4003d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00c190 tx=0x7f08d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601c67325107e0e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.285+0000 7f389af74640 1 Processor -- start 2024-08-18T23:57:17.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f389af74640 1 -- start start 2024-08-18T23:57:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f60f1677640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ec06c610 con 0x7f60ec0b18b0 2024-08-18T23:57:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f5776f6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57700b2d30 0x7f57700725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f5776f6f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5770072b20 0x7f57700b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f5776f6f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577006e500 con 0x7f5770162420 2024-08-18T23:57:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f5776f6f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5770071540 con 0x7f5770072b20 2024-08-18T23:57:17.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.286+0000 7f5776f6f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5770071820 con 0x7f57700b2d30 2024-08-18T23:57:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f60eb7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f60ec0736e0 0x7f60ec0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f60eb7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f60ec0736e0 0x7f60ec0ca980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55406/0 (socket says 172.21.15.103:55406) 2024-08-18T23:57:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f60eb7fe640 1 -- 172.21.15.103:0/4200112670 learned_addr learned my addr 172.21.15.103:0/4200112670 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc007c60 con 0x7f08d40039b0 2024-08-18T23:57:17.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f08ea7fc640 1 -- 172.21.15.103:0/2204131242 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc005ad0 con 0x7f08d40039b0 2024-08-18T23:57:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7ff39ae8b640 1 Processor -- start 2024-08-18T23:57:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f60f1677640 1 -- 172.21.15.103:0/4200112670 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ec06c8f0 con 0x7f60ec0b0cf0 2024-08-18T23:57:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f60f1677640 1 -- 172.21.15.103:0/4200112670 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f60ec0b1c90 con 0x7f60ec0736e0 2024-08-18T23:57:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f07c4010640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f07bc0bcc80 0x7f07bc0bc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7fb803c42640 1 Processor -- start 2024-08-18T23:57:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7ff39ae8b640 1 -- start start 2024-08-18T23:57:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f07c1dac640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f07bc15cb20 0x7f07bc06d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:45836/0 (socket says 172.21.15.103:45836) 2024-08-18T23:57:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f60eb7fe640 1 -- 172.21.15.103:0/4200112670 >> v1:172.21.15.190:6789/0 conn(0x7f60ec0b0cf0 legacy=0x7f60ec072fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-18T23:57:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f5775f6d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f5770162420 0x7f577006ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56530/0 (socket says 172.21.15.103:56530) 2024-08-18T23:57:17.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f5775f6d640 1 -- 172.21.15.103:0/282976260 learned_addr learned my addr 172.21.15.103:0/282976260 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7fb803c42640 1 -- start start 2024-08-18T23:57:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f577676e640 1 --2- 172.21.15.103:0/282976260 >> v2:172.21.15.190:3300/0 conn(0x7f5770072b20 0x7f57700b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f389af74640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f388c0345e0 0x7f388c03aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f389af74640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c036a00 0x7f388c007730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f389af74640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f388c0542c0 con 0x7f388c0e2fe0 2024-08-18T23:57:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f389af74640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f388c036f00 con 0x7f388c0345e0 2024-08-18T23:57:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f389af74640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f388c008ab0 con 0x7f388c036a00 2024-08-18T23:57:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f07c4010640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07bc06e150 con 0x7f07bc0bc5b0 2024-08-18T23:57:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f3899771640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f388c0345e0 0x7f388c03aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f389a773640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c036a00 0x7f388c007730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f3899771640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f388c0345e0 0x7f388c03aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55416/0 (socket says 172.21.15.103:55416) 2024-08-18T23:57:17.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f3899771640 1 -- 172.21.15.103:0/704723630 learned_addr learned my addr 172.21.15.103:0/704723630 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f08f21bf640 1 -- 172.21.15.103:0/2204131242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08d40039b0 msgr2=0x7f08d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f08f21bf640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08d40039b0 0x7f08d4003d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00c190 tx=0x7f08d4005830 comp rx=0 tx=0).stop 2024-08-18T23:57:17.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f07c4010640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07bc06e430 con 0x7f07bc15cb20 2024-08-18T23:57:17.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f07c4010640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f07bc06df10 con 0x7f07bc0bcc80 2024-08-18T23:57:17.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7fb803c42640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f4036730 0x7fb7f4185360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7ff39ae8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff39414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7ff39ae8b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39414d9d0 0x7ff3940729b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7fb803c42640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f40551b0 0x7fb7f4182910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7fb8019de640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f4036730 0x7fb7f4185360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7fb8019de640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f4036730 0x7fb7f4185360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55418/0 (socket says 172.21.15.103:55418) 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7fb8019de640 1 -- 172.21.15.103:0/2158629182 learned_addr learned my addr 172.21.15.103:0/2158629182 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7fb8011dd640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f40551b0 0x7fb7f4182910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb803c42640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f40e1c30 0x7fb7f4053130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7ff39ae8b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3941efb30 0x7ff39414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7ff399688640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39414d9d0 0x7ff3940729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7ff399688640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39414d9d0 0x7ff3940729b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55420/0 (socket says 172.21.15.103:55420) 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7ff399688640 1 -- 172.21.15.103:0/4243043494 learned_addr learned my addr 172.21.15.103:0/4243043494 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff394071b80 con 0x7ff3800052e0 2024-08-18T23:57:17.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940718a0 con 0x7ff39414d9d0 2024-08-18T23:57:17.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff39415e110 con 0x7ff3941efb30 2024-08-18T23:57:17.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff39a68a640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3941efb30 0x7ff39414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f4054e30 con 0x7fb7f40551b0 2024-08-18T23:57:17.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f60eb7fe640 1 -- 172.21.15.103:0/4200112670 >> v1:172.21.15.103:6789/0 conn(0x7f60ec0b18b0 legacy=0x7f60ec06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f60eb7fe640 1 -- 172.21.15.103:0/4200112670 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec06cbd0 con 0x7f60ec0736e0 2024-08-18T23:57:17.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f577676e640 1 -- 172.21.15.103:0/282976260 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57700b2d30 msgr2=0x7f57700725e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T23:57:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f577676e640 1 --2- 172.21.15.103:0/282976260 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57700b2d30 0x7f57700725e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f577676e640 1 -- 172.21.15.103:0/282976260 >> v1:172.21.15.103:6789/0 conn(0x7f5770162420 legacy=0x7f577006ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f577676e640 1 -- 172.21.15.103:0/282976260 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5770071b00 con 0x7f5770072b20 2024-08-18T23:57:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f4054cb0 con 0x7fb7f4036730 2024-08-18T23:57:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f4007070 con 0x7fb7f40e1c30 2024-08-18T23:57:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f08f21bf640 1 -- 172.21.15.103:0/2204131242 shutdown_connections 2024-08-18T23:57:17.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f08f21bf640 1 --2- 172.21.15.103:0/2204131242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08d40039b0 0x7f08d4003d90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f08f21bf640 1 -- 172.21.15.103:0/2204131242 >> 172.21.15.103:0/2204131242 conn(0x7f08ec0b18b0 msgr2=0x7f08ec0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.287+0000 7f07c1dac640 1 -- 172.21.15.103:0/3113451255 learned_addr learned my addr 172.21.15.103:0/3113451255 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f389a773640 1 -- 172.21.15.103:0/704723630 >> v2:172.21.15.190:3300/0 conn(0x7f388c0345e0 msgr2=0x7f388c03aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f60eb7fe640 1 --2- 172.21.15.103:0/4200112670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec0736e0 0x7f60ec0ca980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009e50 tx=0x7f60e402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=370a9733546fcb25 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f389a773640 1 --2- 172.21.15.103:0/704723630 >> v2:172.21.15.190:3300/0 conn(0x7f388c0345e0 0x7f388c03aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb8021df640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f40e1c30 0x7fb7f4053130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff399e89640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff39414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f07c15ab640 1 --2- 172.21.15.103:0/3113451255 >> v2:172.21.15.103:3300/0 conn(0x7f07bc0bcc80 0x7f07bc0bc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051018615 0 0) 0x7f07bc06e430 con 0x7f07bc15cb20 2024-08-18T23:57:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f08f21bf640 1 -- 172.21.15.103:0/2204131242 shutdown_connections 2024-08-18T23:57:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff399688640 1 -- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3941efb30 msgr2=0x7ff39414e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff399688640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3941efb30 0x7ff39414e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff399688640 1 -- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 msgr2=0x7ff39414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff399688640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff39414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff399688640 1 -- 172.21.15.103:0/4243043494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff394073300 con 0x7ff39414d9d0 2024-08-18T23:57:17.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07a8003520 con 0x7f07bc15cb20 2024-08-18T23:57:17.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191989381 0 0) 0x7f07bc06e150 con 0x7f07bc0bc5b0 2024-08-18T23:57:17.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07bc06e430 con 0x7f07bc0bc5b0 2024-08-18T23:57:17.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff39a68a640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3941efb30 0x7ff39414e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:17.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f60e9ffb640 1 -- 172.21.15.103:0/4200112670 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4036070 con 0x7f60ec0736e0 2024-08-18T23:57:17.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1673882198 0 0) 0x7f07bc06e430 con 0x7f07bc0bc5b0 2024-08-18T23:57:17.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f60e9ffb640 1 -- 172.21.15.103:0/4200112670 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e4031600 con 0x7f60ec0736e0 2024-08-18T23:57:17.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f60e9ffb640 1 -- 172.21.15.103:0/4200112670 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40319d0 con 0x7f60ec0736e0 2024-08-18T23:57:17.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 >> v2:172.21.15.103:3300/0 conn(0x7f07bc0bcc80 msgr2=0x7f07bc0bc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f08f21bf640 1 -- 172.21.15.103:0/2204131242 wait complete. 2024-08-18T23:57:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f389a773640 1 -- 172.21.15.103:0/704723630 >> v1:172.21.15.103:6789/0 conn(0x7f388c0e2fe0 legacy=0x7f388c03a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.288+0000 7f389a773640 1 -- 172.21.15.103:0/704723630 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c0350b0 con 0x7f388c036a00 2024-08-18T23:57:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f389a773640 1 --2- 172.21.15.103:0/704723630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c036a00 0x7f388c007730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38840097a0 tx=0x7f388402a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4a917a01ffb70ef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb8011dd640 1 -- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f40e1c30 msgr2=0x7fb7f4053130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb8011dd640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f40e1c30 0x7fb7f4053130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb8011dd640 1 -- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f4036730 msgr2=0x7fb7f4185360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb8011dd640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f4036730 0x7fb7f4185360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7fb8011dd640 1 -- 172.21.15.103:0/2158629182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f4185940 con 0x7fb7f40551b0 2024-08-18T23:57:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7ff399688640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39414d9d0 0x7ff3940729b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00bda0 tx=0x7ff38c009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7fb8019de640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f4036730 0x7fb7f4185360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f577676e640 1 --2- 172.21.15.103:0/282976260 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770072b20 0x7f57700b45f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5768009d90 tx=0x7f576802a590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee9cc31231266018 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 --2- 172.21.15.103:0/3113451255 >> v2:172.21.15.103:3300/0 conn(0x7f07bc0bcc80 0x7f07bc0bc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 >> v1:172.21.15.190:6789/0 conn(0x7f07bc15cb20 legacy=0x7f07bc06d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.289+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc06e710 con 0x7f07bc0bc5b0 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f07b4001920 con 0x7f07bc0bc5b0 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 >> v1:172.21.15.103:6789/0 conn(0x7f07bc0bc5b0 legacy=0x7f07bc16bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c0daa640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a8004c40 0x7f07a8005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c0daa640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a80037a0 0x7f07a8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c0daa640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07a80041d0 0x7f07a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc06df10 con 0x7f07a80037a0 2024-08-18T23:57:17.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f07a800c190 con 0x7f07a8004c40 2024-08-18T23:57:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f07a800c390 con 0x7f07a80041d0 2024-08-18T23:57:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c15ab640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a80037a0 0x7f07a8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7fb8011dd640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f40551b0 0x7fb7f4182910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc06a750 tx=0x7fb7fc069440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f60f1677640 1 -- 172.21.15.103:0/4200112670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec0736e0 msgr2=0x7f60ec0ca980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f60f1677640 1 --2- 172.21.15.103:0/4200112670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec0736e0 0x7f60ec0ca980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009e50 tx=0x7f60e402a710 comp rx=0 tx=0).stop 2024-08-18T23:57:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f60f1677640 1 -- 172.21.15.103:0/4200112670 shutdown_connections 2024-08-18T23:57:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f60f1677640 1 --2- 172.21.15.103:0/4200112670 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec0736e0 0x7f60ec0ca980 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f60f1677640 1 -- 172.21.15.103:0/4200112670 >> 172.21.15.103:0/4200112670 conn(0x7f60ec0d0330 msgr2=0x7f60ec0d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7ff38a7fc640 1 -- 172.21.15.103:0/4243043494 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c019070 con 0x7ff39414d9d0 2024-08-18T23:57:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3940735e0 con 0x7ff39414d9d0 2024-08-18T23:57:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff394151580 con 0x7ff39414d9d0 2024-08-18T23:57:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f07c1dac640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a8004c40 0x7f07a8005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f3898f70640 1 -- 172.21.15.103:0/704723630 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3884037070 con 0x7f388c036a00 2024-08-18T23:57:17.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7f3898f70640 1 -- 172.21.15.103:0/704723630 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f388402adc0 con 0x7f388c036a00 2024-08-18T23:57:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7fb7f27fc640 1 -- 172.21.15.103:0/2158629182 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc074c20 con 0x7fb7f40551b0 2024-08-18T23:57:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.290+0000 7fb7f27fc640 1 -- 172.21.15.103:0/2158629182 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc08f070 con 0x7fb7f40551b0 2024-08-18T23:57:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f389af74640 1 -- 172.21.15.103:0/704723630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c036a00 msgr2=0x7f388c007730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f5774f6b640 1 -- 172.21.15.103:0/282976260 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768007740 con 0x7f5770072b20 2024-08-18T23:57:17.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f5774f6b640 1 -- 172.21.15.103:0/282976260 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57680078e0 con 0x7f5770072b20 2024-08-18T23:57:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f389af74640 1 --2- 172.21.15.103:0/704723630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c036a00 0x7f388c007730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f38840097a0 tx=0x7f388402a0b0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f389af74640 1 -- 172.21.15.103:0/704723630 shutdown_connections 2024-08-18T23:57:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f389af74640 1 --2- 172.21.15.103:0/704723630 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c036a00 0x7f388c007730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f389af74640 1 --2- 172.21.15.103:0/704723630 >> v2:172.21.15.190:3300/0 conn(0x7f388c0345e0 0x7f388c03aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f389af74640 1 -- 172.21.15.103:0/704723630 >> 172.21.15.103:0/704723630 conn(0x7f388c01ea40 msgr2=0x7f388c0556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f08f21bf640 1 Processor -- start 2024-08-18T23:57:17.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f4185c20 con 0x7fb7f40551b0 2024-08-18T23:57:17.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f07c15ab640 1 -- 172.21.15.103:0/3113451255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07a80041d0 msgr2=0x7f07a800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-18T23:57:17.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f07c15ab640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07a80041d0 0x7f07a800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f07c15ab640 1 -- 172.21.15.103:0/3113451255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a8004c40 msgr2=0x7f07a8005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f07c15ab640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a8004c40 0x7f07a8005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f07c15ab640 1 -- 172.21.15.103:0/3113451255 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc06e430 con 0x7f07a80037a0 2024-08-18T23:57:17.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f07c25ad640 1 -- 172.21.15.103:0/3113451255 reap_dead start 2024-08-18T23:57:17.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f07c1dac640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a8004c40 0x7f07a8005040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:17.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f07c15ab640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a80037a0 0x7f07a8003c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0d8510 tx=0x7f07a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8a84928de1a6b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f41861e0 con 0x7fb7f40551b0 2024-08-18T23:57:17.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7fb7f27fc640 1 -- 172.21.15.103:0/2158629182 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc075060 con 0x7fb7f40551b0 2024-08-18T23:57:17.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f60f1677640 1 -- 172.21.15.103:0/4200112670 shutdown_connections 2024-08-18T23:57:17.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7ff38a7fc640 1 -- 172.21.15.103:0/4243043494 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff38c00ce10 con 0x7ff39414d9d0 2024-08-18T23:57:17.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f08f21bf640 1 -- start start 2024-08-18T23:57:17.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f389af74640 1 -- 172.21.15.103:0/704723630 shutdown_connections 2024-08-18T23:57:17.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7ff38a7fc640 1 -- 172.21.15.103:0/4243043494 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c014680 con 0x7ff39414d9d0 2024-08-18T23:57:17.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff37c005290 con 0x7ff39414d9d0 2024-08-18T23:57:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7f08f21bf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d40039b0 0x7f08ec14b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7ff38a7fc640 1 -- 172.21.15.103:0/4243043494 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff38c01c070 con 0x7ff39414d9d0 2024-08-18T23:57:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7f08f21bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08ec14b800 0x7f08ec0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f4039910 con 0x7fb7f40551b0 2024-08-18T23:57:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7f08f21bf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ec0c60b0 0x7f08ec149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7f08eb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d40039b0 0x7f08ec14b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.291+0000 7f60f1677640 1 -- 172.21.15.103:0/4200112670 wait complete. 2024-08-18T23:57:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7f60f1677640 1 Processor -- start 2024-08-18T23:57:17.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7f08eb7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d40039b0 0x7f08ec14b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43758/0 (socket says 172.21.15.103:43758) 2024-08-18T23:57:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f5776f6f640 1 -- 172.21.15.103:0/282976260 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770072b20 msgr2=0x7f57700b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7ff38a7fc640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff37806bf30 0x7ff37806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08eaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08ec14b800 0x7f08ec0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08eb7fe640 1 -- 172.21.15.103:0/3732147963 learned_addr learned my addr 172.21.15.103:0/3732147963 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec0cf830 con 0x7f08ec14b800 2024-08-18T23:57:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f08ec0cf6b0 con 0x7f08ec0c60b0 2024-08-18T23:57:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f08ec0cf9b0 con 0x7f08d40039b0 2024-08-18T23:57:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08ebfff640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ec0c60b0 0x7f08ec149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac036070 con 0x7f07a80037a0 2024-08-18T23:57:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ac031400 con 0x7f07a80037a0 2024-08-18T23:57:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f07c0daa640 1 -- 172.21.15.103:0/3113451255 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac009690 con 0x7f07a80037a0 2024-08-18T23:57:17.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08ebfff640 1 -- 172.21.15.103:0/3732147963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d40039b0 msgr2=0x7f08ec14b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08ebfff640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d40039b0 0x7f08ec14b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08ebfff640 1 -- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08ec14b800 msgr2=0x7f08ec0c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08ebfff640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08ec14b800 0x7f08ec0c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f08ebfff640 1 -- 172.21.15.103:0/3732147963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ec0c91b0 con 0x7f08ec0c60b0 2024-08-18T23:57:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7fb7f27fc640 1 -- 172.21.15.103:0/2158629182 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7fc075200 con 0x7fb7f40551b0 2024-08-18T23:57:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7ff399e89640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff37806bf30 0x7ff37806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7ff399e89640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff37806bf30 0x7ff37806e3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff384000c00 tx=0x7ff384009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f08ebfff640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ec0c60b0 0x7f08ec149fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0ce5e0 tx=0x7f08e400cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f60f1677640 1 -- start start 2024-08-18T23:57:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f60f1677640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec0736e0 0x7f60ec16c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7ff38a7fc640 1 -- 172.21.15.103:0/4243043494 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff38c08af50 con 0x7ff39414d9d0 2024-08-18T23:57:17.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f60f1677640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec0b18b0 0x7f60ec1f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.293+0000 7f389af74640 1 -- 172.21.15.103:0/704723630 wait complete. 2024-08-18T23:57:17.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f389af74640 1 Processor -- start 2024-08-18T23:57:17.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f389af74640 1 -- start start 2024-08-18T23:57:17.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7fb7f27fc640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb7e006beb0 0x7fb7e006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f60ea7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec0b18b0 0x7f60ec1f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f60ea7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec0b18b0 0x7f60ec1f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38574/0 (socket says 172.21.15.103:38574) 2024-08-18T23:57:17.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f60ea7fc640 1 -- 172.21.15.103:0/8536897 learned_addr learned my addr 172.21.15.103:0/8536897 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f07c4010640 1 -- 172.21.15.103:0/3113451255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a80037a0 msgr2=0x7f07a8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f07c4010640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a80037a0 0x7f07a8003c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0d8510 tx=0x7f07a8005830 comp rx=0 tx=0).stop 2024-08-18T23:57:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f60f1677640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec16dff0 0x7f60ec1f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.295+0000 7f60eaffd640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec0736e0 0x7f60ec16c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60eb7fe640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec16dff0 0x7f60ec1f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec067a10 con 0x7f60ec0b18b0 2024-08-18T23:57:17.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f07c4010640 1 -- 172.21.15.103:0/3113451255 shutdown_connections 2024-08-18T23:57:17.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f07c4010640 1 --2- 172.21.15.103:0/3113451255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07a80037a0 0x7f07a8003c20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f07c4010640 1 -- 172.21.15.103:0/3113451255 >> 172.21.15.103:0/3113451255 conn(0x7f07bc06b900 msgr2=0x7f07bc06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f60ec067890 con 0x7f60ec16dff0 2024-08-18T23:57:17.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f60ec067b90 con 0x7f60ec0736e0 2024-08-18T23:57:17.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f389af74640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c0345e0 0x7f388c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7fb8019de640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb7e006beb0 0x7fb7e006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f389af74640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f388c036a00 0x7f388c00ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f389af74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f388c0e2fe0 0x7f388c00b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f389af74640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f388c03afe0 con 0x7f388c0e2fe0 2024-08-18T23:57:17.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f389af74640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f388c008f40 con 0x7f388c036a00 2024-08-18T23:57:17.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f389af74640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f388c03b160 con 0x7f388c0345e0 2024-08-18T23:57:17.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60eaffd640 1 -- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec16dff0 msgr2=0x7f60ec1f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899f72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c0345e0 0x7f388c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899f72640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c0345e0 0x7f388c0cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:43778/0 (socket says 172.21.15.103:43778) 2024-08-18T23:57:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60eaffd640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec16dff0 0x7f60ec1f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60eaffd640 1 -- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec0b18b0 msgr2=0x7f60ec1f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899f72640 1 -- 172.21.15.103:0/510644599 learned_addr learned my addr 172.21.15.103:0/510644599 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899771640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f388c036a00 0x7f388c00ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f07c4010640 1 -- 172.21.15.103:0/3113451255 shutdown_connections 2024-08-18T23:57:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f389a773640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f388c0e2fe0 0x7f388c00b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60eaffd640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec0b18b0 0x7f60ec1f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60eaffd640 1 -- 172.21.15.103:0/8536897 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ec16ca50 con 0x7f60ec0736e0 2024-08-18T23:57:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7fb8019de640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb7e006beb0 0x7fb7e006e370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4000f90 tx=0x7fb7f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899f72640 1 -- 172.21.15.103:0/510644599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f388c036a00 msgr2=0x7f388c00ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f60ea7fc640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec0b18b0 0x7f60ec1f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:17.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899f72640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f388c036a00 0x7f388c00ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899f72640 1 -- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f388c0e2fe0 msgr2=0x7f388c00b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899f72640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f388c0e2fe0 0x7f388c00b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f3899f72640 1 -- 172.21.15.103:0/510644599 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f388c0c4600 con 0x7f388c0345e0 2024-08-18T23:57:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7fb7f27fc640 1 -- 172.21.15.103:0/2158629182 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb7fc1061f0 con 0x7fb7f40551b0 2024-08-18T23:57:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f60eaffd640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec0736e0 0x7f60ec16c510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c410 tx=0x7f60dc00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f07c4010640 1 -- 172.21.15.103:0/3113451255 wait complete. 2024-08-18T23:57:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f5776f6f640 1 --2- 172.21.15.103:0/282976260 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770072b20 0x7f57700b45f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5768009d90 tx=0x7f576802a590 comp rx=0 tx=0).stop 2024-08-18T23:57:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f5776f6f640 1 -- 172.21.15.103:0/282976260 shutdown_connections 2024-08-18T23:57:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f5776f6f640 1 --2- 172.21.15.103:0/282976260 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5770072b20 0x7f57700b45f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f5776f6f640 1 --2- 172.21.15.103:0/282976260 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f57700b2d30 0x7f57700725e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f5776f6f640 1 -- 172.21.15.103:0/282976260 >> 172.21.15.103:0/282976260 conn(0x7f57700b1780 msgr2=0x7f57700b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f5776f6f640 1 -- 172.21.15.103:0/282976260 shutdown_connections 2024-08-18T23:57:17.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.292+0000 7f5776f6f640 1 -- 172.21.15.103:0/282976260 wait complete. 2024-08-18T23:57:17.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f3899f72640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c0345e0 0x7f388c0cc630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3894050f50 tx=0x7f3894069440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f5776f6f640 1 Processor -- start 2024-08-18T23:57:17.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.294+0000 7f5776f6f640 1 -- start start 2024-08-18T23:57:17.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f5776f6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5770072b20 0x7f5770160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f5775f6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5770072b20 0x7f5770160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f5775f6d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5770072b20 0x7f5770160170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38578/0 (socket says 172.21.15.103:38578) 2024-08-18T23:57:17.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f5775f6d640 1 -- 172.21.15.103:0/618424410 learned_addr learned my addr 172.21.15.103:0/618424410 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f5776f6f640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57700b2d30 0x7f5770201f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f60d37fe640 1 -- 172.21.15.103:0/8536897 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc017070 con 0x7f60ec0736e0 2024-08-18T23:57:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f577576c640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57700b2d30 0x7f5770201f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.296+0000 7f5776f6f640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5770162420 0x7f5770200790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f57700b4b30 con 0x7f5770072b20 2024-08-18T23:57:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f57700720c0 con 0x7f57700b2d30 2024-08-18T23:57:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f57700b4cb0 con 0x7f5770162420 2024-08-18T23:57:17.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f60d37fe640 1 -- 172.21.15.103:0/8536897 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60dc005250 con 0x7f60ec0736e0 2024-08-18T23:57:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f388a7fc640 1 -- 172.21.15.103:0/510644599 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894074c20 con 0x7f388c0345e0 2024-08-18T23:57:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ec16ccf0 con 0x7f60ec0736e0 2024-08-18T23:57:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ec16d2b0 con 0x7f60ec0736e0 2024-08-18T23:57:17.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f388a7fc640 1 -- 172.21.15.103:0/510644599 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389408f070 con 0x7f388c0345e0 2024-08-18T23:57:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f388c052610 con 0x7f388c0345e0 2024-08-18T23:57:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f5775f6d640 1 -- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5770162420 msgr2=0x7f5770200790 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-18T23:57:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f577676e640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5770162420 0x7f5770200790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f5775f6d640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5770162420 0x7f5770200790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f5775f6d640 1 -- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57700b2d30 msgr2=0x7f5770201f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f388c052bd0 con 0x7f388c0345e0 2024-08-18T23:57:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f5775f6d640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57700b2d30 0x7f5770201f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.297+0000 7f5775f6d640 1 -- 172.21.15.103:0/618424410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5770163f50 con 0x7f5770072b20 2024-08-18T23:57:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.298+0000 7f5775f6d640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5770072b20 0x7f5770160170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f576c00b780 tx=0x7f576c00bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.298+0000 7f388a7fc640 1 -- 172.21.15.103:0/510644599 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3894075120 con 0x7f388c0345e0 2024-08-18T23:57:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.298+0000 7f60d37fe640 1 -- 172.21.15.103:0/8536897 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0045e0 con 0x7f60ec0736e0 2024-08-18T23:57:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.298+0000 7f07c4010640 1 Processor -- start 2024-08-18T23:57:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.298+0000 7f07c4010640 1 -- start start 2024-08-18T23:57:17.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.299+0000 7ff38a7fc640 1 -- 172.21.15.103:0/4243043494 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff38c0590e0 con 0x7ff39414d9d0 2024-08-18T23:57:17.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.299+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388c03a390 con 0x7f388c0345e0 2024-08-18T23:57:17.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.299+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ec0ca980 con 0x7f60ec0736e0 2024-08-18T23:57:17.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c4010640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a80037a0 0x7f07bc0b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.299+0000 7f08d3fff640 1 -- 172.21.15.103:0/3732147963 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e4017070 con 0x7f08ec0c60b0 2024-08-18T23:57:17.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.299+0000 7f08d3fff640 1 -- 172.21.15.103:0/3732147963 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e4005d40 con 0x7f08ec0c60b0 2024-08-18T23:57:17.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.299+0000 7f08d3fff640 1 -- 172.21.15.103:0/3732147963 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e400a850 con 0x7f08ec0c60b0 2024-08-18T23:57:17.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c4010640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07bc1f8d40 0x7f07bc144bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08ec0c8110 con 0x7f08ec0c60b0 2024-08-18T23:57:17.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c1dac640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a80037a0 0x7f07bc0b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c4010640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07bc1eabb0 0x7f07bc1eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c15ab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07bc1f8d40 0x7f07bc144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c1dac640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a80037a0 0x7f07bc0b84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:55482/0 (socket says 172.21.15.103:55482) 2024-08-18T23:57:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f388a7fc640 1 -- 172.21.15.103:0/510644599 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38940752c0 con 0x7f388c0345e0 2024-08-18T23:57:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08ec0c86d0 con 0x7f08ec0c60b0 2024-08-18T23:57:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c15ab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07bc1f8d40 0x7f07bc144bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38608/0 (socket says 172.21.15.103:38608) 2024-08-18T23:57:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c4010640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc06f1f0 con 0x7f07bc1f8d40 2024-08-18T23:57:17.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c4010640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc06ecd0 con 0x7f07a80037a0 2024-08-18T23:57:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c4010640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f07bc1eb560 con 0x7f07bc1eabb0 2024-08-18T23:57:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c1dac640 1 -- 172.21.15.103:0/2874891614 learned_addr learned my addr 172.21.15.103:0/2874891614 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f07c25ad640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07bc1eabb0 0x7f07bc1eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.300+0000 7f60d37fe640 1 -- 172.21.15.103:0/8536897 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60dc01a070 con 0x7f60ec0736e0 2024-08-18T23:57:17.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f388a7fc640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f387806be30 0x7f387806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f07c25ad640 1 -- 172.21.15.103:0/2874891614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a80037a0 msgr2=0x7f07bc0b84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f07c25ad640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a80037a0 0x7f07bc0b84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f07c25ad640 1 -- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07bc1f8d40 msgr2=0x7f07bc144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f07c25ad640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07bc1f8d40 0x7f07bc144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f07c25ad640 1 -- 172.21.15.103:0/2874891614 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc1457b0 con 0x7f07bc1eabb0 2024-08-18T23:57:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f07c25ad640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07bc1eabb0 0x7f07bc1eb020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f07bc068010 tx=0x7f07b400ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f60d37fe640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60d806be80 0x7f60d806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f60d37fe640 1 -- 172.21.15.103:0/8536897 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f60dc08a270 con 0x7f60ec0736e0 2024-08-18T23:57:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08ec15a280 con 0x7f08ec0c60b0 2024-08-18T23:57:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f3899771640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f387806be30 0x7f387806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.301+0000 7f60ea7fc640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60d806be80 0x7f60d806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.302+0000 7f388a7fc640 1 -- 172.21.15.103:0/510644599 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3894106360 con 0x7f388c0345e0 2024-08-18T23:57:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.302+0000 7f3899771640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f387806be30 0x7f387806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f388c00eb90 tx=0x7f3890009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.302+0000 7f60ea7fc640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60d806be80 0x7f60d806e340 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f60ec073280 tx=0x7f60e0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.302+0000 7f08d3fff640 1 -- 172.21.15.103:0/3732147963 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08e400a9f0 con 0x7f08ec0c60b0 2024-08-18T23:57:17.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.303+0000 7f08d3fff640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f08d806be80 0x7f08d806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.303+0000 7f08eb7fe640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f08d806be80 0x7f08d806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.303+0000 7f08d3fff640 1 -- 172.21.15.103:0/3732147963 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f08e408a310 con 0x7f08ec0c60b0 2024-08-18T23:57:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.304+0000 7f08eb7fe640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f08d806be80 0x7f08d806e340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005fd0 tx=0x7f08dc009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.304+0000 7fb7f27fc640 1 -- 172.21.15.103:0/2158629182 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb7fc0d4180 con 0x7fb7f40551b0 2024-08-18T23:57:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.304+0000 7f57667fc640 1 -- 172.21.15.103:0/618424410 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c019070 con 0x7f5770072b20 2024-08-18T23:57:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.304+0000 7f57667fc640 1 -- 172.21.15.103:0/618424410 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c00c740 con 0x7f5770072b20 2024-08-18T23:57:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.304+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5770201b50 con 0x7f5770072b20 2024-08-18T23:57:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.304+0000 7f57667fc640 1 -- 172.21.15.103:0/618424410 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c00cb30 con 0x7f5770072b20 2024-08-18T23:57:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.304+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57701644d0 con 0x7f5770072b20 2024-08-18T23:57:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.305+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57700b45f0 con 0x7f5770072b20 2024-08-18T23:57:17.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.306+0000 7f388a7fc640 1 -- 172.21.15.103:0/510644599 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f38940d4940 con 0x7f388c0345e0 2024-08-18T23:57:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.306+0000 7f57667fc640 1 -- 172.21.15.103:0/618424410 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f576c01c070 con 0x7f5770072b20 2024-08-18T23:57:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.307+0000 7f57667fc640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f575406be30 0x7f575406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.307+0000 7f57667fc640 1 -- 172.21.15.103:0/618424410 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f576c08a7a0 con 0x7f5770072b20 2024-08-18T23:57:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.307+0000 7f577576c640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f575406be30 0x7f575406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.308+0000 7f08d3fff640 1 -- 172.21.15.103:0/3732147963 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f08e40583a0 con 0x7f08ec0c60b0 2024-08-18T23:57:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.308+0000 7f577576c640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f575406be30 0x7f575406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57701606b0 tx=0x7f57600090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.310+0000 7f60d37fe640 1 -- 172.21.15.103:0/8536897 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f60dc058370 con 0x7f60ec0736e0 2024-08-18T23:57:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.311+0000 7f07b27fc640 1 -- 172.21.15.103:0/2874891614 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4017070 con 0x7f07bc1eabb0 2024-08-18T23:57:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.311+0000 7f07b27fc640 1 -- 172.21.15.103:0/2874891614 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07b400a610 con 0x7f07bc1eabb0 2024-08-18T23:57:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.311+0000 7f07b27fc640 1 -- 172.21.15.103:0/2874891614 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b400aa00 con 0x7f07bc1eabb0 2024-08-18T23:57:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.312+0000 7f07c4010640 1 -- 172.21.15.103:0/2874891614 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07bc145a90 con 0x7f07bc1eabb0 2024-08-18T23:57:17.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.312+0000 7f07c4010640 1 -- 172.21.15.103:0/2874891614 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f07bc146050 con 0x7f07bc1eabb0 2024-08-18T23:57:17.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.314+0000 7f079ffff640 1 -- 172.21.15.103:0/2874891614 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07bc0bc070 con 0x7f07bc1eabb0 2024-08-18T23:57:17.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.315+0000 7f07b27fc640 1 -- 172.21.15.103:0/2874891614 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f07b400aba0 con 0x7f07bc1eabb0 2024-08-18T23:57:17.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.316+0000 7f07b27fc640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f07a006bf00 0x7f07a006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.316+0000 7f07b27fc640 1 -- 172.21.15.103:0/2874891614 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f07b408a560 con 0x7f07bc1eabb0 2024-08-18T23:57:17.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.316+0000 7f57667fc640 1 -- 172.21.15.103:0/618424410 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f576c058720 con 0x7f5770072b20 2024-08-18T23:57:17.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.316+0000 7f07c1dac640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f07a006bf00 0x7f07a006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.317+0000 7f07c1dac640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f07a006bf00 0x7f07a006e3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f07bc1640e0 tx=0x7f07b8007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.321+0000 7f07b27fc640 1 -- 172.21.15.103:0/2874891614 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f07b4058560 con 0x7f07bc1eabb0 2024-08-18T23:57:17.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.627+0000 7fdaab43b640 1 -- 172.21.15.103:0/1361812583 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fda84005850 con 0x7fdaa41668b0 2024-08-18T23:57:17.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.627+0000 7fda99ffb640 1 -- 172.21.15.103:0/1361812583 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda9c059350 con 0x7fdaa41668b0 2024-08-18T23:57:17.629 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:17.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.631+0000 7fda8f7fe640 1 -- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fda8806bf00 msgr2=0x7fda8806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.631+0000 7fda8f7fe640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fda8806bf00 0x7fda8806e3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40af640 tx=0x7fda94008040 comp rx=0 tx=0).stop 2024-08-18T23:57:17.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.631+0000 7fda8f7fe640 1 -- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa41668b0 msgr2=0x7fdaa413b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.631+0000 7fda8f7fe640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa41668b0 0x7fdaa413b9d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00b970 tx=0x7fda9c00be30 comp rx=0 tx=0).stop 2024-08-18T23:57:17.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.631+0000 7fda8f7fe640 1 -- 172.21.15.103:0/1361812583 shutdown_connections 2024-08-18T23:57:17.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.631+0000 7fda8f7fe640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fda8806bf00 0x7fda8806e3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.632+0000 7fda8f7fe640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdaa41668b0 0x7fdaa413b9d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.632+0000 7fda8f7fe640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdaa4165f90 0x7fdaa41602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.632+0000 7fda8f7fe640 1 --2- 172.21.15.103:0/1361812583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdaa4071410 0x7fdaa413c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.632+0000 7fda8f7fe640 1 -- 172.21.15.103:0/1361812583 >> 172.21.15.103:0/1361812583 conn(0x7fdaa40cfb10 msgr2=0x7fdaa40cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.632+0000 7fda8f7fe640 1 -- 172.21.15.103:0/1361812583 shutdown_connections 2024-08-18T23:57:17.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.632+0000 7fda8f7fe640 1 -- 172.21.15.103:0/1361812583 wait complete. 2024-08-18T23:57:17.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-08-18T23:57:17.650 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:17.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.671+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f60ec072fd0 con 0x7f60ec0736e0 2024-08-18T23:57:17.673 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-08-18T23:57:17.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.672+0000 7f60d37fe640 1 -- 172.21.15.103:0/8536897 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f60dc05c670 con 0x7f60ec0736e0 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60d806be80 msgr2=0x7f60d806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60d806be80 0x7f60d806e340 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f60ec073280 tx=0x7f60e0009190 comp rx=0 tx=0).stop 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec0736e0 msgr2=0x7f60ec16c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec0736e0 0x7f60ec16c510 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c410 tx=0x7f60dc00c8d0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 shutdown_connections 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60d806be80 0x7f60d806e340 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f60ec16dff0 0x7f60ec1f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60ec0b18b0 0x7f60ec1f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 --2- 172.21.15.103:0/8536897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f60ec0736e0 0x7f60ec16c510 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 >> 172.21.15.103:0/8536897 conn(0x7f60ec0d0330 msgr2=0x7f60ec0b5cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 shutdown_connections 2024-08-18T23:57:17.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.674+0000 7f60f1677640 1 -- 172.21.15.103:0/8536897 wait complete. 2024-08-18T23:57:17.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-08-18T23:57:17.687 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:17.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.698+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff37c005580 con 0x7ff39414d9d0 2024-08-18T23:57:17.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.699+0000 7ff38a7fc640 1 -- 172.21.15.103:0/4243043494 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff38c08a070 con 0x7ff39414d9d0 2024-08-18T23:57:17.701 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-08-18T23:57:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff37806bf30 msgr2=0x7ff37806e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff37806bf30 0x7ff37806e3f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff384000c00 tx=0x7ff384009040 comp rx=0 tx=0).stop 2024-08-18T23:57:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39414d9d0 msgr2=0x7ff3940729b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39414d9d0 0x7ff3940729b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00bda0 tx=0x7ff38c009ed0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 shutdown_connections 2024-08-18T23:57:17.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff37806bf30 0x7ff37806e3f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff3941efb30 0x7ff39414e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff39414d9d0 0x7ff3940729b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 --2- 172.21.15.103:0/4243043494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3800052e0 0x7ff39414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 >> 172.21.15.103:0/4243043494 conn(0x7ff39406c3f0 msgr2=0x7ff3940b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 shutdown_connections 2024-08-18T23:57:17.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7ff39ae8b640 1 -- 172.21.15.103:0/4243043494 wait complete. 2024-08-18T23:57:17.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.702+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb7f404fdd0 con 0x7fb7f40551b0 2024-08-18T23:57:17.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.703+0000 7fb7f27fc640 1 -- 172.21.15.103:0/2158629182 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7fc0d8480 con 0x7fb7f40551b0 2024-08-18T23:57:17.707 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:17.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb7e006beb0 msgr2=0x7fb7e006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb7e006beb0 0x7fb7e006e370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4000f90 tx=0x7fb7f8009040 comp rx=0 tx=0).stop 2024-08-18T23:57:17.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f40551b0 msgr2=0x7fb7f4182910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f40551b0 0x7fb7f4182910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc06a750 tx=0x7fb7fc069440 comp rx=0 tx=0).stop 2024-08-18T23:57:17.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 shutdown_connections 2024-08-18T23:57:17.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb7e006beb0 0x7fb7e006e370 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7f40e1c30 0x7fb7f4053130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7f40551b0 0x7fb7f4182910 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 --2- 172.21.15.103:0/2158629182 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7f4036730 0x7fb7f4185360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 >> 172.21.15.103:0/2158629182 conn(0x7fb7f401d930 msgr2=0x7fb7f4006510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 shutdown_connections 2024-08-18T23:57:17.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.705+0000 7fb803c42640 1 -- 172.21.15.103:0/2158629182 wait complete. 2024-08-18T23:57:17.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.706+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f388c0d99b0 con 0x7f388c0345e0 2024-08-18T23:57:17.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.707+0000 7f388a7fc640 1 -- 172.21.15.103:0/510644599 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f38940d4240 con 0x7f388c0345e0 2024-08-18T23:57:17.712 INFO:teuthology.orchestra.run.smithi103.stdout:55834574857 2024-08-18T23:57:17.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.710+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f08ec14d160 con 0x7f08ec0c60b0 2024-08-18T23:57:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.710+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f387806be30 msgr2=0x7f387806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.710+0000 7f389af74640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f387806be30 0x7f387806e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f388c00eb90 tx=0x7f3890009240 comp rx=0 tx=0).stop 2024-08-18T23:57:17.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.710+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c0345e0 msgr2=0x7f388c0cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.710+0000 7f389af74640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c0345e0 0x7f388c0cc630 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3894050f50 tx=0x7f3894069440 comp rx=0 tx=0).stop 2024-08-18T23:57:17.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.710+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 shutdown_connections 2024-08-18T23:57:17.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.711+0000 7f389af74640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f387806be30 0x7f387806e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.711+0000 7f389af74640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f388c0e2fe0 0x7f388c00b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.711+0000 7f389af74640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f388c036a00 0x7f388c00ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.711+0000 7f389af74640 1 --2- 172.21.15.103:0/510644599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f388c0345e0 0x7f388c0cc630 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.711+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 >> 172.21.15.103:0/510644599 conn(0x7f388c01ea40 msgr2=0x7f388c0080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.711+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 shutdown_connections 2024-08-18T23:57:17.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.711+0000 7f389af74640 1 -- 172.21.15.103:0/510644599 wait complete. 2024-08-18T23:57:17.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.711+0000 7f08d3fff640 1 -- 172.21.15.103:0/3732147963 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08e405c6a0 con 0x7f08ec0c60b0 2024-08-18T23:57:17.718 INFO:teuthology.orchestra.run.smithi103.stdout:55834574859 2024-08-18T23:57:17.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.714+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f08d806be80 msgr2=0x7f08d806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.714+0000 7f08f21bf640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f08d806be80 0x7f08d806e340 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f08dc005fd0 tx=0x7f08dc009030 comp rx=0 tx=0).stop 2024-08-18T23:57:17.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.714+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ec0c60b0 msgr2=0x7f08ec149fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.714+0000 7f08f21bf640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ec0c60b0 0x7f08ec149fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0ce5e0 tx=0x7f08e400cb90 comp rx=0 tx=0).stop 2024-08-18T23:57:17.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.714+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 shutdown_connections 2024-08-18T23:57:17.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.714+0000 7f08f21bf640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f08d806be80 0x7f08d806e340 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.715+0000 7f08f21bf640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08ec0c60b0 0x7f08ec149fc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.715+0000 7f08f21bf640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08ec14b800 0x7f08ec0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.715+0000 7f08f21bf640 1 --2- 172.21.15.103:0/3732147963 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08d40039b0 0x7f08ec14b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.715+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 >> 172.21.15.103:0/3732147963 conn(0x7f08ec0b18b0 msgr2=0x7f08ec14c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.715+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 shutdown_connections 2024-08-18T23:57:17.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.715+0000 7f08f21bf640 1 -- 172.21.15.103:0/3732147963 wait complete. 2024-08-18T23:57:17.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.716+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5770154fd0 con 0x7f5770072b20 2024-08-18T23:57:17.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.717+0000 7f57667fc640 1 -- 172.21.15.103:0/618424410 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f576c05ca20 con 0x7f5770072b20 2024-08-18T23:57:17.723 INFO:teuthology.orchestra.run.smithi103.stdout:55834574859 2024-08-18T23:57:17.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-08-18T23:57:17.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.718+0000 7f079ffff640 1 -- 172.21.15.103:0/2874891614 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f07bc0b8a20 con 0x7f07bc1eabb0 2024-08-18T23:57:17.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.718+0000 7f07b27fc640 1 -- 172.21.15.103:0/2874891614 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f07b405c860 con 0x7f07bc1eabb0 2024-08-18T23:57:17.726 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:17.726 INFO:teuthology.orchestra.run.smithi103.stdout:55834574858 2024-08-18T23:57:17.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-08-18T23:57:17.728 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:17.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f575406be30 msgr2=0x7f575406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f575406be30 0x7f575406e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f57701606b0 tx=0x7f57600090e0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5770072b20 msgr2=0x7f5770160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5770072b20 0x7f5770160170 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f576c00b780 tx=0x7f576c00bc40 comp rx=0 tx=0).stop 2024-08-18T23:57:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 shutdown_connections 2024-08-18T23:57:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f575406be30 0x7f575406e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5770162420 0x7f5770200790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f57700b2d30 0x7f5770201f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 --2- 172.21.15.103:0/618424410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5770072b20 0x7f5770160170 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 >> 172.21.15.103:0/618424410 conn(0x7f57700b1780 msgr2=0x7f57700af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 shutdown_connections 2024-08-18T23:57:17.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.720+0000 7f5776f6f640 1 -- 172.21.15.103:0/618424410 wait complete. 2024-08-18T23:57:17.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 -- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f07a006bf00 msgr2=0x7f07a006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f07a006bf00 0x7f07a006e3c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f07bc1640e0 tx=0x7f07b8007dd0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 -- 172.21.15.103:0/2874891614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07bc1eabb0 msgr2=0x7f07bc1eb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07bc1eabb0 0x7f07bc1eb020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f07bc068010 tx=0x7f07b400ccd0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 -- 172.21.15.103:0/2874891614 shutdown_connections 2024-08-18T23:57:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f07a006bf00 0x7f07a006e3c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07bc1eabb0 0x7f07bc1eb020 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07bc1f8d40 0x7f07bc144bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 --2- 172.21.15.103:0/2874891614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07a80037a0 0x7f07bc0b84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 -- 172.21.15.103:0/2874891614 >> 172.21.15.103:0/2874891614 conn(0x7f07bc06b900 msgr2=0x7f07bc06c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 -- 172.21.15.103:0/2874891614 shutdown_connections 2024-08-18T23:57:17.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.722+0000 7f079ffff640 1 -- 172.21.15.103:0/2874891614 wait complete. 2024-08-18T23:57:17.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-08-18T23:57:17.736 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:17.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-08-18T23:57:17.737 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:17.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-08-18T23:57:17.739 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:17.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-08-18T23:57:17.740 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:17.740 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T23:57:17.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:17.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.877+0000 7f8596210640 1 Processor -- start 2024-08-18T23:57:17.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.877+0000 7f8596210640 1 -- start start 2024-08-18T23:57:17.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f8596210640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85900cbac0 0x7f85900aed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f8596210640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85900ced00 con 0x7f8590072b20 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f8596210640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859015e7b0 con 0x7f8590072740 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f8596210640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85900cc030 con 0x7f85900cbac0 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858effd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8590072b20 0x7f85900cb3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56576/0 (socket says 172.21.15.103:56576) 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858effd640 1 -- 172.21.15.103:0/684861073 learned_addr learned my addr 172.21.15.103:0/684861073 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858ffff640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85900cbac0 0x7f85900aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656219870 0 0) 0x7f85900ced00 con 0x7f8590072b20 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8578003520 con 0x7f8590072b20 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2890604035 0 0) 0x7f8578003520 con 0x7f8590072b20 2024-08-18T23:57:17.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85900cbac0 msgr2=0x7f85900aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85900cbac0 0x7f85900aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 >> v1:172.21.15.190:6789/0 conn(0x7f8590072740 legacy=0x7f85900cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85900cefa0 con 0x7f8590072b20 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f8584001670 con 0x7f8590072b20 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 >> v1:172.21.15.103:6789/0 conn(0x7f8590072b20 legacy=0x7f85900cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85780039e0 0x7f8578003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f8578004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85900cbac0 0x7f85780050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85900cc030 con 0x7f8578004390 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f857800b9c0 con 0x7f85780039e0 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f857800bbc0 con 0x7f85900cbac0 2024-08-18T23:57:17.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.878+0000 7f858effd640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f8578004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.879+0000 7f858f7fe640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85780039e0 0x7f8578003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.879+0000 7f858ffff640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85900cbac0 0x7f85780050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.879+0000 7f858effd640 1 -- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85900cbac0 msgr2=0x7f85780050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.879+0000 7f858effd640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85900cbac0 0x7f85780050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.879+0000 7f858effd640 1 -- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85780039e0 msgr2=0x7f8578003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.879+0000 7f858effd640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85780039e0 0x7f8578003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.879+0000 7f858effd640 1 -- 172.21.15.103:0/684861073 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8578003520 con 0x7f8578004390 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.879+0000 7f858effd640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f8578004860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f858400c190 tx=0x7f8578005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc08be6cd416cf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584007cc0 con 0x7f8578004390 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8584005ad0 con 0x7f8578004390 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f858e7fc640 1 -- 172.21.15.103:0/684861073 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8584007070 con 0x7f8578004390 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f8596210640 1 -- 172.21.15.103:0/684861073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 msgr2=0x7f8578004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f8596210640 1 --2- 172.21.15.103:0/684861073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f8578004860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f858400c190 tx=0x7f8578005830 comp rx=0 tx=0).stop 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f858ffff640 1 -- 172.21.15.103:0/684861073 reap_dead start 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f8596210640 1 -- 172.21.15.103:0/684861073 shutdown_connections 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f8596210640 1 -- 172.21.15.103:0/684861073 >> 172.21.15.103:0/684861073 conn(0x7f85900cd7e0 msgr2=0x7f85900cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f8596210640 1 -- 172.21.15.103:0/684861073 shutdown_connections 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.880+0000 7f8596210640 1 -- 172.21.15.103:0/684861073 wait complete. 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.881+0000 7f8596210640 1 Processor -- start 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f8596210640 1 -- start start 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f8596210640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f859014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f8596210640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f859006f460 0x7f8590153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f8596210640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f859006fda0 0x7f85900ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f8596210640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8590072f70 con 0x7f8578004390 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f8596210640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85900cc310 con 0x7f859006f460 2024-08-18T23:57:17.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f8596210640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85900730f0 con 0x7f859006fda0 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f858f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f859014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f858f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f859014f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38626/0 (socket says 172.21.15.103:38626) 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.882+0000 7f858f7fe640 1 -- 172.21.15.103:0/2554151003 learned_addr learned my addr 172.21.15.103:0/2554151003 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f858effd640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f859006f460 0x7f8590153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f858ffff640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f859006fda0 0x7f85900ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f858f7fe640 1 -- 172.21.15.103:0/2554151003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f859006fda0 msgr2=0x7f85900ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f858f7fe640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f859006fda0 0x7f85900ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f858f7fe640 1 -- 172.21.15.103:0/2554151003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f859006f460 msgr2=0x7f8590153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f858f7fe640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f859006f460 0x7f8590153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f858f7fe640 1 -- 172.21.15.103:0/2554151003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85900b4f20 con 0x7f8578004390 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f858f7fe640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f859014f860 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f858000f7c0 tx=0x7f858000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f8577fff640 1 -- 172.21.15.103:0/2554151003 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858000fe70 con 0x7f8578004390 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f8577fff640 1 -- 172.21.15.103:0/2554151003 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580018070 con 0x7f8578004390 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85901f7c50 con 0x7f8578004390 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f8577fff640 1 -- 172.21.15.103:0/2554151003 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858000d730 con 0x7f8578004390 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.883+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85900b51c0 con 0x7f8578004390 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.884+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85900cf7a0 con 0x7f8578004390 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.885+0000 7f8577fff640 1 -- 172.21.15.103:0/2554151003 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f858000d8d0 con 0x7f8578004390 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.885+0000 7f8577fff640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f857c06be60 0x7f857c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.885+0000 7f8577fff640 1 -- 172.21.15.103:0/2554151003 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f858008b0a0 con 0x7f8578004390 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.885+0000 7f858effd640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f857c06be60 0x7f857c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:17.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.885+0000 7f858effd640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f857c06be60 0x7f857c06e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f858400c190 tx=0x7f858402d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:17.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:17.889+0000 7f8577fff640 1 -- 172.21.15.103:0/2554151003 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f858001a310 con 0x7f8578004390 2024-08-18T23:57:18.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.050+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85900cb4c0 con 0x7f857c06be60 2024-08-18T23:57:18.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.058+0000 7f8577fff640 1 -- 172.21.15.103:0/2554151003 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f85900cb4c0 con 0x7f857c06be60 2024-08-18T23:57:18.063 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:18.065 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:18.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f857c06be60 msgr2=0x7f857c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f857c06be60 0x7f857c06e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f858400c190 tx=0x7f858402d000 comp rx=0 tx=0).stop 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 msgr2=0x7f859014f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f859014f860 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f858000f7c0 tx=0x7f858000fc80 comp rx=0 tx=0).stop 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 shutdown_connections 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f857c06be60 0x7f857c06e320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f859006fda0 0x7f85900ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f859006f460 0x7f8590153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 --2- 172.21.15.103:0/2554151003 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8578004390 0x7f859014f860 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 >> 172.21.15.103:0/2554151003 conn(0x7f85900cd7e0 msgr2=0x7f85900af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 shutdown_connections 2024-08-18T23:57:18.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.062+0000 7f8596210640 1 -- 172.21.15.103:0/2554151003 wait complete. 2024-08-18T23:57:18.074 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-08-18T23:57:16.169143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003330"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796132+0000","last_change":"2024-08-18T23:56:52.756091+0000","last_active":"2024-08-18T23:56:58.796132+0000","last_peered":"2024-08-18T23:56:58.796132+0000","last_clean":"2024-08-18T23:56:58.796132+0000","last_became_active":"2024-08-18T23:56:52.755823+0000","last_became_peered":"2024-08-18T23:56:52.755823+0000","last_unstale":"2024-08-18T23:56:58.796132+0000","last_undegraded":"2024-08-18T23:56:58.796132+0000","last_fullsized":"2024-08-18T23:56:58.796132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:10:48.081149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145741+0000","last_change":"2024-08-18T23:56:53.755660+0000","last_active":"2024-08-18T23:56:59.145741+0000","last_peered":"2024-08-18T23:56:59.145741+0000","last_clean":"2024-08-18T23:56:59.145741+0000","last_became_active":"2024-08-18T23:56:53.755395+0000","last_became_peered":"2024-08-18T23:56:53.755395+0000","last_unstale":"2024-08-18T23:56:59.145741+0000","last_undegraded":"2024-08-18T23:56:59.145741+0000","last_fullsized":"2024-08-18T23:56:59.145741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:24.430755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144804+0000","last_change":"2024-08-18T23:56:57.985729+0000","last_active":"2024-08-18T23:56:59.144804+0000","last_peered":"2024-08-18T23:56:59.144804+0000","last_clean":"2024-08-18T23:56:59.144804+0000","last_became_active":"2024-08-18T23:56:57.985390+0000","last_became_peered":"2024-08-18T23:56:57.985390+0000","last_unstale":"2024-08-18T23:56:59.144804+0000","last_undegraded":"2024-08-18T23:56:59.144804+0000","last_fullsized":"2024-08-18T23:56:59.144804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:47.865044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145904+0000","last_change":"2024-08-18T23:56:52.757392+0000","last_active":"2024-08-18T23:56:59.145904+0000","last_peered":"2024-08-18T23:56:59.145904+0000","last_clean":"2024-08-18T23:56:59.145904+0000","last_became_active":"2024-08-18T23:56:52.757111+0000","last_became_peered":"2024-08-18T23:56:52.757111+0000","last_unstale":"2024-08-18T23:56:59.145904+0000","last_undegraded":"2024-08-18T23:56:59.145904+0000","last_fullsized":"2024-08-18T23:56:59.145904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795884+0000","last_change":"2024-08-18T23:56:53.773415+0000","last_active":"2024-08-18T23:56:58.795884+0000","last_peered":"2024-08-18T23:56:58.795884+0000","last_clean":"2024-08-18T23:56:58.795884+0000","last_became_active":"2024-08-18T23:56:53.769428+0000","last_became_peered":"2024-08-18T23:56:53.769428+0000","last_unstale":"2024-08-18T23:56:58.795884+0000","last_undegraded":"2024-08-18T23:56:58.795884+0000","last_fullsized":"2024-08-18T23:56:58.795884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145415+0000","last_change":"2024-08-18T23:56:57.796039+0000","last_active":"2024-08-18T23:56:59.145415+0000","last_peered":"2024-08-18T23:56:59.145415+0000","last_clean":"2024-08-18T23:56:59.145415+0000","last_became_active":"2024-08-18T23:56:57.795504+0000","last_became_peered":"2024-08-18T23:56:57.795504+0000","last_unstale":"2024-08-18T23:56:59.145415+0000","last_undegraded":"2024-08-18T23:56:59.145415+0000","last_fullsized":"2024-08-18T23:56:59.145415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:45.045215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146785+0000","last_change":"2024-08-18T23:56:52.758482+0000","last_active":"2024-08-18T23:56:59.146785+0000","last_peered":"2024-08-18T23:56:59.146785+0000","last_clean":"2024-08-18T23:56:59.146785+0000","last_became_active":"2024-08-18T23:56:52.758194+0000","last_became_peered":"2024-08-18T23:56:52.758194+0000","last_unstale":"2024-08-18T23:56:59.146785+0000","last_undegraded":"2024-08-18T23:56:59.146785+0000","last_fullsized":"2024-08-18T23:56:59.146785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:34.443678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147481+0000","last_change":"2024-08-18T23:56:53.769569+0000","last_active":"2024-08-18T23:56:59.147481+0000","last_peered":"2024-08-18T23:56:59.147481+0000","last_clean":"2024-08-18T23:56:59.147481+0000","last_became_active":"2024-08-18T23:56:53.769304+0000","last_became_peered":"2024-08-18T23:56:53.769304+0000","last_unstale":"2024-08-18T23:56:59.147481+0000","last_undegraded":"2024-08-18T23:56:59.147481+0000","last_fullsized":"2024-08-18T23:56:59.147481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:24.430755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145660+0000","last_change":"2024-08-18T23:56:57.804268+0000","last_active":"2024-08-18T23:56:59.145660+0000","last_peered":"2024-08-18T23:56:59.145660+0000","last_clean":"2024-08-18T23:56:59.145660+0000","last_became_active":"2024-08-18T23:56:57.803915+0000","last_became_peered":"2024-08-18T23:56:57.803915+0000","last_unstale":"2024-08-18T23:56:59.145660+0000","last_undegraded":"2024-08-18T23:56:59.145660+0000","last_fullsized":"2024-08-18T23:56:59.145660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:26.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146148+0000","last_change":"2024-08-18T23:56:52.758724+0000","last_active":"2024-08-18T23:56:59.146148+0000","last_peered":"2024-08-18T23:56:59.146148+0000","last_clean":"2024-08-18T23:56:59.146148+0000","last_became_active":"2024-08-18T23:56:52.758420+0000","last_became_peered":"2024-08-18T23:56:52.758420+0000","last_unstale":"2024-08-18T23:56:59.146148+0000","last_undegraded":"2024-08-18T23:56:59.146148+0000","last_fullsized":"2024-08-18T23:56:59.146148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:11.818210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147721+0000","last_change":"2024-08-18T23:56:53.769922+0000","last_active":"2024-08-18T23:56:59.147721+0000","last_peered":"2024-08-18T23:56:59.147721+0000","last_clean":"2024-08-18T23:56:59.147721+0000","last_became_active":"2024-08-18T23:56:53.769638+0000","last_became_peered":"2024-08-18T23:56:53.769638+0000","last_unstale":"2024-08-18T23:56:59.147721+0000","last_undegraded":"2024-08-18T23:56:59.147721+0000","last_fullsized":"2024-08-18T23:56:59.147721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:38.459488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145653+0000","last_change":"2024-08-18T23:56:57.794111+0000","last_active":"2024-08-18T23:56:59.145653+0000","last_peered":"2024-08-18T23:56:59.145653+0000","last_clean":"2024-08-18T23:56:59.145653+0000","last_became_active":"2024-08-18T23:56:57.793673+0000","last_became_peered":"2024-08-18T23:56:57.793673+0000","last_unstale":"2024-08-18T23:56:59.145653+0000","last_undegraded":"2024-08-18T23:56:59.145653+0000","last_fullsized":"2024-08-18T23:56:59.145653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:03.077928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793609+0000","last_change":"2024-08-18T23:56:53.766114+0000","last_active":"2024-08-18T23:56:58.793609+0000","last_peered":"2024-08-18T23:56:58.793609+0000","last_clean":"2024-08-18T23:56:58.793609+0000","last_became_active":"2024-08-18T23:56:53.765850+0000","last_became_peered":"2024-08-18T23:56:53.765850+0000","last_unstale":"2024-08-18T23:56:58.793609+0000","last_undegraded":"2024-08-18T23:56:58.793609+0000","last_fullsized":"2024-08-18T23:56:58.793609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147028+0000","last_change":"2024-08-18T23:56:52.759173+0000","last_active":"2024-08-18T23:56:59.147028+0000","last_peered":"2024-08-18T23:56:59.147028+0000","last_clean":"2024-08-18T23:56:59.147028+0000","last_became_active":"2024-08-18T23:56:52.758044+0000","last_became_peered":"2024-08-18T23:56:52.758044+0000","last_unstale":"2024-08-18T23:56:59.147028+0000","last_undegraded":"2024-08-18T23:56:59.147028+0000","last_fullsized":"2024-08-18T23:56:59.147028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:54.977859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147008+0000","last_change":"2024-08-18T23:56:57.804321+0000","last_active":"2024-08-18T23:56:59.147008+0000","last_peered":"2024-08-18T23:56:59.147008+0000","last_clean":"2024-08-18T23:56:59.147008+0000","last_became_active":"2024-08-18T23:56:57.803852+0000","last_became_peered":"2024-08-18T23:56:57.803852+0000","last_unstale":"2024-08-18T23:56:59.147008+0000","last_undegraded":"2024-08-18T23:56:59.147008+0000","last_fullsized":"2024-08-18T23:56:59.147008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145007+0000","last_change":"2024-08-18T23:56:53.768638+0000","last_active":"2024-08-18T23:56:59.145007+0000","last_peered":"2024-08-18T23:56:59.145007+0000","last_clean":"2024-08-18T23:56:59.145007+0000","last_became_active":"2024-08-18T23:56:53.768163+0000","last_became_peered":"2024-08-18T23:56:53.768163+0000","last_unstale":"2024-08-18T23:56:59.145007+0000","last_undegraded":"2024-08-18T23:56:59.145007+0000","last_fullsized":"2024-08-18T23:56:59.145007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:22.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146062+0000","last_change":"2024-08-18T23:56:52.752900+0000","last_active":"2024-08-18T23:56:59.146062+0000","last_peered":"2024-08-18T23:56:59.146062+0000","last_clean":"2024-08-18T23:56:59.146062+0000","last_became_active":"2024-08-18T23:56:52.752616+0000","last_became_peered":"2024-08-18T23:56:52.752616+0000","last_unstale":"2024-08-18T23:56:59.146062+0000","last_undegraded":"2024-08-18T23:56:59.146062+0000","last_fullsized":"2024-08-18T23:56:59.146062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146712+0000","last_change":"2024-08-18T23:56:57.795841+0000","last_active":"2024-08-18T23:56:59.146712+0000","last_peered":"2024-08-18T23:56:59.146712+0000","last_clean":"2024-08-18T23:56:59.146712+0000","last_became_active":"2024-08-18T23:56:57.795354+0000","last_became_peered":"2024-08-18T23:56:57.795354+0000","last_unstale":"2024-08-18T23:56:59.146712+0000","last_undegraded":"2024-08-18T23:56:59.146712+0000","last_fullsized":"2024-08-18T23:56:59.146712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:53.536907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145239+0000","last_change":"2024-08-18T23:56:53.771090+0000","last_active":"2024-08-18T23:56:59.145239+0000","last_peered":"2024-08-18T23:56:59.145239+0000","last_clean":"2024-08-18T23:56:59.145239+0000","last_became_active":"2024-08-18T23:56:53.770808+0000","last_became_peered":"2024-08-18T23:56:53.770808+0000","last_unstale":"2024-08-18T23:56:59.145239+0000","last_undegraded":"2024-08-18T23:56:59.145239+0000","last_fullsized":"2024-08-18T23:56:59.145239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145853+0000","last_change":"2024-08-18T23:56:52.754196+0000","last_active":"2024-08-18T23:56:59.145853+0000","last_peered":"2024-08-18T23:56:59.145853+0000","last_clean":"2024-08-18T23:56:59.145853+0000","last_became_active":"2024-08-18T23:56:52.753897+0000","last_became_peered":"2024-08-18T23:56:52.753897+0000","last_unstale":"2024-08-18T23:56:59.145853+0000","last_undegraded":"2024-08-18T23:56:59.145853+0000","last_fullsized":"2024-08-18T23:56:59.145853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:33:22.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145815+0000","last_change":"2024-08-18T23:56:57.981814+0000","last_active":"2024-08-18T23:56:59.145815+0000","last_peered":"2024-08-18T23:56:59.145815+0000","last_clean":"2024-08-18T23:56:59.145815+0000","last_became_active":"2024-08-18T23:56:57.981431+0000","last_became_peered":"2024-08-18T23:56:57.981431+0000","last_unstale":"2024-08-18T23:56:59.145815+0000","last_undegraded":"2024-08-18T23:56:59.145815+0000","last_fullsized":"2024-08-18T23:56:59.145815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145805+0000","last_change":"2024-08-18T23:56:53.767404+0000","last_active":"2024-08-18T23:56:59.145805+0000","last_peered":"2024-08-18T23:56:59.145805+0000","last_clean":"2024-08-18T23:56:59.145805+0000","last_became_active":"2024-08-18T23:56:53.764501+0000","last_became_peered":"2024-08-18T23:56:53.764501+0000","last_unstale":"2024-08-18T23:56:59.145805+0000","last_undegraded":"2024-08-18T23:56:59.145805+0000","last_fullsized":"2024-08-18T23:56:59.145805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:37.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147087+0000","last_change":"2024-08-18T23:56:52.759789+0000","last_active":"2024-08-18T23:56:59.147087+0000","last_peered":"2024-08-18T23:56:59.147087+0000","last_clean":"2024-08-18T23:56:59.147087+0000","last_became_active":"2024-08-18T23:56:52.758829+0000","last_became_peered":"2024-08-18T23:56:52.758829+0000","last_unstale":"2024-08-18T23:56:59.147087+0000","last_undegraded":"2024-08-18T23:56:59.147087+0000","last_fullsized":"2024-08-18T23:56:59.147087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:30.187935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146272+0000","last_change":"2024-08-18T23:56:57.801849+0000","last_active":"2024-08-18T23:56:59.146272+0000","last_peered":"2024-08-18T23:56:59.146272+0000","last_clean":"2024-08-18T23:56:59.146272+0000","last_became_active":"2024-08-18T23:56:57.801424+0000","last_became_peered":"2024-08-18T23:56:57.801424+0000","last_unstale":"2024-08-18T23:56:59.146272+0000","last_undegraded":"2024-08-18T23:56:59.146272+0000","last_fullsized":"2024-08-18T23:56:59.146272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:28.469431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796181+0000","last_change":"2024-08-18T23:56:53.769056+0000","last_active":"2024-08-18T23:56:58.796181+0000","last_peered":"2024-08-18T23:56:58.796181+0000","last_clean":"2024-08-18T23:56:58.796181+0000","last_became_active":"2024-08-18T23:56:53.768321+0000","last_became_peered":"2024-08-18T23:56:53.768321+0000","last_unstale":"2024-08-18T23:56:58.796181+0000","last_undegraded":"2024-08-18T23:56:58.796181+0000","last_fullsized":"2024-08-18T23:56:58.796181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794222+0000","last_change":"2024-08-18T23:56:52.755465+0000","last_active":"2024-08-18T23:56:58.794222+0000","last_peered":"2024-08-18T23:56:58.794222+0000","last_clean":"2024-08-18T23:56:58.794222+0000","last_became_active":"2024-08-18T23:56:52.755229+0000","last_became_peered":"2024-08-18T23:56:52.755229+0000","last_unstale":"2024-08-18T23:56:58.794222+0000","last_undegraded":"2024-08-18T23:56:58.794222+0000","last_fullsized":"2024-08-18T23:56:58.794222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145628+0000","last_change":"2024-08-18T23:56:57.986350+0000","last_active":"2024-08-18T23:56:59.145628+0000","last_peered":"2024-08-18T23:56:59.145628+0000","last_clean":"2024-08-18T23:56:59.145628+0000","last_became_active":"2024-08-18T23:56:57.985425+0000","last_became_peered":"2024-08-18T23:56:57.985425+0000","last_unstale":"2024-08-18T23:56:59.145628+0000","last_undegraded":"2024-08-18T23:56:59.145628+0000","last_fullsized":"2024-08-18T23:56:59.145628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:21.592416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145448+0000","last_change":"2024-08-18T23:56:53.768554+0000","last_active":"2024-08-18T23:56:59.145448+0000","last_peered":"2024-08-18T23:56:59.145448+0000","last_clean":"2024-08-18T23:56:59.145448+0000","last_became_active":"2024-08-18T23:56:53.767502+0000","last_became_peered":"2024-08-18T23:56:53.767502+0000","last_unstale":"2024-08-18T23:56:59.145448+0000","last_undegraded":"2024-08-18T23:56:59.145448+0000","last_fullsized":"2024-08-18T23:56:59.145448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145919+0000","last_change":"2024-08-18T23:56:52.742342+0000","last_active":"2024-08-18T23:56:59.145919+0000","last_peered":"2024-08-18T23:56:59.145919+0000","last_clean":"2024-08-18T23:56:59.145919+0000","last_became_active":"2024-08-18T23:56:52.741958+0000","last_became_peered":"2024-08-18T23:56:52.741958+0000","last_unstale":"2024-08-18T23:56:59.145919+0000","last_undegraded":"2024-08-18T23:56:59.145919+0000","last_fullsized":"2024-08-18T23:56:59.145919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144744+0000","last_change":"2024-08-18T23:56:57.982697+0000","last_active":"2024-08-18T23:56:59.144744+0000","last_peered":"2024-08-18T23:56:59.144744+0000","last_clean":"2024-08-18T23:56:59.144744+0000","last_became_active":"2024-08-18T23:56:57.981397+0000","last_became_peered":"2024-08-18T23:56:57.981397+0000","last_unstale":"2024-08-18T23:56:59.144744+0000","last_undegraded":"2024-08-18T23:56:59.144744+0000","last_fullsized":"2024-08-18T23:56:59.144744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:04.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145536+0000","last_change":"2024-08-18T23:56:53.764548+0000","last_active":"2024-08-18T23:56:59.145536+0000","last_peered":"2024-08-18T23:56:59.145536+0000","last_clean":"2024-08-18T23:56:59.145536+0000","last_became_active":"2024-08-18T23:56:53.764280+0000","last_became_peered":"2024-08-18T23:56:53.764280+0000","last_unstale":"2024-08-18T23:56:59.145536+0000","last_undegraded":"2024-08-18T23:56:59.145536+0000","last_fullsized":"2024-08-18T23:56:59.145536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147248+0000","last_change":"2024-08-18T23:56:52.759045+0000","last_active":"2024-08-18T23:56:59.147248+0000","last_peered":"2024-08-18T23:56:59.147248+0000","last_clean":"2024-08-18T23:56:59.147248+0000","last_became_active":"2024-08-18T23:56:52.758744+0000","last_became_peered":"2024-08-18T23:56:52.758744+0000","last_unstale":"2024-08-18T23:56:59.147248+0000","last_undegraded":"2024-08-18T23:56:59.147248+0000","last_fullsized":"2024-08-18T23:56:59.147248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:56.808416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795776+0000","last_change":"2024-08-18T23:56:57.984133+0000","last_active":"2024-08-18T23:56:58.795776+0000","last_peered":"2024-08-18T23:56:58.795776+0000","last_clean":"2024-08-18T23:56:58.795776+0000","last_became_active":"2024-08-18T23:56:57.983723+0000","last_became_peered":"2024-08-18T23:56:57.983723+0000","last_unstale":"2024-08-18T23:56:58.795776+0000","last_undegraded":"2024-08-18T23:56:58.795776+0000","last_fullsized":"2024-08-18T23:56:58.795776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147781+0000","last_change":"2024-08-18T23:56:53.771404+0000","last_active":"2024-08-18T23:56:59.147781+0000","last_peered":"2024-08-18T23:56:59.147781+0000","last_clean":"2024-08-18T23:56:59.147781+0000","last_became_active":"2024-08-18T23:56:53.771115+0000","last_became_peered":"2024-08-18T23:56:53.771115+0000","last_unstale":"2024-08-18T23:56:59.147781+0000","last_undegraded":"2024-08-18T23:56:59.147781+0000","last_fullsized":"2024-08-18T23:56:59.147781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:31.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145623+0000","last_change":"2024-08-18T23:56:52.755938+0000","last_active":"2024-08-18T23:56:59.145623+0000","last_peered":"2024-08-18T23:56:59.145623+0000","last_clean":"2024-08-18T23:56:59.145623+0000","last_became_active":"2024-08-18T23:56:52.755665+0000","last_became_peered":"2024-08-18T23:56:52.755665+0000","last_unstale":"2024-08-18T23:56:59.145623+0000","last_undegraded":"2024-08-18T23:56:59.145623+0000","last_fullsized":"2024-08-18T23:56:59.145623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:54.232884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145948+0000","last_change":"2024-08-18T23:56:57.800426+0000","last_active":"2024-08-18T23:56:59.145948+0000","last_peered":"2024-08-18T23:56:59.145948+0000","last_clean":"2024-08-18T23:56:59.145948+0000","last_became_active":"2024-08-18T23:56:57.800074+0000","last_became_peered":"2024-08-18T23:56:57.800074+0000","last_unstale":"2024-08-18T23:56:59.145948+0000","last_undegraded":"2024-08-18T23:56:59.145948+0000","last_fullsized":"2024-08-18T23:56:59.145948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:36.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146563+0000","last_change":"2024-08-18T23:56:53.766348+0000","last_active":"2024-08-18T23:56:59.146563+0000","last_peered":"2024-08-18T23:56:59.146563+0000","last_clean":"2024-08-18T23:56:59.146563+0000","last_became_active":"2024-08-18T23:56:53.765359+0000","last_became_peered":"2024-08-18T23:56:53.765359+0000","last_unstale":"2024-08-18T23:56:59.146563+0000","last_undegraded":"2024-08-18T23:56:59.146563+0000","last_fullsized":"2024-08-18T23:56:59.146563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:33:23.061905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147639+0000","last_change":"2024-08-18T23:56:52.753019+0000","last_active":"2024-08-18T23:56:59.147639+0000","last_peered":"2024-08-18T23:56:59.147639+0000","last_clean":"2024-08-18T23:56:59.147639+0000","last_became_active":"2024-08-18T23:56:52.752740+0000","last_became_peered":"2024-08-18T23:56:52.752740+0000","last_unstale":"2024-08-18T23:56:59.147639+0000","last_undegraded":"2024-08-18T23:56:59.147639+0000","last_fullsized":"2024-08-18T23:56:59.147639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145300+0000","last_change":"2024-08-18T23:56:57.798746+0000","last_active":"2024-08-18T23:56:59.145300+0000","last_peered":"2024-08-18T23:56:59.145300+0000","last_clean":"2024-08-18T23:56:59.145300+0000","last_became_active":"2024-08-18T23:56:57.798335+0000","last_became_peered":"2024-08-18T23:56:57.798335+0000","last_unstale":"2024-08-18T23:56:59.145300+0000","last_undegraded":"2024-08-18T23:56:59.145300+0000","last_fullsized":"2024-08-18T23:56:59.145300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145775+0000","last_change":"2024-08-18T23:56:53.761896+0000","last_active":"2024-08-18T23:56:59.145775+0000","last_peered":"2024-08-18T23:56:59.145775+0000","last_clean":"2024-08-18T23:56:59.145775+0000","last_became_active":"2024-08-18T23:56:53.761638+0000","last_became_peered":"2024-08-18T23:56:53.761638+0000","last_unstale":"2024-08-18T23:56:59.145775+0000","last_undegraded":"2024-08-18T23:56:59.145775+0000","last_fullsized":"2024-08-18T23:56:59.145775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794282+0000","last_change":"2024-08-18T23:56:52.761057+0000","last_active":"2024-08-18T23:56:58.794282+0000","last_peered":"2024-08-18T23:56:58.794282+0000","last_clean":"2024-08-18T23:56:58.794282+0000","last_became_active":"2024-08-18T23:56:52.760813+0000","last_became_peered":"2024-08-18T23:56:52.760813+0000","last_unstale":"2024-08-18T23:56:58.794282+0000","last_undegraded":"2024-08-18T23:56:58.794282+0000","last_fullsized":"2024-08-18T23:56:58.794282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145978+0000","last_change":"2024-08-18T23:56:57.799531+0000","last_active":"2024-08-18T23:56:59.145978+0000","last_peered":"2024-08-18T23:56:59.145978+0000","last_clean":"2024-08-18T23:56:59.145978+0000","last_became_active":"2024-08-18T23:56:57.798589+0000","last_became_peered":"2024-08-18T23:56:57.798589+0000","last_unstale":"2024-08-18T23:56:59.145978+0000","last_undegraded":"2024-08-18T23:56:59.145978+0000","last_fullsized":"2024-08-18T23:56:59.145978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:57.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795376+0000","last_change":"2024-08-18T23:56:53.773751+0000","last_active":"2024-08-18T23:56:58.795376+0000","last_peered":"2024-08-18T23:56:58.795376+0000","last_clean":"2024-08-18T23:56:58.795376+0000","last_became_active":"2024-08-18T23:56:53.769340+0000","last_became_peered":"2024-08-18T23:56:53.769340+0000","last_unstale":"2024-08-18T23:56:58.795376+0000","last_undegraded":"2024-08-18T23:56:58.795376+0000","last_fullsized":"2024-08-18T23:56:58.795376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:54.085641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147163+0000","last_change":"2024-08-18T23:56:52.759398+0000","last_active":"2024-08-18T23:56:59.147163+0000","last_peered":"2024-08-18T23:56:59.147163+0000","last_clean":"2024-08-18T23:56:59.147163+0000","last_became_active":"2024-08-18T23:56:52.758246+0000","last_became_peered":"2024-08-18T23:56:52.758246+0000","last_unstale":"2024-08-18T23:56:59.147163+0000","last_undegraded":"2024-08-18T23:56:59.147163+0000","last_fullsized":"2024-08-18T23:56:59.147163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:53.080654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796092+0000","last_change":"2024-08-18T23:56:57.985422+0000","last_active":"2024-08-18T23:56:58.796092+0000","last_peered":"2024-08-18T23:56:58.796092+0000","last_clean":"2024-08-18T23:56:58.796092+0000","last_became_active":"2024-08-18T23:56:57.984963+0000","last_became_peered":"2024-08-18T23:56:57.984963+0000","last_unstale":"2024-08-18T23:56:58.796092+0000","last_undegraded":"2024-08-18T23:56:58.796092+0000","last_fullsized":"2024-08-18T23:56:58.796092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.275461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144943+0000","last_change":"2024-08-18T23:56:53.766829+0000","last_active":"2024-08-18T23:56:59.144943+0000","last_peered":"2024-08-18T23:56:59.144943+0000","last_clean":"2024-08-18T23:56:59.144943+0000","last_became_active":"2024-08-18T23:56:53.766585+0000","last_became_peered":"2024-08-18T23:56:53.766585+0000","last_unstale":"2024-08-18T23:56:59.144943+0000","last_undegraded":"2024-08-18T23:56:59.144943+0000","last_fullsized":"2024-08-18T23:56:59.144943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146162+0000","last_change":"2024-08-18T23:56:52.749395+0000","last_active":"2024-08-18T23:56:59.146162+0000","last_peered":"2024-08-18T23:56:59.146162+0000","last_clean":"2024-08-18T23:56:59.146162+0000","last_became_active":"2024-08-18T23:56:52.749089+0000","last_became_peered":"2024-08-18T23:56:52.749089+0000","last_unstale":"2024-08-18T23:56:59.146162+0000","last_undegraded":"2024-08-18T23:56:59.146162+0000","last_fullsized":"2024-08-18T23:56:59.146162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147280+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:56:59.147280+0000","last_peered":"2024-08-18T23:56:59.147280+0000","last_clean":"2024-08-18T23:56:59.147280+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:56:59.147280+0000","last_undegraded":"2024-08-18T23:56:59.147280+0000","last_fullsized":"2024-08-18T23:56:59.147280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793760+0000","last_change":"2024-08-18T23:56:57.985242+0000","last_active":"2024-08-18T23:56:58.793760+0000","last_peered":"2024-08-18T23:56:58.793760+0000","last_clean":"2024-08-18T23:56:58.793760+0000","last_became_active":"2024-08-18T23:56:57.984868+0000","last_became_peered":"2024-08-18T23:56:57.984868+0000","last_unstale":"2024-08-18T23:56:58.793760+0000","last_undegraded":"2024-08-18T23:56:58.793760+0000","last_fullsized":"2024-08-18T23:56:58.793760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146556+0000","last_change":"2024-08-18T23:56:53.770252+0000","last_active":"2024-08-18T23:56:59.146556+0000","last_peered":"2024-08-18T23:56:59.146556+0000","last_clean":"2024-08-18T23:56:59.146556+0000","last_became_active":"2024-08-18T23:56:53.769985+0000","last_became_peered":"2024-08-18T23:56:53.769985+0000","last_unstale":"2024-08-18T23:56:59.146556+0000","last_undegraded":"2024-08-18T23:56:59.146556+0000","last_fullsized":"2024-08-18T23:56:59.146556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:53.459015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794847+0000","last_change":"2024-08-18T23:56:52.753918+0000","last_active":"2024-08-18T23:56:58.794847+0000","last_peered":"2024-08-18T23:56:58.794847+0000","last_clean":"2024-08-18T23:56:58.794847+0000","last_became_active":"2024-08-18T23:56:52.753634+0000","last_became_peered":"2024-08-18T23:56:52.753634+0000","last_unstale":"2024-08-18T23:56:58.794847+0000","last_undegraded":"2024-08-18T23:56:58.794847+0000","last_fullsized":"2024-08-18T23:56:58.794847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793607+0000","last_change":"2024-08-18T23:56:57.981987+0000","last_active":"2024-08-18T23:56:58.793607+0000","last_peered":"2024-08-18T23:56:58.793607+0000","last_clean":"2024-08-18T23:56:58.793607+0000","last_became_active":"2024-08-18T23:56:57.981487+0000","last_became_peered":"2024-08-18T23:56:57.981487+0000","last_unstale":"2024-08-18T23:56:58.793607+0000","last_undegraded":"2024-08-18T23:56:58.793607+0000","last_fullsized":"2024-08-18T23:56:58.793607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147493+0000","last_change":"2024-08-18T23:56:53.775056+0000","last_active":"2024-08-18T23:56:59.147493+0000","last_peered":"2024-08-18T23:56:59.147493+0000","last_clean":"2024-08-18T23:56:59.147493+0000","last_became_active":"2024-08-18T23:56:53.772898+0000","last_became_peered":"2024-08-18T23:56:53.772898+0000","last_unstale":"2024-08-18T23:56:59.147493+0000","last_undegraded":"2024-08-18T23:56:59.147493+0000","last_fullsized":"2024-08-18T23:56:59.147493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145727+0000","last_change":"2024-08-18T23:56:52.753178+0000","last_active":"2024-08-18T23:56:59.145727+0000","last_peered":"2024-08-18T23:56:59.145727+0000","last_clean":"2024-08-18T23:56:59.145727+0000","last_became_active":"2024-08-18T23:56:52.752810+0000","last_became_peered":"2024-08-18T23:56:52.752810+0000","last_unstale":"2024-08-18T23:56:59.145727+0000","last_undegraded":"2024-08-18T23:56:59.145727+0000","last_fullsized":"2024-08-18T23:56:59.145727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795903+0000","last_change":"2024-08-18T23:56:57.796078+0000","last_active":"2024-08-18T23:56:58.795903+0000","last_peered":"2024-08-18T23:56:58.795903+0000","last_clean":"2024-08-18T23:56:58.795903+0000","last_became_active":"2024-08-18T23:56:57.795669+0000","last_became_peered":"2024-08-18T23:56:57.795669+0000","last_unstale":"2024-08-18T23:56:58.795903+0000","last_undegraded":"2024-08-18T23:56:58.795903+0000","last_fullsized":"2024-08-18T23:56:58.795903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:36.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146826+0000","last_change":"2024-08-18T23:56:53.769692+0000","last_active":"2024-08-18T23:56:59.146826+0000","last_peered":"2024-08-18T23:56:59.146826+0000","last_clean":"2024-08-18T23:56:59.146826+0000","last_became_active":"2024-08-18T23:56:53.768418+0000","last_became_peered":"2024-08-18T23:56:53.768418+0000","last_unstale":"2024-08-18T23:56:59.146826+0000","last_undegraded":"2024-08-18T23:56:59.146826+0000","last_fullsized":"2024-08-18T23:56:59.146826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:06.397680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794421+0000","last_change":"2024-08-18T23:56:52.756405+0000","last_active":"2024-08-18T23:56:58.794421+0000","last_peered":"2024-08-18T23:56:58.794421+0000","last_clean":"2024-08-18T23:56:58.794421+0000","last_became_active":"2024-08-18T23:56:52.756101+0000","last_became_peered":"2024-08-18T23:56:52.756101+0000","last_unstale":"2024-08-18T23:56:58.794421+0000","last_undegraded":"2024-08-18T23:56:58.794421+0000","last_fullsized":"2024-08-18T23:56:58.794421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145551+0000","last_change":"2024-08-18T23:56:57.984658+0000","last_active":"2024-08-18T23:56:59.145551+0000","last_peered":"2024-08-18T23:56:59.145551+0000","last_clean":"2024-08-18T23:56:59.145551+0000","last_became_active":"2024-08-18T23:56:57.984250+0000","last_became_peered":"2024-08-18T23:56:57.984250+0000","last_unstale":"2024-08-18T23:56:59.145551+0000","last_undegraded":"2024-08-18T23:56:59.145551+0000","last_fullsized":"2024-08-18T23:56:59.145551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:45.358309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146315+0000","last_change":"2024-08-18T23:56:53.764626+0000","last_active":"2024-08-18T23:56:59.146315+0000","last_peered":"2024-08-18T23:56:59.146315+0000","last_clean":"2024-08-18T23:56:59.146315+0000","last_became_active":"2024-08-18T23:56:53.764329+0000","last_became_peered":"2024-08-18T23:56:53.764329+0000","last_unstale":"2024-08-18T23:56:59.146315+0000","last_undegraded":"2024-08-18T23:56:59.146315+0000","last_fullsized":"2024-08-18T23:56:59.146315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:16.778909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146458+0000","last_change":"2024-08-18T23:56:52.756222+0000","last_active":"2024-08-18T23:56:59.146458+0000","last_peered":"2024-08-18T23:56:59.146458+0000","last_clean":"2024-08-18T23:56:59.146458+0000","last_became_active":"2024-08-18T23:56:52.755983+0000","last_became_peered":"2024-08-18T23:56:52.755983+0000","last_unstale":"2024-08-18T23:56:59.146458+0000","last_undegraded":"2024-08-18T23:56:59.146458+0000","last_fullsized":"2024-08-18T23:56:59.146458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:43:40.687385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145369+0000","last_change":"2024-08-18T23:56:57.797013+0000","last_active":"2024-08-18T23:56:59.145369+0000","last_peered":"2024-08-18T23:56:59.145369+0000","last_clean":"2024-08-18T23:56:59.145369+0000","last_became_active":"2024-08-18T23:56:57.796588+0000","last_became_peered":"2024-08-18T23:56:57.796588+0000","last_unstale":"2024-08-18T23:56:59.145369+0000","last_undegraded":"2024-08-18T23:56:59.145369+0000","last_fullsized":"2024-08-18T23:56:59.145369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:01.094119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146228+0000","last_change":"2024-08-18T23:56:53.769197+0000","last_active":"2024-08-18T23:56:59.146228+0000","last_peered":"2024-08-18T23:56:59.146228+0000","last_clean":"2024-08-18T23:56:59.146228+0000","last_became_active":"2024-08-18T23:56:53.768715+0000","last_became_peered":"2024-08-18T23:56:53.768715+0000","last_unstale":"2024-08-18T23:56:59.146228+0000","last_undegraded":"2024-08-18T23:56:59.146228+0000","last_fullsized":"2024-08-18T23:56:59.146228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:57.104014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794086+0000","last_change":"2024-08-18T23:56:52.756491+0000","last_active":"2024-08-18T23:56:58.794086+0000","last_peered":"2024-08-18T23:56:58.794086+0000","last_clean":"2024-08-18T23:56:58.794086+0000","last_became_active":"2024-08-18T23:56:52.756158+0000","last_became_peered":"2024-08-18T23:56:52.756158+0000","last_unstale":"2024-08-18T23:56:58.794086+0000","last_undegraded":"2024-08-18T23:56:58.794086+0000","last_fullsized":"2024-08-18T23:56:58.794086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:31.503425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795726+0000","last_change":"2024-08-18T23:56:57.796919+0000","last_active":"2024-08-18T23:56:58.795726+0000","last_peered":"2024-08-18T23:56:58.795726+0000","last_clean":"2024-08-18T23:56:58.795726+0000","last_became_active":"2024-08-18T23:56:57.796482+0000","last_became_peered":"2024-08-18T23:56:57.796482+0000","last_unstale":"2024-08-18T23:56:58.795726+0000","last_undegraded":"2024-08-18T23:56:58.795726+0000","last_fullsized":"2024-08-18T23:56:58.795726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:57.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793669+0000","last_change":"2024-08-18T23:56:53.762288+0000","last_active":"2024-08-18T23:56:58.793669+0000","last_peered":"2024-08-18T23:56:58.793669+0000","last_clean":"2024-08-18T23:56:58.793669+0000","last_became_active":"2024-08-18T23:56:53.762007+0000","last_became_peered":"2024-08-18T23:56:53.762007+0000","last_unstale":"2024-08-18T23:56:58.793669+0000","last_undegraded":"2024-08-18T23:56:58.793669+0000","last_fullsized":"2024-08-18T23:56:58.793669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793757+0000","last_change":"2024-08-18T23:56:52.748797+0000","last_active":"2024-08-18T23:56:58.793757+0000","last_peered":"2024-08-18T23:56:58.793757+0000","last_clean":"2024-08-18T23:56:58.793757+0000","last_became_active":"2024-08-18T23:56:52.747807+0000","last_became_peered":"2024-08-18T23:56:52.747807+0000","last_unstale":"2024-08-18T23:56:58.793757+0000","last_undegraded":"2024-08-18T23:56:58.793757+0000","last_fullsized":"2024-08-18T23:56:58.793757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145359+0000","last_change":"2024-08-18T23:56:57.985530+0000","last_active":"2024-08-18T23:56:59.145359+0000","last_peered":"2024-08-18T23:56:59.145359+0000","last_clean":"2024-08-18T23:56:59.145359+0000","last_became_active":"2024-08-18T23:56:57.985049+0000","last_became_peered":"2024-08-18T23:56:57.985049+0000","last_unstale":"2024-08-18T23:56:59.145359+0000","last_undegraded":"2024-08-18T23:56:59.145359+0000","last_fullsized":"2024-08-18T23:56:59.145359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:31.882944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146550+0000","last_change":"2024-08-18T23:56:53.769503+0000","last_active":"2024-08-18T23:56:59.146550+0000","last_peered":"2024-08-18T23:56:59.146550+0000","last_clean":"2024-08-18T23:56:59.146550+0000","last_became_active":"2024-08-18T23:56:53.768768+0000","last_became_peered":"2024-08-18T23:56:53.768768+0000","last_unstale":"2024-08-18T23:56:59.146550+0000","last_undegraded":"2024-08-18T23:56:59.146550+0000","last_fullsized":"2024-08-18T23:56:59.146550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:31.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147504+0000","last_change":"2024-08-18T23:56:52.752031+0000","last_active":"2024-08-18T23:56:59.147504+0000","last_peered":"2024-08-18T23:56:59.147504+0000","last_clean":"2024-08-18T23:56:59.147504+0000","last_became_active":"2024-08-18T23:56:52.751751+0000","last_became_peered":"2024-08-18T23:56:52.751751+0000","last_unstale":"2024-08-18T23:56:59.147504+0000","last_undegraded":"2024-08-18T23:56:59.147504+0000","last_fullsized":"2024-08-18T23:56:59.147504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145177+0000","last_change":"2024-08-18T23:56:57.981834+0000","last_active":"2024-08-18T23:56:59.145177+0000","last_peered":"2024-08-18T23:56:59.145177+0000","last_clean":"2024-08-18T23:56:59.145177+0000","last_became_active":"2024-08-18T23:56:57.981436+0000","last_became_peered":"2024-08-18T23:56:57.981436+0000","last_unstale":"2024-08-18T23:56:59.145177+0000","last_undegraded":"2024-08-18T23:56:59.145177+0000","last_fullsized":"2024-08-18T23:56:59.145177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:26.326851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795759+0000","last_change":"2024-08-18T23:56:53.767263+0000","last_active":"2024-08-18T23:56:58.795759+0000","last_peered":"2024-08-18T23:56:58.795759+0000","last_clean":"2024-08-18T23:56:58.795759+0000","last_became_active":"2024-08-18T23:56:53.763206+0000","last_became_peered":"2024-08-18T23:56:53.763206+0000","last_unstale":"2024-08-18T23:56:58.795759+0000","last_undegraded":"2024-08-18T23:56:58.795759+0000","last_fullsized":"2024-08-18T23:56:58.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:55.982846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796033+0000","last_change":"2024-08-18T23:56:52.755349+0000","last_active":"2024-08-18T23:56:58.796033+0000","last_peered":"2024-08-18T23:56:58.796033+0000","last_clean":"2024-08-18T23:56:58.796033+0000","last_became_active":"2024-08-18T23:56:52.755083+0000","last_became_peered":"2024-08-18T23:56:52.755083+0000","last_unstale":"2024-08-18T23:56:58.796033+0000","last_undegraded":"2024-08-18T23:56:58.796033+0000","last_fullsized":"2024-08-18T23:56:58.796033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:21.056208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147710+0000","last_change":"2024-08-18T23:56:57.982048+0000","last_active":"2024-08-18T23:56:59.147710+0000","last_peered":"2024-08-18T23:56:59.147710+0000","last_clean":"2024-08-18T23:56:59.147710+0000","last_became_active":"2024-08-18T23:56:57.981629+0000","last_became_peered":"2024-08-18T23:56:57.981629+0000","last_unstale":"2024-08-18T23:56:59.147710+0000","last_undegraded":"2024-08-18T23:56:59.147710+0000","last_fullsized":"2024-08-18T23:56:59.147710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:10.436357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146447+0000","last_change":"2024-08-18T23:56:53.769453+0000","last_active":"2024-08-18T23:56:59.146447+0000","last_peered":"2024-08-18T23:56:59.146447+0000","last_clean":"2024-08-18T23:56:59.146447+0000","last_became_active":"2024-08-18T23:56:53.768971+0000","last_became_peered":"2024-08-18T23:56:53.768971+0000","last_unstale":"2024-08-18T23:56:59.146447+0000","last_undegraded":"2024-08-18T23:56:59.146447+0000","last_fullsized":"2024-08-18T23:56:59.146447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:18.236785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:57:03.095757+0000","last_change":"2024-08-18T23:56:52.742740+0000","last_active":"2024-08-18T23:57:03.095757+0000","last_peered":"2024-08-18T23:57:03.095757+0000","last_clean":"2024-08-18T23:57:03.095757+0000","last_became_active":"2024-08-18T23:56:52.742250+0000","last_became_peered":"2024-08-18T23:56:52.742250+0000","last_unstale":"2024-08-18T23:57:03.095757+0000","last_undegraded":"2024-08-18T23:57:03.095757+0000","last_fullsized":"2024-08-18T23:57:03.095757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145905+0000","last_change":"2024-08-18T23:56:57.796638+0000","last_active":"2024-08-18T23:56:59.145905+0000","last_peered":"2024-08-18T23:56:59.145905+0000","last_clean":"2024-08-18T23:56:59.145905+0000","last_became_active":"2024-08-18T23:56:57.796223+0000","last_became_peered":"2024-08-18T23:56:57.796223+0000","last_unstale":"2024-08-18T23:56:59.145905+0000","last_undegraded":"2024-08-18T23:56:59.145905+0000","last_fullsized":"2024-08-18T23:56:59.145905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146813+0000","last_change":"2024-08-18T23:56:53.766948+0000","last_active":"2024-08-18T23:56:59.146813+0000","last_peered":"2024-08-18T23:56:59.146813+0000","last_clean":"2024-08-18T23:56:59.146813+0000","last_became_active":"2024-08-18T23:56:53.766437+0000","last_became_peered":"2024-08-18T23:56:53.766437+0000","last_unstale":"2024-08-18T23:56:59.146813+0000","last_undegraded":"2024-08-18T23:56:59.146813+0000","last_fullsized":"2024-08-18T23:56:59.146813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:12.823198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145614+0000","last_change":"2024-08-18T23:56:52.752268+0000","last_active":"2024-08-18T23:56:59.145614+0000","last_peered":"2024-08-18T23:56:59.145614+0000","last_clean":"2024-08-18T23:56:59.145614+0000","last_became_active":"2024-08-18T23:56:52.751988+0000","last_became_peered":"2024-08-18T23:56:52.751988+0000","last_unstale":"2024-08-18T23:56:59.145614+0000","last_undegraded":"2024-08-18T23:56:59.145614+0000","last_fullsized":"2024-08-18T23:56:59.145614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146117+0000","last_change":"2024-08-18T23:56:57.795578+0000","last_active":"2024-08-18T23:56:59.146117+0000","last_peered":"2024-08-18T23:56:59.146117+0000","last_clean":"2024-08-18T23:56:59.146117+0000","last_became_active":"2024-08-18T23:56:57.795182+0000","last_became_peered":"2024-08-18T23:56:57.795182+0000","last_unstale":"2024-08-18T23:56:59.146117+0000","last_undegraded":"2024-08-18T23:56:59.146117+0000","last_fullsized":"2024-08-18T23:56:59.146117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:28.122472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796078+0000","last_change":"2024-08-18T23:56:53.773616+0000","last_active":"2024-08-18T23:56:58.796078+0000","last_peered":"2024-08-18T23:56:58.796078+0000","last_clean":"2024-08-18T23:56:58.796078+0000","last_became_active":"2024-08-18T23:56:53.773129+0000","last_became_peered":"2024-08-18T23:56:53.773129+0000","last_unstale":"2024-08-18T23:56:58.796078+0000","last_undegraded":"2024-08-18T23:56:58.796078+0000","last_fullsized":"2024-08-18T23:56:58.796078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146443+0000","last_change":"2024-08-18T23:56:52.744917+0000","last_active":"2024-08-18T23:56:59.146443+0000","last_peered":"2024-08-18T23:56:59.146443+0000","last_clean":"2024-08-18T23:56:59.146443+0000","last_became_active":"2024-08-18T23:56:52.744638+0000","last_became_peered":"2024-08-18T23:56:52.744638+0000","last_unstale":"2024-08-18T23:56:59.146443+0000","last_undegraded":"2024-08-18T23:56:59.146443+0000","last_fullsized":"2024-08-18T23:56:59.146443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144951+0000","last_change":"2024-08-18T23:56:57.794782+0000","last_active":"2024-08-18T23:56:59.144951+0000","last_peered":"2024-08-18T23:56:59.144951+0000","last_clean":"2024-08-18T23:56:59.144951+0000","last_became_active":"2024-08-18T23:56:57.794392+0000","last_became_peered":"2024-08-18T23:56:57.794392+0000","last_unstale":"2024-08-18T23:56:59.144951+0000","last_undegraded":"2024-08-18T23:56:59.144951+0000","last_fullsized":"2024-08-18T23:56:59.144951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:47.357886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146347+0000","last_change":"2024-08-18T23:56:53.774590+0000","last_active":"2024-08-18T23:56:59.146347+0000","last_peered":"2024-08-18T23:56:59.146347+0000","last_clean":"2024-08-18T23:56:59.146347+0000","last_became_active":"2024-08-18T23:56:53.774302+0000","last_became_peered":"2024-08-18T23:56:53.774302+0000","last_unstale":"2024-08-18T23:56:59.146347+0000","last_undegraded":"2024-08-18T23:56:59.146347+0000","last_fullsized":"2024-08-18T23:56:59.146347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793992+0000","last_change":"2024-08-18T23:56:52.750383+0000","last_active":"2024-08-18T23:56:58.793992+0000","last_peered":"2024-08-18T23:56:58.793992+0000","last_clean":"2024-08-18T23:56:58.793992+0000","last_became_active":"2024-08-18T23:56:52.750095+0000","last_became_peered":"2024-08-18T23:56:52.750095+0000","last_unstale":"2024-08-18T23:56:58.793992+0000","last_undegraded":"2024-08-18T23:56:58.793992+0000","last_fullsized":"2024-08-18T23:56:58.793992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144880+0000","last_change":"2024-08-18T23:56:57.982444+0000","last_active":"2024-08-18T23:56:59.144880+0000","last_peered":"2024-08-18T23:56:59.144880+0000","last_clean":"2024-08-18T23:56:59.144880+0000","last_became_active":"2024-08-18T23:56:57.982080+0000","last_became_peered":"2024-08-18T23:56:57.982080+0000","last_unstale":"2024-08-18T23:56:59.144880+0000","last_undegraded":"2024-08-18T23:56:59.144880+0000","last_fullsized":"2024-08-18T23:56:59.144880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:46:30.528419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795672+0000","last_change":"2024-08-18T23:56:57.984231+0000","last_active":"2024-08-18T23:56:58.795672+0000","last_peered":"2024-08-18T23:56:58.795672+0000","last_clean":"2024-08-18T23:56:58.795672+0000","last_became_active":"2024-08-18T23:56:57.983816+0000","last_became_peered":"2024-08-18T23:56:57.983816+0000","last_unstale":"2024-08-18T23:56:58.795672+0000","last_undegraded":"2024-08-18T23:56:58.795672+0000","last_fullsized":"2024-08-18T23:56:58.795672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145512+0000","last_change":"2024-08-18T23:56:53.765456+0000","last_active":"2024-08-18T23:56:59.145512+0000","last_peered":"2024-08-18T23:56:59.145512+0000","last_clean":"2024-08-18T23:56:59.145512+0000","last_became_active":"2024-08-18T23:56:53.765209+0000","last_became_peered":"2024-08-18T23:56:53.765209+0000","last_unstale":"2024-08-18T23:56:59.145512+0000","last_undegraded":"2024-08-18T23:56:59.145512+0000","last_fullsized":"2024-08-18T23:56:59.145512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145778+0000","last_change":"2024-08-18T23:56:52.746017+0000","last_active":"2024-08-18T23:56:59.145778+0000","last_peered":"2024-08-18T23:56:59.145778+0000","last_clean":"2024-08-18T23:56:59.145778+0000","last_became_active":"2024-08-18T23:56:52.745758+0000","last_became_peered":"2024-08-18T23:56:52.745758+0000","last_unstale":"2024-08-18T23:56:59.145778+0000","last_undegraded":"2024-08-18T23:56:59.145778+0000","last_fullsized":"2024-08-18T23:56:59.145778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794035+0000","last_change":"2024-08-18T23:56:57.797625+0000","last_active":"2024-08-18T23:56:58.794035+0000","last_peered":"2024-08-18T23:56:58.794035+0000","last_clean":"2024-08-18T23:56:58.794035+0000","last_became_active":"2024-08-18T23:56:57.797212+0000","last_became_peered":"2024-08-18T23:56:57.797212+0000","last_unstale":"2024-08-18T23:56:58.794035+0000","last_undegraded":"2024-08-18T23:56:58.794035+0000","last_fullsized":"2024-08-18T23:56:58.794035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145996+0000","last_change":"2024-08-18T23:56:53.770813+0000","last_active":"2024-08-18T23:56:59.145996+0000","last_peered":"2024-08-18T23:56:59.145996+0000","last_clean":"2024-08-18T23:56:59.145996+0000","last_became_active":"2024-08-18T23:56:53.770418+0000","last_became_peered":"2024-08-18T23:56:53.770418+0000","last_unstale":"2024-08-18T23:56:59.145996+0000","last_undegraded":"2024-08-18T23:56:59.145996+0000","last_fullsized":"2024-08-18T23:56:59.145996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145393+0000","last_change":"2024-08-18T23:56:52.749549+0000","last_active":"2024-08-18T23:56:59.145393+0000","last_peered":"2024-08-18T23:56:59.145393+0000","last_clean":"2024-08-18T23:56:59.145393+0000","last_became_active":"2024-08-18T23:56:52.749241+0000","last_became_peered":"2024-08-18T23:56:52.749241+0000","last_unstale":"2024-08-18T23:56:59.145393+0000","last_undegraded":"2024-08-18T23:56:59.145393+0000","last_fullsized":"2024-08-18T23:56:59.145393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:10:48.081149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793835+0000","last_change":"2024-08-18T23:56:52.748476+0000","last_active":"2024-08-18T23:56:58.793835+0000","last_peered":"2024-08-18T23:56:58.793835+0000","last_clean":"2024-08-18T23:56:58.793835+0000","last_became_active":"2024-08-18T23:56:52.748086+0000","last_became_peered":"2024-08-18T23:56:52.748086+0000","last_unstale":"2024-08-18T23:56:58.793835+0000","last_undegraded":"2024-08-18T23:56:58.793835+0000","last_fullsized":"2024-08-18T23:56:58.793835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796022+0000","last_change":"2024-08-18T23:56:53.769482+0000","last_active":"2024-08-18T23:56:58.796022+0000","last_peered":"2024-08-18T23:56:58.796022+0000","last_clean":"2024-08-18T23:56:58.796022+0000","last_became_active":"2024-08-18T23:56:53.769011+0000","last_became_peered":"2024-08-18T23:56:53.769011+0000","last_unstale":"2024-08-18T23:56:58.796022+0000","last_undegraded":"2024-08-18T23:56:58.796022+0000","last_fullsized":"2024-08-18T23:56:58.796022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794765+0000","last_change":"2024-08-18T23:56:57.794273+0000","last_active":"2024-08-18T23:56:58.794765+0000","last_peered":"2024-08-18T23:56:58.794765+0000","last_clean":"2024-08-18T23:56:58.794765+0000","last_became_active":"2024-08-18T23:56:57.793881+0000","last_became_peered":"2024-08-18T23:56:57.793881+0000","last_unstale":"2024-08-18T23:56:58.794765+0000","last_undegraded":"2024-08-18T23:56:58.794765+0000","last_fullsized":"2024-08-18T23:56:58.794765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:35.231599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145044+0000","last_change":"2024-08-18T23:56:52.758361+0000","last_active":"2024-08-18T23:56:59.145044+0000","last_peered":"2024-08-18T23:56:59.145044+0000","last_clean":"2024-08-18T23:56:59.145044+0000","last_became_active":"2024-08-18T23:56:52.758061+0000","last_became_peered":"2024-08-18T23:56:52.758061+0000","last_unstale":"2024-08-18T23:56:59.145044+0000","last_undegraded":"2024-08-18T23:56:59.145044+0000","last_fullsized":"2024-08-18T23:56:59.145044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:31.503425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145753+0000","last_change":"2024-08-18T23:56:53.772935+0000","last_active":"2024-08-18T23:56:59.145753+0000","last_peered":"2024-08-18T23:56:59.145753+0000","last_clean":"2024-08-18T23:56:59.145753+0000","last_became_active":"2024-08-18T23:56:53.772663+0000","last_became_peered":"2024-08-18T23:56:53.772663+0000","last_unstale":"2024-08-18T23:56:59.145753+0000","last_undegraded":"2024-08-18T23:56:59.145753+0000","last_fullsized":"2024-08-18T23:56:59.145753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:17.271839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145518+0000","last_change":"2024-08-18T23:56:57.796804+0000","last_active":"2024-08-18T23:56:59.145518+0000","last_peered":"2024-08-18T23:56:59.145518+0000","last_clean":"2024-08-18T23:56:59.145518+0000","last_became_active":"2024-08-18T23:56:57.796403+0000","last_became_peered":"2024-08-18T23:56:57.796403+0000","last_unstale":"2024-08-18T23:56:59.145518+0000","last_undegraded":"2024-08-18T23:56:59.145518+0000","last_fullsized":"2024-08-18T23:56:59.145518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:52.440154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793982+0000","last_change":"2024-08-18T23:56:53.762460+0000","last_active":"2024-08-18T23:56:58.793982+0000","last_peered":"2024-08-18T23:56:58.793982+0000","last_clean":"2024-08-18T23:56:58.793982+0000","last_became_active":"2024-08-18T23:56:53.762178+0000","last_became_peered":"2024-08-18T23:56:53.762178+0000","last_unstale":"2024-08-18T23:56:58.793982+0000","last_undegraded":"2024-08-18T23:56:58.793982+0000","last_fullsized":"2024-08-18T23:56:58.793982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794237+0000","last_change":"2024-08-18T23:56:53.764382+0000","last_active":"2024-08-18T23:56:58.794237+0000","last_peered":"2024-08-18T23:56:58.794237+0000","last_clean":"2024-08-18T23:56:58.794237+0000","last_became_active":"2024-08-18T23:56:53.764101+0000","last_became_peered":"2024-08-18T23:56:53.764101+0000","last_unstale":"2024-08-18T23:56:58.794237+0000","last_undegraded":"2024-08-18T23:56:58.794237+0000","last_fullsized":"2024-08-18T23:56:58.794237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:55.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147476+0000","last_change":"2024-08-18T23:56:53.775607+0000","last_active":"2024-08-18T23:56:59.147476+0000","last_peered":"2024-08-18T23:56:59.147476+0000","last_clean":"2024-08-18T23:56:59.147476+0000","last_became_active":"2024-08-18T23:56:53.775349+0000","last_became_peered":"2024-08-18T23:56:53.775349+0000","last_unstale":"2024-08-18T23:56:59.147476+0000","last_undegraded":"2024-08-18T23:56:59.147476+0000","last_fullsized":"2024-08-18T23:56:59.147476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:49.498231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795886+0000","last_change":"2024-08-18T23:56:53.767511+0000","last_active":"2024-08-18T23:56:58.795886+0000","last_peered":"2024-08-18T23:56:58.795886+0000","last_clean":"2024-08-18T23:56:58.795886+0000","last_became_active":"2024-08-18T23:56:53.762845+0000","last_became_peered":"2024-08-18T23:56:53.762845+0000","last_unstale":"2024-08-18T23:56:58.795886+0000","last_undegraded":"2024-08-18T23:56:58.795886+0000","last_fullsized":"2024-08-18T23:56:58.795886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145268+0000","last_change":"2024-08-18T23:56:53.764036+0000","last_active":"2024-08-18T23:56:59.145268+0000","last_peered":"2024-08-18T23:56:59.145268+0000","last_clean":"2024-08-18T23:56:59.145268+0000","last_became_active":"2024-08-18T23:56:53.763734+0000","last_became_peered":"2024-08-18T23:56:53.763734+0000","last_unstale":"2024-08-18T23:56:59.145268+0000","last_undegraded":"2024-08-18T23:56:59.145268+0000","last_fullsized":"2024-08-18T23:56:59.145268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:24.083795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145438+0000","last_change":"2024-08-18T23:56:53.766271+0000","last_active":"2024-08-18T23:56:59.145438+0000","last_peered":"2024-08-18T23:56:59.145438+0000","last_clean":"2024-08-18T23:56:59.145438+0000","last_became_active":"2024-08-18T23:56:53.766022+0000","last_became_peered":"2024-08-18T23:56:53.766022+0000","last_unstale":"2024-08-18T23:56:59.145438+0000","last_undegraded":"2024-08-18T23:56:59.145438+0000","last_fullsized":"2024-08-18T23:56:59.145438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794419+0000","last_change":"2024-08-18T23:56:53.759600+0000","last_active":"2024-08-18T23:56:58.794419+0000","last_peered":"2024-08-18T23:56:58.794419+0000","last_clean":"2024-08-18T23:56:58.794419+0000","last_became_active":"2024-08-18T23:56:53.759294+0000","last_became_peered":"2024-08-18T23:56:53.759294+0000","last_unstale":"2024-08-18T23:56:58.794419+0000","last_undegraded":"2024-08-18T23:56:58.794419+0000","last_fullsized":"2024-08-18T23:56:58.794419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145362+0000","last_change":"2024-08-18T23:56:53.764119+0000","last_active":"2024-08-18T23:56:59.145362+0000","last_peered":"2024-08-18T23:56:59.145362+0000","last_clean":"2024-08-18T23:56:59.145362+0000","last_became_active":"2024-08-18T23:56:53.763804+0000","last_became_peered":"2024-08-18T23:56:53.763804+0000","last_unstale":"2024-08-18T23:56:59.145362+0000","last_undegraded":"2024-08-18T23:56:59.145362+0000","last_fullsized":"2024-08-18T23:56:59.145362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:49.498231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145653+0000","last_change":"2024-08-18T23:56:53.770463+0000","last_active":"2024-08-18T23:56:59.145653+0000","last_peered":"2024-08-18T23:56:59.145653+0000","last_clean":"2024-08-18T23:56:59.145653+0000","last_became_active":"2024-08-18T23:56:53.768044+0000","last_became_peered":"2024-08-18T23:56:53.768044+0000","last_unstale":"2024-08-18T23:56:59.145653+0000","last_undegraded":"2024-08-18T23:56:59.145653+0000","last_fullsized":"2024-08-18T23:56:59.145653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145134+0000","last_change":"2024-08-18T23:56:53.764055+0000","last_active":"2024-08-18T23:56:59.145134+0000","last_peered":"2024-08-18T23:56:59.145134+0000","last_clean":"2024-08-18T23:56:59.145134+0000","last_became_active":"2024-08-18T23:56:53.763760+0000","last_became_peered":"2024-08-18T23:56:53.763760+0000","last_unstale":"2024-08-18T23:56:59.145134+0000","last_undegraded":"2024-08-18T23:56:59.145134+0000","last_fullsized":"2024-08-18T23:56:59.145134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147400+0000","last_change":"2024-08-18T23:56:53.769367+0000","last_active":"2024-08-18T23:56:59.147400+0000","last_peered":"2024-08-18T23:56:59.147400+0000","last_clean":"2024-08-18T23:56:59.147400+0000","last_became_active":"2024-08-18T23:56:53.767443+0000","last_became_peered":"2024-08-18T23:56:53.767443+0000","last_unstale":"2024-08-18T23:56:59.147400+0000","last_undegraded":"2024-08-18T23:56:59.147400+0000","last_fullsized":"2024-08-18T23:56:59.147400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:24.083795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795708+0000","last_change":"2024-08-18T23:56:53.762405+0000","last_active":"2024-08-18T23:56:58.795708+0000","last_peered":"2024-08-18T23:56:58.795708+0000","last_clean":"2024-08-18T23:56:58.795708+0000","last_became_active":"2024-08-18T23:56:53.761768+0000","last_became_peered":"2024-08-18T23:56:53.761768+0000","last_unstale":"2024-08-18T23:56:58.795708+0000","last_undegraded":"2024-08-18T23:56:58.795708+0000","last_fullsized":"2024-08-18T23:56:58.795708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793905+0000","last_change":"2024-08-18T23:56:53.766982+0000","last_active":"2024-08-18T23:56:58.793905+0000","last_peered":"2024-08-18T23:56:58.793905+0000","last_clean":"2024-08-18T23:56:58.793905+0000","last_became_active":"2024-08-18T23:56:53.766519+0000","last_became_peered":"2024-08-18T23:56:53.766519+0000","last_unstale":"2024-08-18T23:56:58.793905+0000","last_undegraded":"2024-08-18T23:56:58.793905+0000","last_fullsized":"2024-08-18T23:56:58.793905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147183+0000","last_change":"2024-08-18T23:56:53.763491+0000","last_active":"2024-08-18T23:56:59.147183+0000","last_peered":"2024-08-18T23:56:59.147183+0000","last_clean":"2024-08-18T23:56:59.147183+0000","last_became_active":"2024-08-18T23:56:53.763123+0000","last_became_peered":"2024-08-18T23:56:53.763123+0000","last_unstale":"2024-08-18T23:56:59.147183+0000","last_undegraded":"2024-08-18T23:56:59.147183+0000","last_fullsized":"2024-08-18T23:56:59.147183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:48:21.747365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794368+0000","last_change":"2024-08-18T23:56:53.756577+0000","last_active":"2024-08-18T23:56:58.794368+0000","last_peered":"2024-08-18T23:56:58.794368+0000","last_clean":"2024-08-18T23:56:58.794368+0000","last_became_active":"2024-08-18T23:56:53.755872+0000","last_became_peered":"2024-08-18T23:56:53.755872+0000","last_unstale":"2024-08-18T23:56:58.794368+0000","last_undegraded":"2024-08-18T23:56:58.794368+0000","last_fullsized":"2024-08-18T23:56:58.794368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:12.823198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146986+0000","last_change":"2024-08-18T23:56:53.775155+0000","last_active":"2024-08-18T23:56:59.146986+0000","last_peered":"2024-08-18T23:56:59.146986+0000","last_clean":"2024-08-18T23:56:59.146986+0000","last_became_active":"2024-08-18T23:56:53.774332+0000","last_became_peered":"2024-08-18T23:56:53.774332+0000","last_unstale":"2024-08-18T23:56:59.146986+0000","last_undegraded":"2024-08-18T23:56:59.146986+0000","last_fullsized":"2024-08-18T23:56:59.146986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:57.104014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145651+0000","last_change":"2024-08-18T23:56:53.777136+0000","last_active":"2024-08-18T23:56:59.145651+0000","last_peered":"2024-08-18T23:56:59.145651+0000","last_clean":"2024-08-18T23:56:59.145651+0000","last_became_active":"2024-08-18T23:56:53.776851+0000","last_became_peered":"2024-08-18T23:56:53.776851+0000","last_unstale":"2024-08-18T23:56:59.145651+0000","last_undegraded":"2024-08-18T23:56:59.145651+0000","last_fullsized":"2024-08-18T23:56:59.145651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145548+0000","last_change":"2024-08-18T23:56:53.772745+0000","last_active":"2024-08-18T23:56:59.145548+0000","last_peered":"2024-08-18T23:56:59.145548+0000","last_clean":"2024-08-18T23:56:59.145548+0000","last_became_active":"2024-08-18T23:56:53.772455+0000","last_became_peered":"2024-08-18T23:56:53.772455+0000","last_unstale":"2024-08-18T23:56:59.145548+0000","last_undegraded":"2024-08-18T23:56:59.145548+0000","last_fullsized":"2024-08-18T23:56:59.145548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795596+0000","last_change":"2024-08-18T23:56:53.768901+0000","last_active":"2024-08-18T23:56:58.795596+0000","last_peered":"2024-08-18T23:56:58.795596+0000","last_clean":"2024-08-18T23:56:58.795596+0000","last_became_active":"2024-08-18T23:56:53.767949+0000","last_became_peered":"2024-08-18T23:56:53.767949+0000","last_unstale":"2024-08-18T23:56:58.795596+0000","last_undegraded":"2024-08-18T23:56:58.795596+0000","last_fullsized":"2024-08-18T23:56:58.795596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:57.813404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144928+0000","last_change":"2024-08-18T23:56:53.757368+0000","last_active":"2024-08-18T23:56:59.144928+0000","last_peered":"2024-08-18T23:56:59.144928+0000","last_clean":"2024-08-18T23:56:59.144928+0000","last_became_active":"2024-08-18T23:56:53.756898+0000","last_became_peered":"2024-08-18T23:56:53.756898+0000","last_unstale":"2024-08-18T23:56:59.144928+0000","last_undegraded":"2024-08-18T23:56:59.144928+0000","last_fullsized":"2024-08-18T23:56:59.144928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:59.039252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146741+0000","last_change":"2024-08-18T23:56:53.765280+0000","last_active":"2024-08-18T23:56:59.146741+0000","last_peered":"2024-08-18T23:56:59.146741+0000","last_clean":"2024-08-18T23:56:59.146741+0000","last_became_active":"2024-08-18T23:56:53.763756+0000","last_became_peered":"2024-08-18T23:56:53.763756+0000","last_unstale":"2024-08-18T23:56:59.146741+0000","last_undegraded":"2024-08-18T23:56:59.146741+0000","last_fullsized":"2024-08-18T23:56:59.146741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:55.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794162+0000","last_change":"2024-08-18T23:56:53.772201+0000","last_active":"2024-08-18T23:56:58.794162+0000","last_peered":"2024-08-18T23:56:58.794162+0000","last_clean":"2024-08-18T23:56:58.794162+0000","last_became_active":"2024-08-18T23:56:53.770656+0000","last_became_peered":"2024-08-18T23:56:53.770656+0000","last_unstale":"2024-08-18T23:56:58.794162+0000","last_undegraded":"2024-08-18T23:56:58.794162+0000","last_fullsized":"2024-08-18T23:56:58.794162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794351+0000","last_change":"2024-08-18T23:56:53.772162+0000","last_active":"2024-08-18T23:56:58.794351+0000","last_peered":"2024-08-18T23:56:58.794351+0000","last_clean":"2024-08-18T23:56:58.794351+0000","last_became_active":"2024-08-18T23:56:53.771265+0000","last_became_peered":"2024-08-18T23:56:53.771265+0000","last_unstale":"2024-08-18T23:56:58.794351+0000","last_undegraded":"2024-08-18T23:56:58.794351+0000","last_fullsized":"2024-08-18T23:56:58.794351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146824+0000","last_change":"2024-08-18T23:56:53.772410+0000","last_active":"2024-08-18T23:56:59.146824+0000","last_peered":"2024-08-18T23:56:59.146824+0000","last_clean":"2024-08-18T23:56:59.146824+0000","last_became_active":"2024-08-18T23:56:53.771633+0000","last_became_peered":"2024-08-18T23:56:53.771633+0000","last_unstale":"2024-08-18T23:56:59.146824+0000","last_undegraded":"2024-08-18T23:56:59.146824+0000","last_fullsized":"2024-08-18T23:56:59.146824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:41.319632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144814+0000","last_change":"2024-08-18T23:56:53.766249+0000","last_active":"2024-08-18T23:56:59.144814+0000","last_peered":"2024-08-18T23:56:59.144814+0000","last_clean":"2024-08-18T23:56:59.144814+0000","last_became_active":"2024-08-18T23:56:53.765940+0000","last_became_peered":"2024-08-18T23:56:53.765940+0000","last_unstale":"2024-08-18T23:56:59.144814+0000","last_undegraded":"2024-08-18T23:56:59.144814+0000","last_fullsized":"2024-08-18T23:56:59.144814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146148+0000","last_change":"2024-08-18T23:56:53.766607+0000","last_active":"2024-08-18T23:56:59.146148+0000","last_peered":"2024-08-18T23:56:59.146148+0000","last_clean":"2024-08-18T23:56:59.146148+0000","last_became_active":"2024-08-18T23:56:53.766145+0000","last_became_peered":"2024-08-18T23:56:53.766145+0000","last_unstale":"2024-08-18T23:56:59.146148+0000","last_undegraded":"2024-08-18T23:56:59.146148+0000","last_fullsized":"2024-08-18T23:56:59.146148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147356+0000","last_change":"2024-08-18T23:56:53.770217+0000","last_active":"2024-08-18T23:56:59.147356+0000","last_peered":"2024-08-18T23:56:59.147356+0000","last_clean":"2024-08-18T23:56:59.147356+0000","last_became_active":"2024-08-18T23:56:53.769943+0000","last_became_peered":"2024-08-18T23:56:53.769943+0000","last_unstale":"2024-08-18T23:56:59.147356+0000","last_undegraded":"2024-08-18T23:56:59.147356+0000","last_fullsized":"2024-08-18T23:56:59.147356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:22.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146889+0000","last_change":"2024-08-18T23:56:53.763822+0000","last_active":"2024-08-18T23:56:59.146889+0000","last_peered":"2024-08-18T23:56:59.146889+0000","last_clean":"2024-08-18T23:56:59.146889+0000","last_became_active":"2024-08-18T23:56:53.762359+0000","last_became_peered":"2024-08-18T23:56:53.762359+0000","last_unstale":"2024-08-18T23:56:59.146889+0000","last_undegraded":"2024-08-18T23:56:59.146889+0000","last_fullsized":"2024-08-18T23:56:59.146889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:38.459488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147339+0000","last_change":"2024-08-18T23:56:53.775297+0000","last_active":"2024-08-18T23:56:59.147339+0000","last_peered":"2024-08-18T23:56:59.147339+0000","last_clean":"2024-08-18T23:56:59.147339+0000","last_became_active":"2024-08-18T23:56:53.774803+0000","last_became_peered":"2024-08-18T23:56:53.774803+0000","last_unstale":"2024-08-18T23:56:59.147339+0000","last_undegraded":"2024-08-18T23:56:59.147339+0000","last_fullsized":"2024-08-18T23:56:59.147339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:59.039252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795630+0000","last_change":"2024-08-18T23:56:53.761493+0000","last_active":"2024-08-18T23:56:58.795630+0000","last_peered":"2024-08-18T23:56:58.795630+0000","last_clean":"2024-08-18T23:56:58.795630+0000","last_became_active":"2024-08-18T23:56:53.760939+0000","last_became_peered":"2024-08-18T23:56:53.760939+0000","last_unstale":"2024-08-18T23:56:58.795630+0000","last_undegraded":"2024-08-18T23:56:58.795630+0000","last_fullsized":"2024-08-18T23:56:58.795630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145825+0000","last_change":"2024-08-18T23:56:53.763839+0000","last_active":"2024-08-18T23:56:59.145825+0000","last_peered":"2024-08-18T23:56:59.145825+0000","last_clean":"2024-08-18T23:56:59.145825+0000","last_became_active":"2024-08-18T23:56:53.763462+0000","last_became_peered":"2024-08-18T23:56:53.763462+0000","last_unstale":"2024-08-18T23:56:59.145825+0000","last_undegraded":"2024-08-18T23:56:59.145825+0000","last_fullsized":"2024-08-18T23:56:59.145825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146738+0000","last_change":"2024-08-18T23:56:53.769068+0000","last_active":"2024-08-18T23:56:59.146738+0000","last_peered":"2024-08-18T23:56:59.146738+0000","last_clean":"2024-08-18T23:56:59.146738+0000","last_became_active":"2024-08-18T23:56:53.767605+0000","last_became_peered":"2024-08-18T23:56:53.767605+0000","last_unstale":"2024-08-18T23:56:59.146738+0000","last_undegraded":"2024-08-18T23:56:59.146738+0000","last_fullsized":"2024-08-18T23:56:59.146738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:30.270890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:18.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:18.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.213+0000 7f7f356e6640 1 Processor -- start 2024-08-18T23:57:18.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.213+0000 7f7f356e6640 1 -- start start 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f356e6640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f3015e350 0x7f7f300d47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f356e6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7f300d2d80 0x7f7f300b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f356e6640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3015e730 con 0x7f7f300d1d10 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f356e6640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f7f300cef80 con 0x7f7f3015e350 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f356e6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7f300cf260 con 0x7f7f300d2d80 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f2effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f3015e350 0x7f7f300d47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f267fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f7f300d1d10 0x7f7f300d2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56584/0 (socket says 172.21.15.103:56584) 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f2effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7f3015e350 0x7f7f300d47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38636/0 (socket says 172.21.15.103:38636) 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f267fc640 1 -- 172.21.15.103:0/1518133891 learned_addr learned my addr 172.21.15.103:0/1518133891 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.214+0000 7f7f2f7fe640 1 --2- 172.21.15.103:0/1518133891 >> v2:172.21.15.190:3300/0 conn(0x7f7f300d2d80 0x7f7f300b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2effd640 1 -- 172.21.15.103:0/1518133891 >> v2:172.21.15.190:3300/0 conn(0x7f7f300d2d80 msgr2=0x7f7f300b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2effd640 1 --2- 172.21.15.103:0/1518133891 >> v2:172.21.15.190:3300/0 conn(0x7f7f300d2d80 0x7f7f300b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2effd640 1 -- 172.21.15.103:0/1518133891 >> v1:172.21.15.103:6789/0 conn(0x7f7f300d1d10 legacy=0x7f7f300d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2effd640 1 -- 172.21.15.103:0/1518133891 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f300cf540 con 0x7f7f3015e350 2024-08-18T23:57:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2e7fc640 1 -- 172.21.15.103:0/1518133891 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1404908999 0 0) 0x7f7f3015e730 con 0x7f7f300d1d10 2024-08-18T23:57:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2f7fe640 1 --2- 172.21.15.103:0/1518133891 >> v2:172.21.15.190:3300/0 conn(0x7f7f300d2d80 0x7f7f300b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2effd640 1 --2- 172.21.15.103:0/1518133891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300d47c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7f300ce690 tx=0x7f7f2002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f0577e1e3f1d9a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2e7fc640 1 -- 172.21.15.103:0/1518133891 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20037070 con 0x7f7f3015e350 2024-08-18T23:57:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2e7fc640 1 -- 172.21.15.103:0/1518133891 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f20032440 con 0x7f7f3015e350 2024-08-18T23:57:18.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.215+0000 7f7f2e7fc640 1 -- 172.21.15.103:0/1518133891 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20032810 con 0x7f7f3015e350 2024-08-18T23:57:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.216+0000 7f7f356e6640 1 -- 172.21.15.103:0/1518133891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 msgr2=0x7f7f300d47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.216+0000 7f7f356e6640 1 --2- 172.21.15.103:0/1518133891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300d47c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7f300ce690 tx=0x7f7f2002a1a0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.216+0000 7f7f356e6640 1 -- 172.21.15.103:0/1518133891 shutdown_connections 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.216+0000 7f7f356e6640 1 --2- 172.21.15.103:0/1518133891 >> v2:172.21.15.190:3300/0 conn(0x7f7f300d2d80 0x7f7f300b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.216+0000 7f7f356e6640 1 --2- 172.21.15.103:0/1518133891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300d47c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.216+0000 7f7f356e6640 1 -- 172.21.15.103:0/1518133891 >> 172.21.15.103:0/1518133891 conn(0x7f7f3009d3f0 msgr2=0x7f7f300d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.216+0000 7f7f356e6640 1 -- 172.21.15.103:0/1518133891 shutdown_connections 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.216+0000 7f7f356e6640 1 -- 172.21.15.103:0/1518133891 wait complete. 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.217+0000 7f7f356e6640 1 Processor -- start 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.217+0000 7f7f356e6640 1 -- start start 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f356e6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f300d1d10 0x7f7f3014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f356e6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f300d2d80 0x7f7f300b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f356e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f356e6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f300d4d00 con 0x7f7f3015e350 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f356e6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7f300cec30 con 0x7f7f300d2d80 2024-08-18T23:57:18.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f356e6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7f300d4e80 con 0x7f7f300d1d10 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38646/0 (socket says 172.21.15.103:38646) 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2f7fe640 1 -- 172.21.15.103:0/618907439 learned_addr learned my addr 172.21.15.103:0/618907439 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2effd640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f300d1d10 0x7f7f3014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2f7fe640 1 -- 172.21.15.103:0/618907439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f300d1d10 msgr2=0x7f7f3014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2f7fe640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f300d1d10 0x7f7f3014f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2f7fe640 1 -- 172.21.15.103:0/618907439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f300d2d80 msgr2=0x7f7f300b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2f7fe640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f300d2d80 0x7f7f300b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.218+0000 7f7f2f7fe640 1 -- 172.21.15.103:0/618907439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3014fab0 con 0x7f7f3015e350 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.219+0000 7f7f2f7fe640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300c82b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800cd80 tx=0x7f7f2800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.219+0000 7f7f27fff640 1 -- 172.21.15.103:0/618907439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28003b90 con 0x7f7f3015e350 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.219+0000 7f7f27fff640 1 -- 172.21.15.103:0/618907439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f28003d50 con 0x7f7f3015e350 2024-08-18T23:57:18.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.219+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f300b37b0 con 0x7f7f3015e350 2024-08-18T23:57:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.219+0000 7f7f27fff640 1 -- 172.21.15.103:0/618907439 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28004260 con 0x7f7f3015e350 2024-08-18T23:57:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.219+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f300b3d70 con 0x7f7f3015e350 2024-08-18T23:57:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.220+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f300cfd40 con 0x7f7f3015e350 2024-08-18T23:57:18.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.220+0000 7f7f27fff640 1 -- 172.21.15.103:0/618907439 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f28004400 con 0x7f7f3015e350 2024-08-18T23:57:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.221+0000 7f7f27fff640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7f1006be30 0x7f7f1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.221+0000 7f7f27fff640 1 -- 172.21.15.103:0/618907439 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7f2808bc50 con 0x7f7f3015e350 2024-08-18T23:57:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.221+0000 7f7f2effd640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7f1006be30 0x7f7f1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.221+0000 7f7f2effd640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7f1006be30 0x7f7f1006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7f20034000 tx=0x7f7f2002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.225+0000 7f7f27fff640 1 -- 172.21.15.103:0/618907439 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7f28091020 con 0x7f7f3015e350 2024-08-18T23:57:18.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.390+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f300d1660 con 0x7f7f1006be30 2024-08-18T23:57:18.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.397+0000 7f7f27fff640 1 -- 172.21.15.103:0/618907439 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f7f300d1660 con 0x7f7f1006be30 2024-08-18T23:57:18.402 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:18.404 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7f1006be30 msgr2=0x7f7f1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7f1006be30 0x7f7f1006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7f20034000 tx=0x7f7f2002e000 comp rx=0 tx=0).stop 2024-08-18T23:57:18.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 msgr2=0x7f7f300c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300c82b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7f2800cd80 tx=0x7f7f2800a650 comp rx=0 tx=0).stop 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 shutdown_connections 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7f1006be30 0x7f7f1006e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f3015e350 0x7f7f300c82b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f300d2d80 0x7f7f300b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 --2- 172.21.15.103:0/618907439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f300d1d10 0x7f7f3014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 >> 172.21.15.103:0/618907439 conn(0x7f7f3009d3f0 msgr2=0x7f7f300b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 shutdown_connections 2024-08-18T23:57:18.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.401+0000 7f7f356e6640 1 -- 172.21.15.103:0/618907439 wait complete. 2024-08-18T23:57:18.413 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-08-18T23:57:18.169685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219400,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755320,"statfs":{"total":773094113280,"available":772869447680,"internally_reserved":0,"allocated":3284992,"data_stored":1992062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003048"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796132+0000","last_change":"2024-08-18T23:56:52.756091+0000","last_active":"2024-08-18T23:56:58.796132+0000","last_peered":"2024-08-18T23:56:58.796132+0000","last_clean":"2024-08-18T23:56:58.796132+0000","last_became_active":"2024-08-18T23:56:52.755823+0000","last_became_peered":"2024-08-18T23:56:52.755823+0000","last_unstale":"2024-08-18T23:56:58.796132+0000","last_undegraded":"2024-08-18T23:56:58.796132+0000","last_fullsized":"2024-08-18T23:56:58.796132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:10:48.081149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145741+0000","last_change":"2024-08-18T23:56:53.755660+0000","last_active":"2024-08-18T23:56:59.145741+0000","last_peered":"2024-08-18T23:56:59.145741+0000","last_clean":"2024-08-18T23:56:59.145741+0000","last_became_active":"2024-08-18T23:56:53.755395+0000","last_became_peered":"2024-08-18T23:56:53.755395+0000","last_unstale":"2024-08-18T23:56:59.145741+0000","last_undegraded":"2024-08-18T23:56:59.145741+0000","last_fullsized":"2024-08-18T23:56:59.145741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:24.430755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144804+0000","last_change":"2024-08-18T23:56:57.985729+0000","last_active":"2024-08-18T23:56:59.144804+0000","last_peered":"2024-08-18T23:56:59.144804+0000","last_clean":"2024-08-18T23:56:59.144804+0000","last_became_active":"2024-08-18T23:56:57.985390+0000","last_became_peered":"2024-08-18T23:56:57.985390+0000","last_unstale":"2024-08-18T23:56:59.144804+0000","last_undegraded":"2024-08-18T23:56:59.144804+0000","last_fullsized":"2024-08-18T23:56:59.144804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:47.865044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145904+0000","last_change":"2024-08-18T23:56:52.757392+0000","last_active":"2024-08-18T23:56:59.145904+0000","last_peered":"2024-08-18T23:56:59.145904+0000","last_clean":"2024-08-18T23:56:59.145904+0000","last_became_active":"2024-08-18T23:56:52.757111+0000","last_became_peered":"2024-08-18T23:56:52.757111+0000","last_unstale":"2024-08-18T23:56:59.145904+0000","last_undegraded":"2024-08-18T23:56:59.145904+0000","last_fullsized":"2024-08-18T23:56:59.145904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795884+0000","last_change":"2024-08-18T23:56:53.773415+0000","last_active":"2024-08-18T23:56:58.795884+0000","last_peered":"2024-08-18T23:56:58.795884+0000","last_clean":"2024-08-18T23:56:58.795884+0000","last_became_active":"2024-08-18T23:56:53.769428+0000","last_became_peered":"2024-08-18T23:56:53.769428+0000","last_unstale":"2024-08-18T23:56:58.795884+0000","last_undegraded":"2024-08-18T23:56:58.795884+0000","last_fullsized":"2024-08-18T23:56:58.795884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145415+0000","last_change":"2024-08-18T23:56:57.796039+0000","last_active":"2024-08-18T23:56:59.145415+0000","last_peered":"2024-08-18T23:56:59.145415+0000","last_clean":"2024-08-18T23:56:59.145415+0000","last_became_active":"2024-08-18T23:56:57.795504+0000","last_became_peered":"2024-08-18T23:56:57.795504+0000","last_unstale":"2024-08-18T23:56:59.145415+0000","last_undegraded":"2024-08-18T23:56:59.145415+0000","last_fullsized":"2024-08-18T23:56:59.145415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:45.045215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146785+0000","last_change":"2024-08-18T23:56:52.758482+0000","last_active":"2024-08-18T23:56:59.146785+0000","last_peered":"2024-08-18T23:56:59.146785+0000","last_clean":"2024-08-18T23:56:59.146785+0000","last_became_active":"2024-08-18T23:56:52.758194+0000","last_became_peered":"2024-08-18T23:56:52.758194+0000","last_unstale":"2024-08-18T23:56:59.146785+0000","last_undegraded":"2024-08-18T23:56:59.146785+0000","last_fullsized":"2024-08-18T23:56:59.146785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:23:34.443678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147481+0000","last_change":"2024-08-18T23:56:53.769569+0000","last_active":"2024-08-18T23:56:59.147481+0000","last_peered":"2024-08-18T23:56:59.147481+0000","last_clean":"2024-08-18T23:56:59.147481+0000","last_became_active":"2024-08-18T23:56:53.769304+0000","last_became_peered":"2024-08-18T23:56:53.769304+0000","last_unstale":"2024-08-18T23:56:59.147481+0000","last_undegraded":"2024-08-18T23:56:59.147481+0000","last_fullsized":"2024-08-18T23:56:59.147481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:24.430755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145660+0000","last_change":"2024-08-18T23:56:57.804268+0000","last_active":"2024-08-18T23:56:59.145660+0000","last_peered":"2024-08-18T23:56:59.145660+0000","last_clean":"2024-08-18T23:56:59.145660+0000","last_became_active":"2024-08-18T23:56:57.803915+0000","last_became_peered":"2024-08-18T23:56:57.803915+0000","last_unstale":"2024-08-18T23:56:59.145660+0000","last_undegraded":"2024-08-18T23:56:59.145660+0000","last_fullsized":"2024-08-18T23:56:59.145660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:26.495454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146148+0000","last_change":"2024-08-18T23:56:52.758724+0000","last_active":"2024-08-18T23:56:59.146148+0000","last_peered":"2024-08-18T23:56:59.146148+0000","last_clean":"2024-08-18T23:56:59.146148+0000","last_became_active":"2024-08-18T23:56:52.758420+0000","last_became_peered":"2024-08-18T23:56:52.758420+0000","last_unstale":"2024-08-18T23:56:59.146148+0000","last_undegraded":"2024-08-18T23:56:59.146148+0000","last_fullsized":"2024-08-18T23:56:59.146148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:11.818210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147721+0000","last_change":"2024-08-18T23:56:53.769922+0000","last_active":"2024-08-18T23:56:59.147721+0000","last_peered":"2024-08-18T23:56:59.147721+0000","last_clean":"2024-08-18T23:56:59.147721+0000","last_became_active":"2024-08-18T23:56:53.769638+0000","last_became_peered":"2024-08-18T23:56:53.769638+0000","last_unstale":"2024-08-18T23:56:59.147721+0000","last_undegraded":"2024-08-18T23:56:59.147721+0000","last_fullsized":"2024-08-18T23:56:59.147721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:38.459488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145653+0000","last_change":"2024-08-18T23:56:57.794111+0000","last_active":"2024-08-18T23:56:59.145653+0000","last_peered":"2024-08-18T23:56:59.145653+0000","last_clean":"2024-08-18T23:56:59.145653+0000","last_became_active":"2024-08-18T23:56:57.793673+0000","last_became_peered":"2024-08-18T23:56:57.793673+0000","last_unstale":"2024-08-18T23:56:59.145653+0000","last_undegraded":"2024-08-18T23:56:59.145653+0000","last_fullsized":"2024-08-18T23:56:59.145653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:40:03.077928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793609+0000","last_change":"2024-08-18T23:56:53.766114+0000","last_active":"2024-08-18T23:56:58.793609+0000","last_peered":"2024-08-18T23:56:58.793609+0000","last_clean":"2024-08-18T23:56:58.793609+0000","last_became_active":"2024-08-18T23:56:53.765850+0000","last_became_peered":"2024-08-18T23:56:53.765850+0000","last_unstale":"2024-08-18T23:56:58.793609+0000","last_undegraded":"2024-08-18T23:56:58.793609+0000","last_fullsized":"2024-08-18T23:56:58.793609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147028+0000","last_change":"2024-08-18T23:56:52.759173+0000","last_active":"2024-08-18T23:56:59.147028+0000","last_peered":"2024-08-18T23:56:59.147028+0000","last_clean":"2024-08-18T23:56:59.147028+0000","last_became_active":"2024-08-18T23:56:52.758044+0000","last_became_peered":"2024-08-18T23:56:52.758044+0000","last_unstale":"2024-08-18T23:56:59.147028+0000","last_undegraded":"2024-08-18T23:56:59.147028+0000","last_fullsized":"2024-08-18T23:56:59.147028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:54.977859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147008+0000","last_change":"2024-08-18T23:56:57.804321+0000","last_active":"2024-08-18T23:56:59.147008+0000","last_peered":"2024-08-18T23:56:59.147008+0000","last_clean":"2024-08-18T23:56:59.147008+0000","last_became_active":"2024-08-18T23:56:57.803852+0000","last_became_peered":"2024-08-18T23:56:57.803852+0000","last_unstale":"2024-08-18T23:56:59.147008+0000","last_undegraded":"2024-08-18T23:56:59.147008+0000","last_fullsized":"2024-08-18T23:56:59.147008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145007+0000","last_change":"2024-08-18T23:56:53.768638+0000","last_active":"2024-08-18T23:56:59.145007+0000","last_peered":"2024-08-18T23:56:59.145007+0000","last_clean":"2024-08-18T23:56:59.145007+0000","last_became_active":"2024-08-18T23:56:53.768163+0000","last_became_peered":"2024-08-18T23:56:53.768163+0000","last_unstale":"2024-08-18T23:56:59.145007+0000","last_undegraded":"2024-08-18T23:56:59.145007+0000","last_fullsized":"2024-08-18T23:56:59.145007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:22.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146062+0000","last_change":"2024-08-18T23:56:52.752900+0000","last_active":"2024-08-18T23:56:59.146062+0000","last_peered":"2024-08-18T23:56:59.146062+0000","last_clean":"2024-08-18T23:56:59.146062+0000","last_became_active":"2024-08-18T23:56:52.752616+0000","last_became_peered":"2024-08-18T23:56:52.752616+0000","last_unstale":"2024-08-18T23:56:59.146062+0000","last_undegraded":"2024-08-18T23:56:59.146062+0000","last_fullsized":"2024-08-18T23:56:59.146062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146712+0000","last_change":"2024-08-18T23:56:57.795841+0000","last_active":"2024-08-18T23:56:59.146712+0000","last_peered":"2024-08-18T23:56:59.146712+0000","last_clean":"2024-08-18T23:56:59.146712+0000","last_became_active":"2024-08-18T23:56:57.795354+0000","last_became_peered":"2024-08-18T23:56:57.795354+0000","last_unstale":"2024-08-18T23:56:59.146712+0000","last_undegraded":"2024-08-18T23:56:59.146712+0000","last_fullsized":"2024-08-18T23:56:59.146712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:53.536907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145239+0000","last_change":"2024-08-18T23:56:53.771090+0000","last_active":"2024-08-18T23:56:59.145239+0000","last_peered":"2024-08-18T23:56:59.145239+0000","last_clean":"2024-08-18T23:56:59.145239+0000","last_became_active":"2024-08-18T23:56:53.770808+0000","last_became_peered":"2024-08-18T23:56:53.770808+0000","last_unstale":"2024-08-18T23:56:59.145239+0000","last_undegraded":"2024-08-18T23:56:59.145239+0000","last_fullsized":"2024-08-18T23:56:59.145239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145853+0000","last_change":"2024-08-18T23:56:52.754196+0000","last_active":"2024-08-18T23:56:59.145853+0000","last_peered":"2024-08-18T23:56:59.145853+0000","last_clean":"2024-08-18T23:56:59.145853+0000","last_became_active":"2024-08-18T23:56:52.753897+0000","last_became_peered":"2024-08-18T23:56:52.753897+0000","last_unstale":"2024-08-18T23:56:59.145853+0000","last_undegraded":"2024-08-18T23:56:59.145853+0000","last_fullsized":"2024-08-18T23:56:59.145853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:33:22.056918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145815+0000","last_change":"2024-08-18T23:56:57.981814+0000","last_active":"2024-08-18T23:56:59.145815+0000","last_peered":"2024-08-18T23:56:59.145815+0000","last_clean":"2024-08-18T23:56:59.145815+0000","last_became_active":"2024-08-18T23:56:57.981431+0000","last_became_peered":"2024-08-18T23:56:57.981431+0000","last_unstale":"2024-08-18T23:56:59.145815+0000","last_undegraded":"2024-08-18T23:56:59.145815+0000","last_fullsized":"2024-08-18T23:56:59.145815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145805+0000","last_change":"2024-08-18T23:56:53.767404+0000","last_active":"2024-08-18T23:56:59.145805+0000","last_peered":"2024-08-18T23:56:59.145805+0000","last_clean":"2024-08-18T23:56:59.145805+0000","last_became_active":"2024-08-18T23:56:53.764501+0000","last_became_peered":"2024-08-18T23:56:53.764501+0000","last_unstale":"2024-08-18T23:56:59.145805+0000","last_undegraded":"2024-08-18T23:56:59.145805+0000","last_fullsized":"2024-08-18T23:56:59.145805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:37.381431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147087+0000","last_change":"2024-08-18T23:56:52.759789+0000","last_active":"2024-08-18T23:56:59.147087+0000","last_peered":"2024-08-18T23:56:59.147087+0000","last_clean":"2024-08-18T23:56:59.147087+0000","last_became_active":"2024-08-18T23:56:52.758829+0000","last_became_peered":"2024-08-18T23:56:52.758829+0000","last_unstale":"2024-08-18T23:56:59.147087+0000","last_undegraded":"2024-08-18T23:56:59.147087+0000","last_fullsized":"2024-08-18T23:56:59.147087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:30.187935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146272+0000","last_change":"2024-08-18T23:56:57.801849+0000","last_active":"2024-08-18T23:56:59.146272+0000","last_peered":"2024-08-18T23:56:59.146272+0000","last_clean":"2024-08-18T23:56:59.146272+0000","last_became_active":"2024-08-18T23:56:57.801424+0000","last_became_peered":"2024-08-18T23:56:57.801424+0000","last_unstale":"2024-08-18T23:56:59.146272+0000","last_undegraded":"2024-08-18T23:56:59.146272+0000","last_fullsized":"2024-08-18T23:56:59.146272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:45:28.469431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796181+0000","last_change":"2024-08-18T23:56:53.769056+0000","last_active":"2024-08-18T23:56:58.796181+0000","last_peered":"2024-08-18T23:56:58.796181+0000","last_clean":"2024-08-18T23:56:58.796181+0000","last_became_active":"2024-08-18T23:56:53.768321+0000","last_became_peered":"2024-08-18T23:56:53.768321+0000","last_unstale":"2024-08-18T23:56:58.796181+0000","last_undegraded":"2024-08-18T23:56:58.796181+0000","last_fullsized":"2024-08-18T23:56:58.796181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794222+0000","last_change":"2024-08-18T23:56:52.755465+0000","last_active":"2024-08-18T23:56:58.794222+0000","last_peered":"2024-08-18T23:56:58.794222+0000","last_clean":"2024-08-18T23:56:58.794222+0000","last_became_active":"2024-08-18T23:56:52.755229+0000","last_became_peered":"2024-08-18T23:56:52.755229+0000","last_unstale":"2024-08-18T23:56:58.794222+0000","last_undegraded":"2024-08-18T23:56:58.794222+0000","last_fullsized":"2024-08-18T23:56:58.794222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145628+0000","last_change":"2024-08-18T23:56:57.986350+0000","last_active":"2024-08-18T23:56:59.145628+0000","last_peered":"2024-08-18T23:56:59.145628+0000","last_clean":"2024-08-18T23:56:59.145628+0000","last_became_active":"2024-08-18T23:56:57.985425+0000","last_became_peered":"2024-08-18T23:56:57.985425+0000","last_unstale":"2024-08-18T23:56:59.145628+0000","last_undegraded":"2024-08-18T23:56:59.145628+0000","last_fullsized":"2024-08-18T23:56:59.145628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:21.592416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145448+0000","last_change":"2024-08-18T23:56:53.768554+0000","last_active":"2024-08-18T23:56:59.145448+0000","last_peered":"2024-08-18T23:56:59.145448+0000","last_clean":"2024-08-18T23:56:59.145448+0000","last_became_active":"2024-08-18T23:56:53.767502+0000","last_became_peered":"2024-08-18T23:56:53.767502+0000","last_unstale":"2024-08-18T23:56:59.145448+0000","last_undegraded":"2024-08-18T23:56:59.145448+0000","last_fullsized":"2024-08-18T23:56:59.145448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145919+0000","last_change":"2024-08-18T23:56:52.742342+0000","last_active":"2024-08-18T23:56:59.145919+0000","last_peered":"2024-08-18T23:56:59.145919+0000","last_clean":"2024-08-18T23:56:59.145919+0000","last_became_active":"2024-08-18T23:56:52.741958+0000","last_became_peered":"2024-08-18T23:56:52.741958+0000","last_unstale":"2024-08-18T23:56:59.145919+0000","last_undegraded":"2024-08-18T23:56:59.145919+0000","last_fullsized":"2024-08-18T23:56:59.145919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144744+0000","last_change":"2024-08-18T23:56:57.982697+0000","last_active":"2024-08-18T23:56:59.144744+0000","last_peered":"2024-08-18T23:56:59.144744+0000","last_clean":"2024-08-18T23:56:59.144744+0000","last_became_active":"2024-08-18T23:56:57.981397+0000","last_became_peered":"2024-08-18T23:56:57.981397+0000","last_unstale":"2024-08-18T23:56:59.144744+0000","last_undegraded":"2024-08-18T23:56:59.144744+0000","last_fullsized":"2024-08-18T23:56:59.144744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:04.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145536+0000","last_change":"2024-08-18T23:56:53.764548+0000","last_active":"2024-08-18T23:56:59.145536+0000","last_peered":"2024-08-18T23:56:59.145536+0000","last_clean":"2024-08-18T23:56:59.145536+0000","last_became_active":"2024-08-18T23:56:53.764280+0000","last_became_peered":"2024-08-18T23:56:53.764280+0000","last_unstale":"2024-08-18T23:56:59.145536+0000","last_undegraded":"2024-08-18T23:56:59.145536+0000","last_fullsized":"2024-08-18T23:56:59.145536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147248+0000","last_change":"2024-08-18T23:56:52.759045+0000","last_active":"2024-08-18T23:56:59.147248+0000","last_peered":"2024-08-18T23:56:59.147248+0000","last_clean":"2024-08-18T23:56:59.147248+0000","last_became_active":"2024-08-18T23:56:52.758744+0000","last_became_peered":"2024-08-18T23:56:52.758744+0000","last_unstale":"2024-08-18T23:56:59.147248+0000","last_undegraded":"2024-08-18T23:56:59.147248+0000","last_fullsized":"2024-08-18T23:56:59.147248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:56.808416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795776+0000","last_change":"2024-08-18T23:56:57.984133+0000","last_active":"2024-08-18T23:56:58.795776+0000","last_peered":"2024-08-18T23:56:58.795776+0000","last_clean":"2024-08-18T23:56:58.795776+0000","last_became_active":"2024-08-18T23:56:57.983723+0000","last_became_peered":"2024-08-18T23:56:57.983723+0000","last_unstale":"2024-08-18T23:56:58.795776+0000","last_undegraded":"2024-08-18T23:56:58.795776+0000","last_fullsized":"2024-08-18T23:56:58.795776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147781+0000","last_change":"2024-08-18T23:56:53.771404+0000","last_active":"2024-08-18T23:56:59.147781+0000","last_peered":"2024-08-18T23:56:59.147781+0000","last_clean":"2024-08-18T23:56:59.147781+0000","last_became_active":"2024-08-18T23:56:53.771115+0000","last_became_peered":"2024-08-18T23:56:53.771115+0000","last_unstale":"2024-08-18T23:56:59.147781+0000","last_undegraded":"2024-08-18T23:56:59.147781+0000","last_fullsized":"2024-08-18T23:56:59.147781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:31.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145623+0000","last_change":"2024-08-18T23:56:52.755938+0000","last_active":"2024-08-18T23:56:59.145623+0000","last_peered":"2024-08-18T23:56:59.145623+0000","last_clean":"2024-08-18T23:56:59.145623+0000","last_became_active":"2024-08-18T23:56:52.755665+0000","last_became_peered":"2024-08-18T23:56:52.755665+0000","last_unstale":"2024-08-18T23:56:59.145623+0000","last_undegraded":"2024-08-18T23:56:59.145623+0000","last_fullsized":"2024-08-18T23:56:59.145623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:54.232884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145948+0000","last_change":"2024-08-18T23:56:57.800426+0000","last_active":"2024-08-18T23:56:59.145948+0000","last_peered":"2024-08-18T23:56:59.145948+0000","last_clean":"2024-08-18T23:56:59.145948+0000","last_became_active":"2024-08-18T23:56:57.800074+0000","last_became_peered":"2024-08-18T23:56:57.800074+0000","last_unstale":"2024-08-18T23:56:59.145948+0000","last_undegraded":"2024-08-18T23:56:59.145948+0000","last_fullsized":"2024-08-18T23:56:59.145948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:36.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146563+0000","last_change":"2024-08-18T23:56:53.766348+0000","last_active":"2024-08-18T23:56:59.146563+0000","last_peered":"2024-08-18T23:56:59.146563+0000","last_clean":"2024-08-18T23:56:59.146563+0000","last_became_active":"2024-08-18T23:56:53.765359+0000","last_became_peered":"2024-08-18T23:56:53.765359+0000","last_unstale":"2024-08-18T23:56:59.146563+0000","last_undegraded":"2024-08-18T23:56:59.146563+0000","last_fullsized":"2024-08-18T23:56:59.146563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:33:23.061905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147639+0000","last_change":"2024-08-18T23:56:52.753019+0000","last_active":"2024-08-18T23:56:59.147639+0000","last_peered":"2024-08-18T23:56:59.147639+0000","last_clean":"2024-08-18T23:56:59.147639+0000","last_became_active":"2024-08-18T23:56:52.752740+0000","last_became_peered":"2024-08-18T23:56:52.752740+0000","last_unstale":"2024-08-18T23:56:59.147639+0000","last_undegraded":"2024-08-18T23:56:59.147639+0000","last_fullsized":"2024-08-18T23:56:59.147639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145300+0000","last_change":"2024-08-18T23:56:57.798746+0000","last_active":"2024-08-18T23:56:59.145300+0000","last_peered":"2024-08-18T23:56:59.145300+0000","last_clean":"2024-08-18T23:56:59.145300+0000","last_became_active":"2024-08-18T23:56:57.798335+0000","last_became_peered":"2024-08-18T23:56:57.798335+0000","last_unstale":"2024-08-18T23:56:59.145300+0000","last_undegraded":"2024-08-18T23:56:59.145300+0000","last_fullsized":"2024-08-18T23:56:59.145300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145775+0000","last_change":"2024-08-18T23:56:53.761896+0000","last_active":"2024-08-18T23:56:59.145775+0000","last_peered":"2024-08-18T23:56:59.145775+0000","last_clean":"2024-08-18T23:56:59.145775+0000","last_became_active":"2024-08-18T23:56:53.761638+0000","last_became_peered":"2024-08-18T23:56:53.761638+0000","last_unstale":"2024-08-18T23:56:59.145775+0000","last_undegraded":"2024-08-18T23:56:59.145775+0000","last_fullsized":"2024-08-18T23:56:59.145775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:24:46.410144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794282+0000","last_change":"2024-08-18T23:56:52.761057+0000","last_active":"2024-08-18T23:56:58.794282+0000","last_peered":"2024-08-18T23:56:58.794282+0000","last_clean":"2024-08-18T23:56:58.794282+0000","last_became_active":"2024-08-18T23:56:52.760813+0000","last_became_peered":"2024-08-18T23:56:52.760813+0000","last_unstale":"2024-08-18T23:56:58.794282+0000","last_undegraded":"2024-08-18T23:56:58.794282+0000","last_fullsized":"2024-08-18T23:56:58.794282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145978+0000","last_change":"2024-08-18T23:56:57.799531+0000","last_active":"2024-08-18T23:56:59.145978+0000","last_peered":"2024-08-18T23:56:59.145978+0000","last_clean":"2024-08-18T23:56:59.145978+0000","last_became_active":"2024-08-18T23:56:57.798589+0000","last_became_peered":"2024-08-18T23:56:57.798589+0000","last_unstale":"2024-08-18T23:56:59.145978+0000","last_undegraded":"2024-08-18T23:56:59.145978+0000","last_fullsized":"2024-08-18T23:56:59.145978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:57.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795376+0000","last_change":"2024-08-18T23:56:53.773751+0000","last_active":"2024-08-18T23:56:58.795376+0000","last_peered":"2024-08-18T23:56:58.795376+0000","last_clean":"2024-08-18T23:56:58.795376+0000","last_became_active":"2024-08-18T23:56:53.769340+0000","last_became_peered":"2024-08-18T23:56:53.769340+0000","last_unstale":"2024-08-18T23:56:58.795376+0000","last_undegraded":"2024-08-18T23:56:58.795376+0000","last_fullsized":"2024-08-18T23:56:58.795376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:54.085641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147163+0000","last_change":"2024-08-18T23:56:52.759398+0000","last_active":"2024-08-18T23:56:59.147163+0000","last_peered":"2024-08-18T23:56:59.147163+0000","last_clean":"2024-08-18T23:56:59.147163+0000","last_became_active":"2024-08-18T23:56:52.758246+0000","last_became_peered":"2024-08-18T23:56:52.758246+0000","last_unstale":"2024-08-18T23:56:59.147163+0000","last_undegraded":"2024-08-18T23:56:59.147163+0000","last_fullsized":"2024-08-18T23:56:59.147163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:30:53.080654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796092+0000","last_change":"2024-08-18T23:56:57.985422+0000","last_active":"2024-08-18T23:56:58.796092+0000","last_peered":"2024-08-18T23:56:58.796092+0000","last_clean":"2024-08-18T23:56:58.796092+0000","last_became_active":"2024-08-18T23:56:57.984963+0000","last_became_peered":"2024-08-18T23:56:57.984963+0000","last_unstale":"2024-08-18T23:56:58.796092+0000","last_undegraded":"2024-08-18T23:56:58.796092+0000","last_fullsized":"2024-08-18T23:56:58.796092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:22.275461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144943+0000","last_change":"2024-08-18T23:56:53.766829+0000","last_active":"2024-08-18T23:56:59.144943+0000","last_peered":"2024-08-18T23:56:59.144943+0000","last_clean":"2024-08-18T23:56:59.144943+0000","last_became_active":"2024-08-18T23:56:53.766585+0000","last_became_peered":"2024-08-18T23:56:53.766585+0000","last_unstale":"2024-08-18T23:56:59.144943+0000","last_undegraded":"2024-08-18T23:56:59.144943+0000","last_fullsized":"2024-08-18T23:56:59.144943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146162+0000","last_change":"2024-08-18T23:56:52.749395+0000","last_active":"2024-08-18T23:56:59.146162+0000","last_peered":"2024-08-18T23:56:59.146162+0000","last_clean":"2024-08-18T23:56:59.146162+0000","last_became_active":"2024-08-18T23:56:52.749089+0000","last_became_peered":"2024-08-18T23:56:52.749089+0000","last_unstale":"2024-08-18T23:56:59.146162+0000","last_undegraded":"2024-08-18T23:56:59.146162+0000","last_fullsized":"2024-08-18T23:56:59.146162+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147280+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:56:59.147280+0000","last_peered":"2024-08-18T23:56:59.147280+0000","last_clean":"2024-08-18T23:56:59.147280+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:56:59.147280+0000","last_undegraded":"2024-08-18T23:56:59.147280+0000","last_fullsized":"2024-08-18T23:56:59.147280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793760+0000","last_change":"2024-08-18T23:56:57.985242+0000","last_active":"2024-08-18T23:56:58.793760+0000","last_peered":"2024-08-18T23:56:58.793760+0000","last_clean":"2024-08-18T23:56:58.793760+0000","last_became_active":"2024-08-18T23:56:57.984868+0000","last_became_peered":"2024-08-18T23:56:57.984868+0000","last_unstale":"2024-08-18T23:56:58.793760+0000","last_undegraded":"2024-08-18T23:56:58.793760+0000","last_fullsized":"2024-08-18T23:56:58.793760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:34:01.142691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146556+0000","last_change":"2024-08-18T23:56:53.770252+0000","last_active":"2024-08-18T23:56:59.146556+0000","last_peered":"2024-08-18T23:56:59.146556+0000","last_clean":"2024-08-18T23:56:59.146556+0000","last_became_active":"2024-08-18T23:56:53.769985+0000","last_became_peered":"2024-08-18T23:56:53.769985+0000","last_unstale":"2024-08-18T23:56:59.146556+0000","last_undegraded":"2024-08-18T23:56:59.146556+0000","last_fullsized":"2024-08-18T23:56:59.146556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:53.459015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794847+0000","last_change":"2024-08-18T23:56:52.753918+0000","last_active":"2024-08-18T23:56:58.794847+0000","last_peered":"2024-08-18T23:56:58.794847+0000","last_clean":"2024-08-18T23:56:58.794847+0000","last_became_active":"2024-08-18T23:56:52.753634+0000","last_became_peered":"2024-08-18T23:56:52.753634+0000","last_unstale":"2024-08-18T23:56:58.794847+0000","last_undegraded":"2024-08-18T23:56:58.794847+0000","last_fullsized":"2024-08-18T23:56:58.794847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793607+0000","last_change":"2024-08-18T23:56:57.981987+0000","last_active":"2024-08-18T23:56:58.793607+0000","last_peered":"2024-08-18T23:56:58.793607+0000","last_clean":"2024-08-18T23:56:58.793607+0000","last_became_active":"2024-08-18T23:56:57.981487+0000","last_became_peered":"2024-08-18T23:56:57.981487+0000","last_unstale":"2024-08-18T23:56:58.793607+0000","last_undegraded":"2024-08-18T23:56:58.793607+0000","last_fullsized":"2024-08-18T23:56:58.793607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:06.677472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147493+0000","last_change":"2024-08-18T23:56:53.775056+0000","last_active":"2024-08-18T23:56:59.147493+0000","last_peered":"2024-08-18T23:56:59.147493+0000","last_clean":"2024-08-18T23:56:59.147493+0000","last_became_active":"2024-08-18T23:56:53.772898+0000","last_became_peered":"2024-08-18T23:56:53.772898+0000","last_unstale":"2024-08-18T23:56:59.147493+0000","last_undegraded":"2024-08-18T23:56:59.147493+0000","last_fullsized":"2024-08-18T23:56:59.147493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145727+0000","last_change":"2024-08-18T23:56:52.753178+0000","last_active":"2024-08-18T23:56:59.145727+0000","last_peered":"2024-08-18T23:56:59.145727+0000","last_clean":"2024-08-18T23:56:59.145727+0000","last_became_active":"2024-08-18T23:56:52.752810+0000","last_became_peered":"2024-08-18T23:56:52.752810+0000","last_unstale":"2024-08-18T23:56:59.145727+0000","last_undegraded":"2024-08-18T23:56:59.145727+0000","last_fullsized":"2024-08-18T23:56:59.145727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795903+0000","last_change":"2024-08-18T23:56:57.796078+0000","last_active":"2024-08-18T23:56:58.795903+0000","last_peered":"2024-08-18T23:56:58.795903+0000","last_clean":"2024-08-18T23:56:58.795903+0000","last_became_active":"2024-08-18T23:56:57.795669+0000","last_became_peered":"2024-08-18T23:56:57.795669+0000","last_unstale":"2024-08-18T23:56:58.795903+0000","last_undegraded":"2024-08-18T23:56:58.795903+0000","last_fullsized":"2024-08-18T23:56:58.795903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:36.007553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146826+0000","last_change":"2024-08-18T23:56:53.769692+0000","last_active":"2024-08-18T23:56:59.146826+0000","last_peered":"2024-08-18T23:56:59.146826+0000","last_clean":"2024-08-18T23:56:59.146826+0000","last_became_active":"2024-08-18T23:56:53.768418+0000","last_became_peered":"2024-08-18T23:56:53.768418+0000","last_unstale":"2024-08-18T23:56:59.146826+0000","last_undegraded":"2024-08-18T23:56:59.146826+0000","last_fullsized":"2024-08-18T23:56:59.146826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:06.397680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794421+0000","last_change":"2024-08-18T23:56:52.756405+0000","last_active":"2024-08-18T23:56:58.794421+0000","last_peered":"2024-08-18T23:56:58.794421+0000","last_clean":"2024-08-18T23:56:58.794421+0000","last_became_active":"2024-08-18T23:56:52.756101+0000","last_became_peered":"2024-08-18T23:56:52.756101+0000","last_unstale":"2024-08-18T23:56:58.794421+0000","last_undegraded":"2024-08-18T23:56:58.794421+0000","last_fullsized":"2024-08-18T23:56:58.794421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145551+0000","last_change":"2024-08-18T23:56:57.984658+0000","last_active":"2024-08-18T23:56:59.145551+0000","last_peered":"2024-08-18T23:56:59.145551+0000","last_clean":"2024-08-18T23:56:59.145551+0000","last_became_active":"2024-08-18T23:56:57.984250+0000","last_became_peered":"2024-08-18T23:56:57.984250+0000","last_unstale":"2024-08-18T23:56:59.145551+0000","last_undegraded":"2024-08-18T23:56:59.145551+0000","last_fullsized":"2024-08-18T23:56:59.145551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:45.358309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146315+0000","last_change":"2024-08-18T23:56:53.764626+0000","last_active":"2024-08-18T23:56:59.146315+0000","last_peered":"2024-08-18T23:56:59.146315+0000","last_clean":"2024-08-18T23:56:59.146315+0000","last_became_active":"2024-08-18T23:56:53.764329+0000","last_became_peered":"2024-08-18T23:56:53.764329+0000","last_unstale":"2024-08-18T23:56:59.146315+0000","last_undegraded":"2024-08-18T23:56:59.146315+0000","last_fullsized":"2024-08-18T23:56:59.146315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:27:16.778909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146458+0000","last_change":"2024-08-18T23:56:52.756222+0000","last_active":"2024-08-18T23:56:59.146458+0000","last_peered":"2024-08-18T23:56:59.146458+0000","last_clean":"2024-08-18T23:56:59.146458+0000","last_became_active":"2024-08-18T23:56:52.755983+0000","last_became_peered":"2024-08-18T23:56:52.755983+0000","last_unstale":"2024-08-18T23:56:59.146458+0000","last_undegraded":"2024-08-18T23:56:59.146458+0000","last_fullsized":"2024-08-18T23:56:59.146458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:43:40.687385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145369+0000","last_change":"2024-08-18T23:56:57.797013+0000","last_active":"2024-08-18T23:56:59.145369+0000","last_peered":"2024-08-18T23:56:59.145369+0000","last_clean":"2024-08-18T23:56:59.145369+0000","last_became_active":"2024-08-18T23:56:57.796588+0000","last_became_peered":"2024-08-18T23:56:57.796588+0000","last_unstale":"2024-08-18T23:56:59.145369+0000","last_undegraded":"2024-08-18T23:56:59.145369+0000","last_fullsized":"2024-08-18T23:56:59.145369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:11:01.094119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146228+0000","last_change":"2024-08-18T23:56:53.769197+0000","last_active":"2024-08-18T23:56:59.146228+0000","last_peered":"2024-08-18T23:56:59.146228+0000","last_clean":"2024-08-18T23:56:59.146228+0000","last_became_active":"2024-08-18T23:56:53.768715+0000","last_became_peered":"2024-08-18T23:56:53.768715+0000","last_unstale":"2024-08-18T23:56:59.146228+0000","last_undegraded":"2024-08-18T23:56:59.146228+0000","last_fullsized":"2024-08-18T23:56:59.146228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:57.104014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794086+0000","last_change":"2024-08-18T23:56:52.756491+0000","last_active":"2024-08-18T23:56:58.794086+0000","last_peered":"2024-08-18T23:56:58.794086+0000","last_clean":"2024-08-18T23:56:58.794086+0000","last_became_active":"2024-08-18T23:56:52.756158+0000","last_became_peered":"2024-08-18T23:56:52.756158+0000","last_unstale":"2024-08-18T23:56:58.794086+0000","last_undegraded":"2024-08-18T23:56:58.794086+0000","last_fullsized":"2024-08-18T23:56:58.794086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:31.503425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795726+0000","last_change":"2024-08-18T23:56:57.796919+0000","last_active":"2024-08-18T23:56:58.795726+0000","last_peered":"2024-08-18T23:56:58.795726+0000","last_clean":"2024-08-18T23:56:58.795726+0000","last_became_active":"2024-08-18T23:56:57.796482+0000","last_became_peered":"2024-08-18T23:56:57.796482+0000","last_unstale":"2024-08-18T23:56:58.795726+0000","last_undegraded":"2024-08-18T23:56:58.795726+0000","last_fullsized":"2024-08-18T23:56:58.795726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:57.497691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793669+0000","last_change":"2024-08-18T23:56:53.762288+0000","last_active":"2024-08-18T23:56:58.793669+0000","last_peered":"2024-08-18T23:56:58.793669+0000","last_clean":"2024-08-18T23:56:58.793669+0000","last_became_active":"2024-08-18T23:56:53.762007+0000","last_became_peered":"2024-08-18T23:56:53.762007+0000","last_unstale":"2024-08-18T23:56:58.793669+0000","last_undegraded":"2024-08-18T23:56:58.793669+0000","last_fullsized":"2024-08-18T23:56:58.793669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793757+0000","last_change":"2024-08-18T23:56:52.748797+0000","last_active":"2024-08-18T23:56:58.793757+0000","last_peered":"2024-08-18T23:56:58.793757+0000","last_clean":"2024-08-18T23:56:58.793757+0000","last_became_active":"2024-08-18T23:56:52.747807+0000","last_became_peered":"2024-08-18T23:56:52.747807+0000","last_unstale":"2024-08-18T23:56:58.793757+0000","last_undegraded":"2024-08-18T23:56:58.793757+0000","last_fullsized":"2024-08-18T23:56:58.793757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145359+0000","last_change":"2024-08-18T23:56:57.985530+0000","last_active":"2024-08-18T23:56:59.145359+0000","last_peered":"2024-08-18T23:56:59.145359+0000","last_clean":"2024-08-18T23:56:59.145359+0000","last_became_active":"2024-08-18T23:56:57.985049+0000","last_became_peered":"2024-08-18T23:56:57.985049+0000","last_unstale":"2024-08-18T23:56:59.145359+0000","last_undegraded":"2024-08-18T23:56:59.145359+0000","last_fullsized":"2024-08-18T23:56:59.145359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:20:31.882944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146550+0000","last_change":"2024-08-18T23:56:53.769503+0000","last_active":"2024-08-18T23:56:59.146550+0000","last_peered":"2024-08-18T23:56:59.146550+0000","last_clean":"2024-08-18T23:56:59.146550+0000","last_became_active":"2024-08-18T23:56:53.768768+0000","last_became_peered":"2024-08-18T23:56:53.768768+0000","last_unstale":"2024-08-18T23:56:59.146550+0000","last_undegraded":"2024-08-18T23:56:59.146550+0000","last_fullsized":"2024-08-18T23:56:59.146550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:31.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147504+0000","last_change":"2024-08-18T23:56:52.752031+0000","last_active":"2024-08-18T23:56:59.147504+0000","last_peered":"2024-08-18T23:56:59.147504+0000","last_clean":"2024-08-18T23:56:59.147504+0000","last_became_active":"2024-08-18T23:56:52.751751+0000","last_became_peered":"2024-08-18T23:56:52.751751+0000","last_unstale":"2024-08-18T23:56:59.147504+0000","last_undegraded":"2024-08-18T23:56:59.147504+0000","last_fullsized":"2024-08-18T23:56:59.147504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:27:03.760254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145177+0000","last_change":"2024-08-18T23:56:57.981834+0000","last_active":"2024-08-18T23:56:59.145177+0000","last_peered":"2024-08-18T23:56:59.145177+0000","last_clean":"2024-08-18T23:56:59.145177+0000","last_became_active":"2024-08-18T23:56:57.981436+0000","last_became_peered":"2024-08-18T23:56:57.981436+0000","last_unstale":"2024-08-18T23:56:59.145177+0000","last_undegraded":"2024-08-18T23:56:59.145177+0000","last_fullsized":"2024-08-18T23:56:59.145177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:34:26.326851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795759+0000","last_change":"2024-08-18T23:56:53.767263+0000","last_active":"2024-08-18T23:56:58.795759+0000","last_peered":"2024-08-18T23:56:58.795759+0000","last_clean":"2024-08-18T23:56:58.795759+0000","last_became_active":"2024-08-18T23:56:53.763206+0000","last_became_peered":"2024-08-18T23:56:53.763206+0000","last_unstale":"2024-08-18T23:56:58.795759+0000","last_undegraded":"2024-08-18T23:56:58.795759+0000","last_fullsized":"2024-08-18T23:56:58.795759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:13:55.982846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796033+0000","last_change":"2024-08-18T23:56:52.755349+0000","last_active":"2024-08-18T23:56:58.796033+0000","last_peered":"2024-08-18T23:56:58.796033+0000","last_clean":"2024-08-18T23:56:58.796033+0000","last_became_active":"2024-08-18T23:56:52.755083+0000","last_became_peered":"2024-08-18T23:56:52.755083+0000","last_unstale":"2024-08-18T23:56:58.796033+0000","last_undegraded":"2024-08-18T23:56:58.796033+0000","last_fullsized":"2024-08-18T23:56:58.796033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:28:21.056208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147710+0000","last_change":"2024-08-18T23:56:57.982048+0000","last_active":"2024-08-18T23:56:59.147710+0000","last_peered":"2024-08-18T23:56:59.147710+0000","last_clean":"2024-08-18T23:56:59.147710+0000","last_became_active":"2024-08-18T23:56:57.981629+0000","last_became_peered":"2024-08-18T23:56:57.981629+0000","last_unstale":"2024-08-18T23:56:59.147710+0000","last_undegraded":"2024-08-18T23:56:59.147710+0000","last_fullsized":"2024-08-18T23:56:59.147710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:10.436357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146447+0000","last_change":"2024-08-18T23:56:53.769453+0000","last_active":"2024-08-18T23:56:59.146447+0000","last_peered":"2024-08-18T23:56:59.146447+0000","last_clean":"2024-08-18T23:56:59.146447+0000","last_became_active":"2024-08-18T23:56:53.768971+0000","last_became_peered":"2024-08-18T23:56:53.768971+0000","last_unstale":"2024-08-18T23:56:59.146447+0000","last_undegraded":"2024-08-18T23:56:59.146447+0000","last_fullsized":"2024-08-18T23:56:59.146447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:02:18.236785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:57:03.095757+0000","last_change":"2024-08-18T23:56:52.742740+0000","last_active":"2024-08-18T23:57:03.095757+0000","last_peered":"2024-08-18T23:57:03.095757+0000","last_clean":"2024-08-18T23:57:03.095757+0000","last_became_active":"2024-08-18T23:56:52.742250+0000","last_became_peered":"2024-08-18T23:56:52.742250+0000","last_unstale":"2024-08-18T23:57:03.095757+0000","last_undegraded":"2024-08-18T23:57:03.095757+0000","last_fullsized":"2024-08-18T23:57:03.095757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145905+0000","last_change":"2024-08-18T23:56:57.796638+0000","last_active":"2024-08-18T23:56:59.145905+0000","last_peered":"2024-08-18T23:56:59.145905+0000","last_clean":"2024-08-18T23:56:59.145905+0000","last_became_active":"2024-08-18T23:56:57.796223+0000","last_became_peered":"2024-08-18T23:56:57.796223+0000","last_unstale":"2024-08-18T23:56:59.145905+0000","last_undegraded":"2024-08-18T23:56:59.145905+0000","last_fullsized":"2024-08-18T23:56:59.145905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146813+0000","last_change":"2024-08-18T23:56:53.766948+0000","last_active":"2024-08-18T23:56:59.146813+0000","last_peered":"2024-08-18T23:56:59.146813+0000","last_clean":"2024-08-18T23:56:59.146813+0000","last_became_active":"2024-08-18T23:56:53.766437+0000","last_became_peered":"2024-08-18T23:56:53.766437+0000","last_unstale":"2024-08-18T23:56:59.146813+0000","last_undegraded":"2024-08-18T23:56:59.146813+0000","last_fullsized":"2024-08-18T23:56:59.146813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:12.823198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145614+0000","last_change":"2024-08-18T23:56:52.752268+0000","last_active":"2024-08-18T23:56:59.145614+0000","last_peered":"2024-08-18T23:56:59.145614+0000","last_clean":"2024-08-18T23:56:59.145614+0000","last_became_active":"2024-08-18T23:56:52.751988+0000","last_became_peered":"2024-08-18T23:56:52.751988+0000","last_unstale":"2024-08-18T23:56:59.145614+0000","last_undegraded":"2024-08-18T23:56:59.145614+0000","last_fullsized":"2024-08-18T23:56:59.145614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:16.266852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146117+0000","last_change":"2024-08-18T23:56:57.795578+0000","last_active":"2024-08-18T23:56:59.146117+0000","last_peered":"2024-08-18T23:56:59.146117+0000","last_clean":"2024-08-18T23:56:59.146117+0000","last_became_active":"2024-08-18T23:56:57.795182+0000","last_became_peered":"2024-08-18T23:56:57.795182+0000","last_unstale":"2024-08-18T23:56:59.146117+0000","last_undegraded":"2024-08-18T23:56:59.146117+0000","last_fullsized":"2024-08-18T23:56:59.146117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:28.122472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796078+0000","last_change":"2024-08-18T23:56:53.773616+0000","last_active":"2024-08-18T23:56:58.796078+0000","last_peered":"2024-08-18T23:56:58.796078+0000","last_clean":"2024-08-18T23:56:58.796078+0000","last_became_active":"2024-08-18T23:56:53.773129+0000","last_became_peered":"2024-08-18T23:56:53.773129+0000","last_unstale":"2024-08-18T23:56:58.796078+0000","last_undegraded":"2024-08-18T23:56:58.796078+0000","last_fullsized":"2024-08-18T23:56:58.796078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146443+0000","last_change":"2024-08-18T23:56:52.744917+0000","last_active":"2024-08-18T23:56:59.146443+0000","last_peered":"2024-08-18T23:56:59.146443+0000","last_clean":"2024-08-18T23:56:59.146443+0000","last_became_active":"2024-08-18T23:56:52.744638+0000","last_became_peered":"2024-08-18T23:56:52.744638+0000","last_unstale":"2024-08-18T23:56:59.146443+0000","last_undegraded":"2024-08-18T23:56:59.146443+0000","last_fullsized":"2024-08-18T23:56:59.146443+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144951+0000","last_change":"2024-08-18T23:56:57.794782+0000","last_active":"2024-08-18T23:56:59.144951+0000","last_peered":"2024-08-18T23:56:59.144951+0000","last_clean":"2024-08-18T23:56:59.144951+0000","last_became_active":"2024-08-18T23:56:57.794392+0000","last_became_peered":"2024-08-18T23:56:57.794392+0000","last_unstale":"2024-08-18T23:56:59.144951+0000","last_undegraded":"2024-08-18T23:56:59.144951+0000","last_fullsized":"2024-08-18T23:56:59.144951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:47.357886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146347+0000","last_change":"2024-08-18T23:56:53.774590+0000","last_active":"2024-08-18T23:56:59.146347+0000","last_peered":"2024-08-18T23:56:59.146347+0000","last_clean":"2024-08-18T23:56:59.146347+0000","last_became_active":"2024-08-18T23:56:53.774302+0000","last_became_peered":"2024-08-18T23:56:53.774302+0000","last_unstale":"2024-08-18T23:56:59.146347+0000","last_undegraded":"2024-08-18T23:56:59.146347+0000","last_fullsized":"2024-08-18T23:56:59.146347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793992+0000","last_change":"2024-08-18T23:56:52.750383+0000","last_active":"2024-08-18T23:56:58.793992+0000","last_peered":"2024-08-18T23:56:58.793992+0000","last_clean":"2024-08-18T23:56:58.793992+0000","last_became_active":"2024-08-18T23:56:52.750095+0000","last_became_peered":"2024-08-18T23:56:52.750095+0000","last_unstale":"2024-08-18T23:56:58.793992+0000","last_undegraded":"2024-08-18T23:56:58.793992+0000","last_fullsized":"2024-08-18T23:56:58.793992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:57:20.014478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144880+0000","last_change":"2024-08-18T23:56:57.982444+0000","last_active":"2024-08-18T23:56:59.144880+0000","last_peered":"2024-08-18T23:56:59.144880+0000","last_clean":"2024-08-18T23:56:59.144880+0000","last_became_active":"2024-08-18T23:56:57.982080+0000","last_became_peered":"2024-08-18T23:56:57.982080+0000","last_unstale":"2024-08-18T23:56:59.144880+0000","last_undegraded":"2024-08-18T23:56:59.144880+0000","last_fullsized":"2024-08-18T23:56:59.144880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:46:30.528419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795672+0000","last_change":"2024-08-18T23:56:57.984231+0000","last_active":"2024-08-18T23:56:58.795672+0000","last_peered":"2024-08-18T23:56:58.795672+0000","last_clean":"2024-08-18T23:56:58.795672+0000","last_became_active":"2024-08-18T23:56:57.983816+0000","last_became_peered":"2024-08-18T23:56:57.983816+0000","last_unstale":"2024-08-18T23:56:58.795672+0000","last_undegraded":"2024-08-18T23:56:58.795672+0000","last_fullsized":"2024-08-18T23:56:58.795672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145512+0000","last_change":"2024-08-18T23:56:53.765456+0000","last_active":"2024-08-18T23:56:59.145512+0000","last_peered":"2024-08-18T23:56:59.145512+0000","last_clean":"2024-08-18T23:56:59.145512+0000","last_became_active":"2024-08-18T23:56:53.765209+0000","last_became_peered":"2024-08-18T23:56:53.765209+0000","last_unstale":"2024-08-18T23:56:59.145512+0000","last_undegraded":"2024-08-18T23:56:59.145512+0000","last_fullsized":"2024-08-18T23:56:59.145512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145778+0000","last_change":"2024-08-18T23:56:52.746017+0000","last_active":"2024-08-18T23:56:59.145778+0000","last_peered":"2024-08-18T23:56:59.145778+0000","last_clean":"2024-08-18T23:56:59.145778+0000","last_became_active":"2024-08-18T23:56:52.745758+0000","last_became_peered":"2024-08-18T23:56:52.745758+0000","last_unstale":"2024-08-18T23:56:59.145778+0000","last_undegraded":"2024-08-18T23:56:59.145778+0000","last_fullsized":"2024-08-18T23:56:59.145778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:27:36.536160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794035+0000","last_change":"2024-08-18T23:56:57.797625+0000","last_active":"2024-08-18T23:56:58.794035+0000","last_peered":"2024-08-18T23:56:58.794035+0000","last_clean":"2024-08-18T23:56:58.794035+0000","last_became_active":"2024-08-18T23:56:57.797212+0000","last_became_peered":"2024-08-18T23:56:57.797212+0000","last_unstale":"2024-08-18T23:56:58.794035+0000","last_undegraded":"2024-08-18T23:56:58.794035+0000","last_fullsized":"2024-08-18T23:56:58.794035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:42.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145996+0000","last_change":"2024-08-18T23:56:53.770813+0000","last_active":"2024-08-18T23:56:59.145996+0000","last_peered":"2024-08-18T23:56:59.145996+0000","last_clean":"2024-08-18T23:56:59.145996+0000","last_became_active":"2024-08-18T23:56:53.770418+0000","last_became_peered":"2024-08-18T23:56:53.770418+0000","last_unstale":"2024-08-18T23:56:59.145996+0000","last_undegraded":"2024-08-18T23:56:59.145996+0000","last_fullsized":"2024-08-18T23:56:59.145996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145393+0000","last_change":"2024-08-18T23:56:52.749549+0000","last_active":"2024-08-18T23:56:59.145393+0000","last_peered":"2024-08-18T23:56:59.145393+0000","last_clean":"2024-08-18T23:56:59.145393+0000","last_became_active":"2024-08-18T23:56:52.749241+0000","last_became_peered":"2024-08-18T23:56:52.749241+0000","last_unstale":"2024-08-18T23:56:59.145393+0000","last_undegraded":"2024-08-18T23:56:59.145393+0000","last_fullsized":"2024-08-18T23:56:59.145393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:10:48.081149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793835+0000","last_change":"2024-08-18T23:56:52.748476+0000","last_active":"2024-08-18T23:56:58.793835+0000","last_peered":"2024-08-18T23:56:58.793835+0000","last_clean":"2024-08-18T23:56:58.793835+0000","last_became_active":"2024-08-18T23:56:52.748086+0000","last_became_peered":"2024-08-18T23:56:52.748086+0000","last_unstale":"2024-08-18T23:56:58.793835+0000","last_undegraded":"2024-08-18T23:56:58.793835+0000","last_fullsized":"2024-08-18T23:56:58.793835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:10:36.376443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.796022+0000","last_change":"2024-08-18T23:56:53.769482+0000","last_active":"2024-08-18T23:56:58.796022+0000","last_peered":"2024-08-18T23:56:58.796022+0000","last_clean":"2024-08-18T23:56:58.796022+0000","last_became_active":"2024-08-18T23:56:53.769011+0000","last_became_peered":"2024-08-18T23:56:53.769011+0000","last_unstale":"2024-08-18T23:56:58.796022+0000","last_undegraded":"2024-08-18T23:56:58.796022+0000","last_fullsized":"2024-08-18T23:56:58.796022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794765+0000","last_change":"2024-08-18T23:56:57.794273+0000","last_active":"2024-08-18T23:56:58.794765+0000","last_peered":"2024-08-18T23:56:58.794765+0000","last_clean":"2024-08-18T23:56:58.794765+0000","last_became_active":"2024-08-18T23:56:57.793881+0000","last_became_peered":"2024-08-18T23:56:57.793881+0000","last_unstale":"2024-08-18T23:56:58.794765+0000","last_undegraded":"2024-08-18T23:56:58.794765+0000","last_fullsized":"2024-08-18T23:56:58.794765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:45:35.231599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145044+0000","last_change":"2024-08-18T23:56:52.758361+0000","last_active":"2024-08-18T23:56:59.145044+0000","last_peered":"2024-08-18T23:56:59.145044+0000","last_clean":"2024-08-18T23:56:59.145044+0000","last_became_active":"2024-08-18T23:56:52.758061+0000","last_became_peered":"2024-08-18T23:56:52.758061+0000","last_unstale":"2024-08-18T23:56:59.145044+0000","last_undegraded":"2024-08-18T23:56:59.145044+0000","last_fullsized":"2024-08-18T23:56:59.145044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:51.726128+0000","last_clean_scrub_stamp":"2024-08-18T23:56:51.726128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:31.503425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145753+0000","last_change":"2024-08-18T23:56:53.772935+0000","last_active":"2024-08-18T23:56:59.145753+0000","last_peered":"2024-08-18T23:56:59.145753+0000","last_clean":"2024-08-18T23:56:59.145753+0000","last_became_active":"2024-08-18T23:56:53.772663+0000","last_became_peered":"2024-08-18T23:56:53.772663+0000","last_unstale":"2024-08-18T23:56:59.145753+0000","last_undegraded":"2024-08-18T23:56:59.145753+0000","last_fullsized":"2024-08-18T23:56:59.145753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:15:17.271839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145518+0000","last_change":"2024-08-18T23:56:57.796804+0000","last_active":"2024-08-18T23:56:59.145518+0000","last_peered":"2024-08-18T23:56:59.145518+0000","last_clean":"2024-08-18T23:56:59.145518+0000","last_became_active":"2024-08-18T23:56:57.796403+0000","last_became_peered":"2024-08-18T23:56:57.796403+0000","last_unstale":"2024-08-18T23:56:59.145518+0000","last_undegraded":"2024-08-18T23:56:59.145518+0000","last_fullsized":"2024-08-18T23:56:59.145518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:56.769792+0000","last_clean_scrub_stamp":"2024-08-18T23:56:56.769792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:52:52.440154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793982+0000","last_change":"2024-08-18T23:56:53.762460+0000","last_active":"2024-08-18T23:56:58.793982+0000","last_peered":"2024-08-18T23:56:58.793982+0000","last_clean":"2024-08-18T23:56:58.793982+0000","last_became_active":"2024-08-18T23:56:53.762178+0000","last_became_peered":"2024-08-18T23:56:53.762178+0000","last_unstale":"2024-08-18T23:56:58.793982+0000","last_undegraded":"2024-08-18T23:56:58.793982+0000","last_fullsized":"2024-08-18T23:56:58.793982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794237+0000","last_change":"2024-08-18T23:56:53.764382+0000","last_active":"2024-08-18T23:56:58.794237+0000","last_peered":"2024-08-18T23:56:58.794237+0000","last_clean":"2024-08-18T23:56:58.794237+0000","last_became_active":"2024-08-18T23:56:53.764101+0000","last_became_peered":"2024-08-18T23:56:53.764101+0000","last_unstale":"2024-08-18T23:56:58.794237+0000","last_undegraded":"2024-08-18T23:56:58.794237+0000","last_fullsized":"2024-08-18T23:56:58.794237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:55.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147476+0000","last_change":"2024-08-18T23:56:53.775607+0000","last_active":"2024-08-18T23:56:59.147476+0000","last_peered":"2024-08-18T23:56:59.147476+0000","last_clean":"2024-08-18T23:56:59.147476+0000","last_became_active":"2024-08-18T23:56:53.775349+0000","last_became_peered":"2024-08-18T23:56:53.775349+0000","last_unstale":"2024-08-18T23:56:59.147476+0000","last_undegraded":"2024-08-18T23:56:59.147476+0000","last_fullsized":"2024-08-18T23:56:59.147476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:49.498231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795886+0000","last_change":"2024-08-18T23:56:53.767511+0000","last_active":"2024-08-18T23:56:58.795886+0000","last_peered":"2024-08-18T23:56:58.795886+0000","last_clean":"2024-08-18T23:56:58.795886+0000","last_became_active":"2024-08-18T23:56:53.762845+0000","last_became_peered":"2024-08-18T23:56:53.762845+0000","last_unstale":"2024-08-18T23:56:58.795886+0000","last_undegraded":"2024-08-18T23:56:58.795886+0000","last_fullsized":"2024-08-18T23:56:58.795886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145268+0000","last_change":"2024-08-18T23:56:53.764036+0000","last_active":"2024-08-18T23:56:59.145268+0000","last_peered":"2024-08-18T23:56:59.145268+0000","last_clean":"2024-08-18T23:56:59.145268+0000","last_became_active":"2024-08-18T23:56:53.763734+0000","last_became_peered":"2024-08-18T23:56:53.763734+0000","last_unstale":"2024-08-18T23:56:59.145268+0000","last_undegraded":"2024-08-18T23:56:59.145268+0000","last_fullsized":"2024-08-18T23:56:59.145268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:24.083795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145438+0000","last_change":"2024-08-18T23:56:53.766271+0000","last_active":"2024-08-18T23:56:59.145438+0000","last_peered":"2024-08-18T23:56:59.145438+0000","last_clean":"2024-08-18T23:56:59.145438+0000","last_became_active":"2024-08-18T23:56:53.766022+0000","last_became_peered":"2024-08-18T23:56:53.766022+0000","last_unstale":"2024-08-18T23:56:59.145438+0000","last_undegraded":"2024-08-18T23:56:59.145438+0000","last_fullsized":"2024-08-18T23:56:59.145438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794419+0000","last_change":"2024-08-18T23:56:53.759600+0000","last_active":"2024-08-18T23:56:58.794419+0000","last_peered":"2024-08-18T23:56:58.794419+0000","last_clean":"2024-08-18T23:56:58.794419+0000","last_became_active":"2024-08-18T23:56:53.759294+0000","last_became_peered":"2024-08-18T23:56:53.759294+0000","last_unstale":"2024-08-18T23:56:58.794419+0000","last_undegraded":"2024-08-18T23:56:58.794419+0000","last_fullsized":"2024-08-18T23:56:58.794419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145362+0000","last_change":"2024-08-18T23:56:53.764119+0000","last_active":"2024-08-18T23:56:59.145362+0000","last_peered":"2024-08-18T23:56:59.145362+0000","last_clean":"2024-08-18T23:56:59.145362+0000","last_became_active":"2024-08-18T23:56:53.763804+0000","last_became_peered":"2024-08-18T23:56:53.763804+0000","last_unstale":"2024-08-18T23:56:59.145362+0000","last_undegraded":"2024-08-18T23:56:59.145362+0000","last_fullsized":"2024-08-18T23:56:59.145362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:37:49.498231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145653+0000","last_change":"2024-08-18T23:56:53.770463+0000","last_active":"2024-08-18T23:56:59.145653+0000","last_peered":"2024-08-18T23:56:59.145653+0000","last_clean":"2024-08-18T23:56:59.145653+0000","last_became_active":"2024-08-18T23:56:53.768044+0000","last_became_peered":"2024-08-18T23:56:53.768044+0000","last_unstale":"2024-08-18T23:56:59.145653+0000","last_undegraded":"2024-08-18T23:56:59.145653+0000","last_fullsized":"2024-08-18T23:56:59.145653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145134+0000","last_change":"2024-08-18T23:56:53.764055+0000","last_active":"2024-08-18T23:56:59.145134+0000","last_peered":"2024-08-18T23:56:59.145134+0000","last_clean":"2024-08-18T23:56:59.145134+0000","last_became_active":"2024-08-18T23:56:53.763760+0000","last_became_peered":"2024-08-18T23:56:53.763760+0000","last_unstale":"2024-08-18T23:56:59.145134+0000","last_undegraded":"2024-08-18T23:56:59.145134+0000","last_fullsized":"2024-08-18T23:56:59.145134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:50:17.553739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147400+0000","last_change":"2024-08-18T23:56:53.769367+0000","last_active":"2024-08-18T23:56:59.147400+0000","last_peered":"2024-08-18T23:56:59.147400+0000","last_clean":"2024-08-18T23:56:59.147400+0000","last_became_active":"2024-08-18T23:56:53.767443+0000","last_became_peered":"2024-08-18T23:56:53.767443+0000","last_unstale":"2024-08-18T23:56:59.147400+0000","last_undegraded":"2024-08-18T23:56:59.147400+0000","last_fullsized":"2024-08-18T23:56:59.147400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:23:24.083795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795708+0000","last_change":"2024-08-18T23:56:53.762405+0000","last_active":"2024-08-18T23:56:58.795708+0000","last_peered":"2024-08-18T23:56:58.795708+0000","last_clean":"2024-08-18T23:56:58.795708+0000","last_became_active":"2024-08-18T23:56:53.761768+0000","last_became_peered":"2024-08-18T23:56:53.761768+0000","last_unstale":"2024-08-18T23:56:58.795708+0000","last_undegraded":"2024-08-18T23:56:58.795708+0000","last_fullsized":"2024-08-18T23:56:58.795708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.793905+0000","last_change":"2024-08-18T23:56:53.766982+0000","last_active":"2024-08-18T23:56:58.793905+0000","last_peered":"2024-08-18T23:56:58.793905+0000","last_clean":"2024-08-18T23:56:58.793905+0000","last_became_active":"2024-08-18T23:56:53.766519+0000","last_became_peered":"2024-08-18T23:56:53.766519+0000","last_unstale":"2024-08-18T23:56:58.793905+0000","last_undegraded":"2024-08-18T23:56:58.793905+0000","last_fullsized":"2024-08-18T23:56:58.793905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147183+0000","last_change":"2024-08-18T23:56:53.763491+0000","last_active":"2024-08-18T23:56:59.147183+0000","last_peered":"2024-08-18T23:56:59.147183+0000","last_clean":"2024-08-18T23:56:59.147183+0000","last_became_active":"2024-08-18T23:56:53.763123+0000","last_became_peered":"2024-08-18T23:56:53.763123+0000","last_unstale":"2024-08-18T23:56:59.147183+0000","last_undegraded":"2024-08-18T23:56:59.147183+0000","last_fullsized":"2024-08-18T23:56:59.147183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:48:21.747365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794368+0000","last_change":"2024-08-18T23:56:53.756577+0000","last_active":"2024-08-18T23:56:58.794368+0000","last_peered":"2024-08-18T23:56:58.794368+0000","last_clean":"2024-08-18T23:56:58.794368+0000","last_became_active":"2024-08-18T23:56:53.755872+0000","last_became_peered":"2024-08-18T23:56:53.755872+0000","last_unstale":"2024-08-18T23:56:58.794368+0000","last_undegraded":"2024-08-18T23:56:58.794368+0000","last_fullsized":"2024-08-18T23:56:58.794368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:41:12.823198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146986+0000","last_change":"2024-08-18T23:56:53.775155+0000","last_active":"2024-08-18T23:56:59.146986+0000","last_peered":"2024-08-18T23:56:59.146986+0000","last_clean":"2024-08-18T23:56:59.146986+0000","last_became_active":"2024-08-18T23:56:53.774332+0000","last_became_peered":"2024-08-18T23:56:53.774332+0000","last_unstale":"2024-08-18T23:56:59.146986+0000","last_undegraded":"2024-08-18T23:56:59.146986+0000","last_fullsized":"2024-08-18T23:56:59.146986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:57.104014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145651+0000","last_change":"2024-08-18T23:56:53.777136+0000","last_active":"2024-08-18T23:56:59.145651+0000","last_peered":"2024-08-18T23:56:59.145651+0000","last_clean":"2024-08-18T23:56:59.145651+0000","last_became_active":"2024-08-18T23:56:53.776851+0000","last_became_peered":"2024-08-18T23:56:53.776851+0000","last_unstale":"2024-08-18T23:56:59.145651+0000","last_undegraded":"2024-08-18T23:56:59.145651+0000","last_fullsized":"2024-08-18T23:56:59.145651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145548+0000","last_change":"2024-08-18T23:56:53.772745+0000","last_active":"2024-08-18T23:56:59.145548+0000","last_peered":"2024-08-18T23:56:59.145548+0000","last_clean":"2024-08-18T23:56:59.145548+0000","last_became_active":"2024-08-18T23:56:53.772455+0000","last_became_peered":"2024-08-18T23:56:53.772455+0000","last_unstale":"2024-08-18T23:56:59.145548+0000","last_undegraded":"2024-08-18T23:56:59.145548+0000","last_fullsized":"2024-08-18T23:56:59.145548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:18:12.940760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795596+0000","last_change":"2024-08-18T23:56:53.768901+0000","last_active":"2024-08-18T23:56:58.795596+0000","last_peered":"2024-08-18T23:56:58.795596+0000","last_clean":"2024-08-18T23:56:58.795596+0000","last_became_active":"2024-08-18T23:56:53.767949+0000","last_became_peered":"2024-08-18T23:56:53.767949+0000","last_unstale":"2024-08-18T23:56:58.795596+0000","last_undegraded":"2024-08-18T23:56:58.795596+0000","last_fullsized":"2024-08-18T23:56:58.795596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:57.813404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144928+0000","last_change":"2024-08-18T23:56:53.757368+0000","last_active":"2024-08-18T23:56:59.144928+0000","last_peered":"2024-08-18T23:56:59.144928+0000","last_clean":"2024-08-18T23:56:59.144928+0000","last_became_active":"2024-08-18T23:56:53.756898+0000","last_became_peered":"2024-08-18T23:56:53.756898+0000","last_unstale":"2024-08-18T23:56:59.144928+0000","last_undegraded":"2024-08-18T23:56:59.144928+0000","last_fullsized":"2024-08-18T23:56:59.144928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:59.039252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146741+0000","last_change":"2024-08-18T23:56:53.765280+0000","last_active":"2024-08-18T23:56:59.146741+0000","last_peered":"2024-08-18T23:56:59.146741+0000","last_clean":"2024-08-18T23:56:59.146741+0000","last_became_active":"2024-08-18T23:56:53.763756+0000","last_became_peered":"2024-08-18T23:56:53.763756+0000","last_unstale":"2024-08-18T23:56:59.146741+0000","last_undegraded":"2024-08-18T23:56:59.146741+0000","last_fullsized":"2024-08-18T23:56:59.146741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:56:55.237871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794162+0000","last_change":"2024-08-18T23:56:53.772201+0000","last_active":"2024-08-18T23:56:58.794162+0000","last_peered":"2024-08-18T23:56:58.794162+0000","last_clean":"2024-08-18T23:56:58.794162+0000","last_became_active":"2024-08-18T23:56:53.770656+0000","last_became_peered":"2024-08-18T23:56:53.770656+0000","last_unstale":"2024-08-18T23:56:58.794162+0000","last_undegraded":"2024-08-18T23:56:58.794162+0000","last_fullsized":"2024-08-18T23:56:58.794162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:10:57.055442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.794351+0000","last_change":"2024-08-18T23:56:53.772162+0000","last_active":"2024-08-18T23:56:58.794351+0000","last_peered":"2024-08-18T23:56:58.794351+0000","last_clean":"2024-08-18T23:56:58.794351+0000","last_became_active":"2024-08-18T23:56:53.771265+0000","last_became_peered":"2024-08-18T23:56:53.771265+0000","last_unstale":"2024-08-18T23:56:58.794351+0000","last_undegraded":"2024-08-18T23:56:58.794351+0000","last_fullsized":"2024-08-18T23:56:58.794351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146824+0000","last_change":"2024-08-18T23:56:53.772410+0000","last_active":"2024-08-18T23:56:59.146824+0000","last_peered":"2024-08-18T23:56:59.146824+0000","last_clean":"2024-08-18T23:56:59.146824+0000","last_became_active":"2024-08-18T23:56:53.771633+0000","last_became_peered":"2024-08-18T23:56:53.771633+0000","last_unstale":"2024-08-18T23:56:59.146824+0000","last_undegraded":"2024-08-18T23:56:59.146824+0000","last_fullsized":"2024-08-18T23:56:59.146824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:45:41.319632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.144814+0000","last_change":"2024-08-18T23:56:53.766249+0000","last_active":"2024-08-18T23:56:59.144814+0000","last_peered":"2024-08-18T23:56:59.144814+0000","last_clean":"2024-08-18T23:56:59.144814+0000","last_became_active":"2024-08-18T23:56:53.765940+0000","last_became_peered":"2024-08-18T23:56:53.765940+0000","last_unstale":"2024-08-18T23:56:59.144814+0000","last_undegraded":"2024-08-18T23:56:59.144814+0000","last_fullsized":"2024-08-18T23:56:59.144814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:17:55.416110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146148+0000","last_change":"2024-08-18T23:56:53.766607+0000","last_active":"2024-08-18T23:56:59.146148+0000","last_peered":"2024-08-18T23:56:59.146148+0000","last_clean":"2024-08-18T23:56:59.146148+0000","last_became_active":"2024-08-18T23:56:53.766145+0000","last_became_peered":"2024-08-18T23:56:53.766145+0000","last_unstale":"2024-08-18T23:56:59.146148+0000","last_undegraded":"2024-08-18T23:56:59.146148+0000","last_fullsized":"2024-08-18T23:56:59.146148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:25:02.638796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147356+0000","last_change":"2024-08-18T23:56:53.770217+0000","last_active":"2024-08-18T23:56:59.147356+0000","last_peered":"2024-08-18T23:56:59.147356+0000","last_clean":"2024-08-18T23:56:59.147356+0000","last_became_active":"2024-08-18T23:56:53.769943+0000","last_became_peered":"2024-08-18T23:56:53.769943+0000","last_unstale":"2024-08-18T23:56:59.147356+0000","last_undegraded":"2024-08-18T23:56:59.147356+0000","last_fullsized":"2024-08-18T23:56:59.147356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:54:22.456778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146889+0000","last_change":"2024-08-18T23:56:53.763822+0000","last_active":"2024-08-18T23:56:59.146889+0000","last_peered":"2024-08-18T23:56:59.146889+0000","last_clean":"2024-08-18T23:56:59.146889+0000","last_became_active":"2024-08-18T23:56:53.762359+0000","last_became_peered":"2024-08-18T23:56:53.762359+0000","last_unstale":"2024-08-18T23:56:59.146889+0000","last_undegraded":"2024-08-18T23:56:59.146889+0000","last_fullsized":"2024-08-18T23:56:59.146889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:24:38.459488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.147339+0000","last_change":"2024-08-18T23:56:53.775297+0000","last_active":"2024-08-18T23:56:59.147339+0000","last_peered":"2024-08-18T23:56:59.147339+0000","last_clean":"2024-08-18T23:56:59.147339+0000","last_became_active":"2024-08-18T23:56:53.774803+0000","last_became_peered":"2024-08-18T23:56:53.774803+0000","last_unstale":"2024-08-18T23:56:59.147339+0000","last_undegraded":"2024-08-18T23:56:59.147339+0000","last_fullsized":"2024-08-18T23:56:59.147339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:39:59.039252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:58.795630+0000","last_change":"2024-08-18T23:56:53.761493+0000","last_active":"2024-08-18T23:56:58.795630+0000","last_peered":"2024-08-18T23:56:58.795630+0000","last_clean":"2024-08-18T23:56:58.795630+0000","last_became_active":"2024-08-18T23:56:53.760939+0000","last_became_peered":"2024-08-18T23:56:53.760939+0000","last_unstale":"2024-08-18T23:56:58.795630+0000","last_undegraded":"2024-08-18T23:56:58.795630+0000","last_fullsized":"2024-08-18T23:56:58.795630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:20:55.158760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.145825+0000","last_change":"2024-08-18T23:56:53.763839+0000","last_active":"2024-08-18T23:56:59.145825+0000","last_peered":"2024-08-18T23:56:59.145825+0000","last_clean":"2024-08-18T23:56:59.145825+0000","last_became_active":"2024-08-18T23:56:53.763462+0000","last_became_peered":"2024-08-18T23:56:53.763462+0000","last_unstale":"2024-08-18T23:56:59.145825+0000","last_undegraded":"2024-08-18T23:56:59.145825+0000","last_fullsized":"2024-08-18T23:56:59.145825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:54:41.006538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-08-18T23:56:59.146738+0000","last_change":"2024-08-18T23:56:53.769068+0000","last_active":"2024-08-18T23:56:59.146738+0000","last_peered":"2024-08-18T23:56:59.146738+0000","last_clean":"2024-08-18T23:56:59.146738+0000","last_became_active":"2024-08-18T23:56:53.767605+0000","last_became_peered":"2024-08-18T23:56:53.767605+0000","last_unstale":"2024-08-18T23:56:59.146738+0000","last_undegraded":"2024-08-18T23:56:59.146738+0000","last_fullsized":"2024-08-18T23:56:59.146738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:52.731115+0000","last_clean_scrub_stamp":"2024-08-18T23:56:52.731115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:32:30.270890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:18.418 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T23:57:18.418 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-18T23:57:18.418 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-18T23:57:18.419 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-18T23:57:18.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.550+0000 7f0eba94b640 1 Processor -- start 2024-08-18T23:57:18.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.550+0000 7f0eba94b640 1 -- start start 2024-08-18T23:57:18.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eba94b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0eb406d020 0x7f0eb4166b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eba94b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb415c5e0 con 0x7f0eb40afc60 2024-08-18T23:57:18.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eba94b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb415c8c0 con 0x7f0eb415bdd0 2024-08-18T23:57:18.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eba94b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb415d3a0 con 0x7f0eb406d020 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb37fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f0eb40afc60 0x7f0eb406c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56600/0 (socket says 172.21.15.103:56600) 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb37fe640 1 -- 172.21.15.103:0/1437353337 learned_addr learned my addr 172.21.15.103:0/1437353337 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259709820 0 0) 0x7f0eb415c5e0 con 0x7f0eb40afc60 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e9c003520 con 0x7f0eb40afc60 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb8ee8640 1 --2- 172.21.15.103:0/1437353337 >> v2:172.21.15.190:3300/0 conn(0x7f0eb406d020 0x7f0eb4166b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2571822276 0 0) 0x7f0e9c003520 con 0x7f0eb40afc60 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 >> v2:172.21.15.190:3300/0 conn(0x7f0eb406d020 msgr2=0x7f0eb4166b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb2ffd640 1 --2- 172.21.15.103:0/1437353337 >> v2:172.21.15.190:3300/0 conn(0x7f0eb406d020 0x7f0eb4166b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.551+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 >> v1:172.21.15.190:6789/0 conn(0x7f0eb415bdd0 legacy=0x7f0eb40700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb415cba0 con 0x7f0eb40afc60 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f0ea8001670 con 0x7f0eb40afc60 2024-08-18T23:57:18.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 >> v1:172.21.15.103:6789/0 conn(0x7f0eb40afc60 legacy=0x7f0eb406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9c0039b0 0x7f0e9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0e9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9c0051c0 0x7f0e9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb415d3a0 con 0x7f0e9c004800 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9c00c060 con 0x7f0e9c0051c0 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9c00c260 con 0x7f0e9c0039b0 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb37fe640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0e9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb3fff640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9c0039b0 0x7f0e9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb8ee8640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9c0051c0 0x7f0e9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb37fe640 1 -- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9c0039b0 msgr2=0x7f0e9c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb37fe640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e9c0039b0 0x7f0e9c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb37fe640 1 -- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9c0051c0 msgr2=0x7f0e9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:18.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb37fe640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9c0051c0 0x7f0e9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb37fe640 1 -- 172.21.15.103:0/1437353337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9c003520 con 0x7f0e9c004800 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb8ee8640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e9c0051c0 0x7f0e9c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.552+0000 7f0eb8ee8640 1 -- 172.21.15.103:0/1437353337 reap_dead start 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eb37fe640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0e9c004c80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c240 tx=0x7f0e9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14315d93195b274 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8007d10 con 0x7f0e9c004800 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea80058d0 con 0x7f0e9c004800 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eb2ffd640 1 -- 172.21.15.103:0/1437353337 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8005d40 con 0x7f0e9c004800 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eba94b640 1 -- 172.21.15.103:0/1437353337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 msgr2=0x7f0e9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eba94b640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0e9c004c80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800c240 tx=0x7f0e9c005830 comp rx=0 tx=0).stop 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eba94b640 1 -- 172.21.15.103:0/1437353337 shutdown_connections 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eba94b640 1 --2- 172.21.15.103:0/1437353337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0e9c004c80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eba94b640 1 -- 172.21.15.103:0/1437353337 >> 172.21.15.103:0/1437353337 conn(0x7f0eb4071f00 msgr2=0x7f0eb4072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:18.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.553+0000 7f0eba94b640 1 -- 172.21.15.103:0/1437353337 shutdown_connections 2024-08-18T23:57:18.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.554+0000 7f0eba94b640 1 -- 172.21.15.103:0/1437353337 wait complete. 2024-08-18T23:57:18.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.555+0000 7f0eba94b640 1 Processor -- start 2024-08-18T23:57:18.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.555+0000 7f0eba94b640 1 -- start start 2024-08-18T23:57:18.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.555+0000 7f0eba94b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0eb41497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eba94b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb41485c0 0x7f0eb4148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eba94b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb4148f80 0x7f0eb414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eba94b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb415c330 con 0x7f0e9c004800 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eba94b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb415c1b0 con 0x7f0eb41485c0 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eba94b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb406c910 con 0x7f0eb4148f80 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0eb41497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0eb41497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38658/0 (socket says 172.21.15.103:38658) 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 -- 172.21.15.103:0/97013024 learned_addr learned my addr 172.21.15.103:0/97013024 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb37fe640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb41485c0 0x7f0eb4148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb8ee8640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb4148f80 0x7f0eb414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 -- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb4148f80 msgr2=0x7f0eb414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb4148f80 0x7f0eb414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 -- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb41485c0 msgr2=0x7f0eb4148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb41485c0 0x7f0eb4148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 -- 172.21.15.103:0/97013024 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb414bba0 con 0x7f0e9c004800 2024-08-18T23:57:18.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb37fe640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb41485c0 0x7f0eb4148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb3fff640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0eb41497a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400f820 tx=0x7f0ea400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb0ff9640 1 -- 172.21.15.103:0/97013024 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40050d0 con 0x7f0e9c004800 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb0ff9640 1 -- 172.21.15.103:0/97013024 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea4018070 con 0x7f0e9c004800 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb414be80 con 0x7f0e9c004800 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eb0ff9640 1 -- 172.21.15.103:0/97013024 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4005490 con 0x7f0e9c004800 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.556+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb414c440 con 0x7f0e9c004800 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.557+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb40b1810 con 0x7f0e9c004800 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.558+0000 7f0eb0ff9640 1 -- 172.21.15.103:0/97013024 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0ea400d730 con 0x7f0e9c004800 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.558+0000 7f0eb0ff9640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ea006be30 0x7f0ea006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.558+0000 7f0eb0ff9640 1 -- 172.21.15.103:0/97013024 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ea408b020 con 0x7f0e9c004800 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.558+0000 7f0eb37fe640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ea006be30 0x7f0ea006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.559+0000 7f0eb37fe640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ea006be30 0x7f0ea006e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8033000 tx=0x7f0ea8035040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.562+0000 7f0eb0ff9640 1 -- 172.21.15.103:0/97013024 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0eb40b1810 con 0x7f0e9c004800 2024-08-18T23:57:18.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.763+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0eb40b5a50 con 0x7f0e9c004800 2024-08-18T23:57:18.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.763+0000 7f0eb0ff9640 1 -- 172.21.15.103:0/97013024 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0ea4059690 con 0x7f0e9c004800 2024-08-18T23:57:18.765 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:18.765 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ea006be30 msgr2=0x7f0ea006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ea006be30 0x7f0ea006e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8033000 tx=0x7f0ea8035040 comp rx=0 tx=0).stop 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 msgr2=0x7f0eb41497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0eb41497a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400f820 tx=0x7f0ea400fce0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 shutdown_connections 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0ea006be30 0x7f0ea006e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb4148f80 0x7f0eb414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb41485c0 0x7f0eb4148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 --2- 172.21.15.103:0/97013024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e9c004800 0x7f0eb41497a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 >> 172.21.15.103:0/97013024 conn(0x7f0eb4071f00 msgr2=0x7f0eb40cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:18.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 shutdown_connections 2024-08-18T23:57:18.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.765+0000 7f0eba94b640 1 -- 172.21.15.103:0/97013024 wait complete. 2024-08-18T23:57:18.777 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-18T23:57:18.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:18.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.875+0000 7f220dd8f640 1 Processor -- start 2024-08-18T23:57:18.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.875+0000 7f220dd8f640 1 -- start start 2024-08-18T23:57:18.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.875+0000 7f220dd8f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815e380 0x7f22080cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.875+0000 7f220dd8f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f220806d650 0x7f22080d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f220dd8f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f22080d1580 0x7f22080d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f220dd8f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f22080b3500 con 0x7f220806d650 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f220dd8f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f22080b6a50 con 0x7f22080d1580 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f220dd8f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f22080d19b0 con 0x7f220815e380 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2206ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f220806d650 0x7f22080d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2206ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f220806d650 0x7f22080d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38674/0 (socket says 172.21.15.103:38674) 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2206ffd640 1 -- 172.21.15.103:0/659963521 learned_addr learned my addr 172.21.15.103:0/659963521 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2207fff640 1 --2- 172.21.15.103:0/659963521 >> v2:172.21.15.190:3300/0 conn(0x7f22080d1580 0x7f22080d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f22077fe640 1 --2- 172.21.15.103:0/659963521 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815e380 0x7f22080cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2206ffd640 1 -- 172.21.15.103:0/659963521 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815e380 msgr2=0x7f22080cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:18.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2206ffd640 1 --2- 172.21.15.103:0/659963521 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815e380 0x7f22080cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2206ffd640 1 -- 172.21.15.103:0/659963521 >> v2:172.21.15.190:3300/0 conn(0x7f22080d1580 msgr2=0x7f22080d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2206ffd640 1 --2- 172.21.15.103:0/659963521 >> v2:172.21.15.190:3300/0 conn(0x7f22080d1580 0x7f22080d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.876+0000 7f2206ffd640 1 -- 172.21.15.103:0/659963521 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220806da70 con 0x7f220806d650 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f2206ffd640 1 --2- 172.21.15.103:0/659963521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220806d650 0x7f22080d1040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f22080d1c60 tx=0x7f21fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b5df47abd8330a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f22067fc640 1 -- 172.21.15.103:0/659963521 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc037070 con 0x7f220806d650 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f22067fc640 1 -- 172.21.15.103:0/659963521 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21fc032440 con 0x7f220806d650 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f22067fc640 1 -- 172.21.15.103:0/659963521 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc032810 con 0x7f220806d650 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 -- 172.21.15.103:0/659963521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220806d650 msgr2=0x7f22080d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 --2- 172.21.15.103:0/659963521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220806d650 0x7f22080d1040 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f22080d1c60 tx=0x7f21fc02a210 comp rx=0 tx=0).stop 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 -- 172.21.15.103:0/659963521 shutdown_connections 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 --2- 172.21.15.103:0/659963521 >> v2:172.21.15.190:3300/0 conn(0x7f22080d1580 0x7f22080d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 --2- 172.21.15.103:0/659963521 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220806d650 0x7f22080d1040 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 --2- 172.21.15.103:0/659963521 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815e380 0x7f22080cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 -- 172.21.15.103:0/659963521 >> 172.21.15.103:0/659963521 conn(0x7f2208073210 msgr2=0x7f22080735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:18.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 -- 172.21.15.103:0/659963521 shutdown_connections 2024-08-18T23:57:18.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.877+0000 7f220dd8f640 1 -- 172.21.15.103:0/659963521 wait complete. 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.879+0000 7f220dd8f640 1 Processor -- start 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.879+0000 7f220dd8f640 1 -- start start 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f220dd8f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220806d650 0x7f2208157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f220dd8f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22080d1580 0x7f22080ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f220dd8f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815e380 0x7f22080ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f220dd8f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22080b6400 con 0x7f220815e380 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f220dd8f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f22080b6120 con 0x7f220806d650 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f220dd8f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f22080b66e0 con 0x7f22080d1580 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815e380 0x7f22080ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815e380 0x7f22080ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38686/0 (socket says 172.21.15.103:38686) 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 -- 172.21.15.103:0/309553267 learned_addr learned my addr 172.21.15.103:0/309553267 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f22077fe640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220806d650 0x7f2208157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2206ffd640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22080d1580 0x7f22080ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 -- 172.21.15.103:0/309553267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22080d1580 msgr2=0x7f22080ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22080d1580 0x7f22080ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 -- 172.21.15.103:0/309553267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220806d650 msgr2=0x7f2208157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220806d650 0x7f2208157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 -- 172.21.15.103:0/309553267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2208160190 con 0x7f220815e380 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f2207fff640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815e380 0x7f22080ca570 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f220000eed0 tx=0x7f220000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f21effff640 1 -- 172.21.15.103:0/309553267 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2200018020 con 0x7f220815e380 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f21effff640 1 -- 172.21.15.103:0/309553267 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2200014400 con 0x7f220815e380 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f21effff640 1 -- 172.21.15.103:0/309553267 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22000147f0 con 0x7f220815e380 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2208160470 con 0x7f220815e380 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.880+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2208160a30 con 0x7f220815e380 2024-08-18T23:57:18.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.881+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22080d1040 con 0x7f220815e380 2024-08-18T23:57:18.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.882+0000 7f21effff640 1 -- 172.21.15.103:0/309553267 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2200005d10 con 0x7f220815e380 2024-08-18T23:57:18.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.882+0000 7f21effff640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f21f406be60 0x7f21f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:18.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.882+0000 7f21effff640 1 -- 172.21.15.103:0/309553267 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f220008b700 con 0x7f220815e380 2024-08-18T23:57:18.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.882+0000 7f22077fe640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f21f406be60 0x7f21f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:18.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.883+0000 7f22077fe640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f21f406be60 0x7f21f406e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009aa0 tx=0x7f21f8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:18.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:18.886+0000 7f21effff640 1 -- 172.21.15.103:0/309553267 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2200022070 con 0x7f220815e380 2024-08-18T23:57:19.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.086+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22080b42b0 con 0x7f220815e380 2024-08-18T23:57:19.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.086+0000 7f21effff640 1 -- 172.21.15.103:0/309553267 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5228 (secure 0 0 0) 0x7f2200059720 con 0x7f220815e380 2024-08-18T23:57:19.088 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:19.088 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-18T23:57:12:833627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:57:12.157817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:19.089 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-18T23:57:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.088+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f21f406be60 msgr2=0x7f21f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.088+0000 7f220dd8f640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f21f406be60 0x7f21f406e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009aa0 tx=0x7f21f8009190 comp rx=0 tx=0).stop 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.088+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815e380 msgr2=0x7f22080ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.088+0000 7f220dd8f640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815e380 0x7f22080ca570 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f220000eed0 tx=0x7f220000b480 comp rx=0 tx=0).stop 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.088+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 shutdown_connections 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.088+0000 7f220dd8f640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f21f406be60 0x7f21f406e320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.088+0000 7f220dd8f640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f220815e380 0x7f22080ca570 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.089+0000 7f220dd8f640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22080d1580 0x7f22080ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.089+0000 7f220dd8f640 1 --2- 172.21.15.103:0/309553267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f220806d650 0x7f2208157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.089+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 >> 172.21.15.103:0/309553267 conn(0x7f2208073210 msgr2=0x7f22080b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.089+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 shutdown_connections 2024-08-18T23:57:19.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.089+0000 7f220dd8f640 1 -- 172.21.15.103:0/309553267 wait complete. 2024-08-18T23:57:19.101 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.198+0000 7f8a73e49640 1 Processor -- start 2024-08-18T23:57:19.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.198+0000 7f8a73e49640 1 -- start start 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a73e49640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a6c070a20 0x7f8a6c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a73e49640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c15fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a73e49640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6c1605e0 con 0x7f8a6c160060 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a73e49640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6c15d4f0 con 0x7f8a6c070a20 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a73e49640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6c1608c0 con 0x7f8a6c070e00 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a71be5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a6c070a20 0x7f8a6c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a71be5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a6c070a20 0x7f8a6c15cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38688/0 (socket says 172.21.15.103:38688) 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a71be5640 1 -- 172.21.15.103:0/1645626492 learned_addr learned my addr 172.21.15.103:0/1645626492 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.199+0000 7f8a713e4640 1 --2- 172.21.15.103:0/1645626492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c15fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.200+0000 7f8a71be5640 1 -- 172.21.15.103:0/1645626492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 msgr2=0x7f8a6c15fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:19.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.200+0000 7f8a71be5640 1 --2- 172.21.15.103:0/1645626492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c15fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.200+0000 7f8a71be5640 1 -- 172.21.15.103:0/1645626492 >> v1:172.21.15.190:6789/0 conn(0x7f8a6c160060 legacy=0x7f8a6c0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.200+0000 7f8a71be5640 1 -- 172.21.15.103:0/1645626492 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c15c7b0 con 0x7f8a6c070a20 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.200+0000 7f8a71be5640 1 --2- 172.21.15.103:0/1645626492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c15cfb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800dc90 tx=0x7f8a6802e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffaea2ac45d6c8a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.200+0000 7f8a70be3640 1 -- 172.21.15.103:0/1645626492 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6803a070 con 0x7f8a6c070a20 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.200+0000 7f8a70be3640 1 -- 172.21.15.103:0/1645626492 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6800b650 con 0x7f8a6c070a20 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.200+0000 7f8a70be3640 1 -- 172.21.15.103:0/1645626492 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800ba20 con 0x7f8a6c070a20 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.201+0000 7f8a73e49640 1 -- 172.21.15.103:0/1645626492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 msgr2=0x7f8a6c15cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.201+0000 7f8a73e49640 1 --2- 172.21.15.103:0/1645626492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c15cfb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800dc90 tx=0x7f8a6802e430 comp rx=0 tx=0).stop 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.201+0000 7f8a73e49640 1 -- 172.21.15.103:0/1645626492 shutdown_connections 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.201+0000 7f8a73e49640 1 --2- 172.21.15.103:0/1645626492 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c15fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.201+0000 7f8a73e49640 1 --2- 172.21.15.103:0/1645626492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c15cfb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.201+0000 7f8a73e49640 1 -- 172.21.15.103:0/1645626492 >> 172.21.15.103:0/1645626492 conn(0x7f8a6c0cd7e0 msgr2=0x7f8a6c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:19.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.201+0000 7f8a73e49640 1 -- 172.21.15.103:0/1645626492 shutdown_connections 2024-08-18T23:57:19.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.201+0000 7f8a73e49640 1 -- 172.21.15.103:0/1645626492 wait complete. 2024-08-18T23:57:19.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.202+0000 7f8a73e49640 1 Processor -- start 2024-08-18T23:57:19.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.202+0000 7f8a73e49640 1 -- start start 2024-08-18T23:57:19.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a73e49640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c0adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a73e49640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c13c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a73e49640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c160060 0x7f8a6c13ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a73e49640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c0b0480 con 0x7f8a6c070a20 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a73e49640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c06bb70 con 0x7f8a6c160060 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a73e49640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6c0b0600 con 0x7f8a6c070e00 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a71be5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c0adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a71be5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c0adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38704/0 (socket says 172.21.15.103:38704) 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a71be5640 1 -- 172.21.15.103:0/406157077 learned_addr learned my addr 172.21.15.103:0/406157077 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a713e4640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c13c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a723e6640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c160060 0x7f8a6c13ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a71be5640 1 -- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 msgr2=0x7f8a6c13c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a71be5640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c13c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a71be5640 1 -- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c160060 msgr2=0x7f8a6c13ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a71be5640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c160060 0x7f8a6c13ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a71be5640 1 -- 172.21.15.103:0/406157077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c09dc40 con 0x7f8a6c070a20 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a713e4640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c13c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.203+0000 7f8a723e6640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c160060 0x7f8a6c13ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.204+0000 7f8a71be5640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c0adff0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8a68038040 tx=0x7f8a680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.204+0000 7f8a627fc640 1 -- 172.21.15.103:0/406157077 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6803a030 con 0x7f8a6c070a20 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.204+0000 7f8a627fc640 1 -- 172.21.15.103:0/406157077 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a68044070 con 0x7f8a6c070a20 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.204+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6c09df20 con 0x7f8a6c070a20 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.204+0000 7f8a627fc640 1 -- 172.21.15.103:0/406157077 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6803f680 con 0x7f8a6c070a20 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.204+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6c0b4cd0 con 0x7f8a6c070a20 2024-08-18T23:57:19.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.205+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6c0b4ea0 con 0x7f8a6c070a20 2024-08-18T23:57:19.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.205+0000 7f8a627fc640 1 -- 172.21.15.103:0/406157077 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a6803f820 con 0x7f8a6c070a20 2024-08-18T23:57:19.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.206+0000 7f8a627fc640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a5006be30 0x7f8a5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.206+0000 7f8a627fc640 1 -- 172.21.15.103:0/406157077 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a680af670 con 0x7f8a6c070a20 2024-08-18T23:57:19.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.206+0000 7f8a713e4640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a5006be30 0x7f8a5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.206+0000 7f8a713e4640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a5006be30 0x7f8a5006e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c006fd0 tx=0x7f8a5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.210+0000 7f8a627fc640 1 -- 172.21.15.103:0/406157077 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8a6807dc50 con 0x7f8a6c070a20 2024-08-18T23:57:19.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.408+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a6c069430 con 0x7f8a6c070a20 2024-08-18T23:57:19.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.409+0000 7f8a627fc640 1 -- 172.21.15.103:0/406157077 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5228 (secure 0 0 0) 0x7f8a6807d550 con 0x7f8a6c070a20 2024-08-18T23:57:19.410 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:19.410 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-18T23:57:12:833627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:57:12.157817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:19.411 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-18T23:57:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a5006be30 msgr2=0x7f8a5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a5006be30 0x7f8a5006e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c006fd0 tx=0x7f8a5c008040 comp rx=0 tx=0).stop 2024-08-18T23:57:19.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 msgr2=0x7f8a6c0adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c0adff0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8a68038040 tx=0x7f8a680046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 shutdown_connections 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8a5006be30 0x7f8a5006e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a6c160060 0x7f8a6c13ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a6c070e00 0x7f8a6c13c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 --2- 172.21.15.103:0/406157077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a6c070a20 0x7f8a6c0adff0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 >> 172.21.15.103:0/406157077 conn(0x7f8a6c0cd7e0 msgr2=0x7f8a6c0b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 shutdown_connections 2024-08-18T23:57:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.411+0000 7f8a73e49640 1 -- 172.21.15.103:0/406157077 wait complete. 2024-08-18T23:57:19.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:19.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.520+0000 7ff9689ea640 1 Processor -- start 2024-08-18T23:57:19.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.520+0000 7ff9689ea640 1 -- start start 2024-08-18T23:57:19.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff9689ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640b4370 0x7ff9640ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff9689ea640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff964072610 con 0x7ff96415ade0 2024-08-18T23:57:19.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff9689ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9640728f0 con 0x7ff96406f770 2024-08-18T23:57:19.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff9689ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff96406db10 con 0x7ff9640b4370 2024-08-18T23:57:19.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff96259c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff96415ade0 0x7ff96406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56614/0 (socket says 172.21.15.103:56614) 2024-08-18T23:57:19.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff96259c640 1 -- 172.21.15.103:0/522088114 learned_addr learned my addr 172.21.15.103:0/522088114 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292621321 0 0) 0x7ff964072610 con 0x7ff96415ade0 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff962d9d640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640b4370 0x7ff9640ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff950003520 con 0x7ff96415ade0 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 229945027 0 0) 0x7ff950003520 con 0x7ff96415ade0 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640b4370 msgr2=0x7ff9640ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640b4370 0x7ff9640ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 >> v1:172.21.15.190:6789/0 conn(0x7ff96406f770 legacy=0x7ff9640ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff964072bd0 con 0x7ff96415ade0 2024-08-18T23:57:19.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7ff954001670 con 0x7ff96415ade0 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.521+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 >> v1:172.21.15.103:6789/0 conn(0x7ff96415ade0 legacy=0x7ff96406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff961d9b640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640b4370 0x7ff9500039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff961d9b640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff950003f20 0x7ff950004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff961d9b640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950004d40 0x7ff9500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff96406db10 con 0x7ff950003f20 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff95000bad0 con 0x7ff950004d40 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff95000bcd0 con 0x7ff9640b4370 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff959d9b640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff950003f20 0x7ff950004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff96259c640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640b4370 0x7ff9500039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff962d9d640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950004d40 0x7ff9500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff959d9b640 1 -- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640b4370 msgr2=0x7ff9500039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:19.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff959d9b640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640b4370 0x7ff9500039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff959d9b640 1 -- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950004d40 msgr2=0x7ff9500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff959d9b640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950004d40 0x7ff9500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.522+0000 7ff959d9b640 1 -- 172.21.15.103:0/522088114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff950003520 con 0x7ff950003f20 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff959d9b640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff950003f20 0x7ff950004800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff94c001860 tx=0x7ff950005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23aa2706614f7f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c037070 con 0x7ff950003f20 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94c02abf0 con 0x7ff950003f20 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff961d9b640 1 -- 172.21.15.103:0/522088114 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c001430 con 0x7ff950003f20 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff9689ea640 1 -- 172.21.15.103:0/522088114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff950003f20 msgr2=0x7ff950004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff9689ea640 1 --2- 172.21.15.103:0/522088114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff950003f20 0x7ff950004800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff94c001860 tx=0x7ff950005830 comp rx=0 tx=0).stop 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff962d9d640 1 -- 172.21.15.103:0/522088114 reap_dead start 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff9689ea640 1 -- 172.21.15.103:0/522088114 shutdown_connections 2024-08-18T23:57:19.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff9689ea640 1 -- 172.21.15.103:0/522088114 >> 172.21.15.103:0/522088114 conn(0x7ff9640cfc40 msgr2=0x7ff9640d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:19.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff9689ea640 1 -- 172.21.15.103:0/522088114 shutdown_connections 2024-08-18T23:57:19.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.523+0000 7ff9689ea640 1 -- 172.21.15.103:0/522088114 wait complete. 2024-08-18T23:57:19.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.525+0000 7ff9689ea640 1 Processor -- start 2024-08-18T23:57:19.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.525+0000 7ff9689ea640 1 -- start start 2024-08-18T23:57:19.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.525+0000 7ff9689ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950003f20 0x7ff964155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.525+0000 7ff9689ea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9640ce2f0 0x7ff9640cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.525+0000 7ff9689ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640cb0b0 0x7ff96406df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.525+0000 7ff9689ea640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff96406d6c0 con 0x7ff9640ce2f0 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.525+0000 7ff9689ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff96415b1c0 con 0x7ff950003f20 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.525+0000 7ff9689ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff96406d840 con 0x7ff9640cb0b0 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9640ce2f0 0x7ff9640cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9640ce2f0 0x7ff9640cab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38714/0 (socket says 172.21.15.103:38714) 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 -- 172.21.15.103:0/4238560240 learned_addr learned my addr 172.21.15.103:0/4238560240 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff962d9d640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640cb0b0 0x7ff96406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff96259c640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950003f20 0x7ff964155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 -- 172.21.15.103:0/4238560240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640cb0b0 msgr2=0x7ff96406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640cb0b0 0x7ff96406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 -- 172.21.15.103:0/4238560240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950003f20 msgr2=0x7ff964155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950003f20 0x7ff964155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 -- 172.21.15.103:0/4238560240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9640cb6e0 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff959d9b640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9640ce2f0 0x7ff9640cab70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff94c001950 tx=0x7ff94c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff95b7fe640 1 -- 172.21.15.103:0/4238560240 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c03f020 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff95b7fe640 1 -- 172.21.15.103:0/4238560240 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff94c005270 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff95b7fe640 1 -- 172.21.15.103:0/4238560240 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c037040 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9640cd810 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.526+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9640cddd0 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.527+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9640b47b0 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.528+0000 7ff95b7fe640 1 -- 172.21.15.103:0/4238560240 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff94c042020 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.528+0000 7ff95b7fe640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff94406be60 0x7ff94406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.528+0000 7ff95b7fe640 1 -- 172.21.15.103:0/4238560240 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff94c0aaf90 con 0x7ff9640ce2f0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.528+0000 7ff96259c640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff94406be60 0x7ff94406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.529+0000 7ff96259c640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff94406be60 0x7ff94406e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff9540011e0 tx=0x7ff954001090 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.532+0000 7ff95b7fe640 1 -- 172.21.15.103:0/4238560240 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff94c049030 con 0x7ff9640ce2f0 2024-08-18T23:57:19.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.697+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9640d01c0 con 0x7ff9640ce2f0 2024-08-18T23:57:19.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.698+0000 7ff95b7fe640 1 -- 172.21.15.103:0/4238560240 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7ff94c078fb0 con 0x7ff9640ce2f0 2024-08-18T23:57:19.700 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:19.700 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff94406be60 msgr2=0x7ff94406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff94406be60 0x7ff94406e320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff9540011e0 tx=0x7ff954001090 comp rx=0 tx=0).stop 2024-08-18T23:57:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9640ce2f0 msgr2=0x7ff9640cab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9640ce2f0 0x7ff9640cab70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff94c001950 tx=0x7ff94c001230 comp rx=0 tx=0).stop 2024-08-18T23:57:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 shutdown_connections 2024-08-18T23:57:19.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff94406be60 0x7ff94406e320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9640cb0b0 0x7ff96406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9640ce2f0 0x7ff9640cab70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.700+0000 7ff9689ea640 1 --2- 172.21.15.103:0/4238560240 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff950003f20 0x7ff964155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.701+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 >> 172.21.15.103:0/4238560240 conn(0x7ff9640cfc40 msgr2=0x7ff9640b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:19.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.701+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 shutdown_connections 2024-08-18T23:57:19.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.701+0000 7ff9689ea640 1 -- 172.21.15.103:0/4238560240 wait complete. 2024-08-18T23:57:19.713 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:19.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.810+0000 7fd688fa1640 1 Processor -- start 2024-08-18T23:57:19.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.810+0000 7fd688fa1640 1 -- start start 2024-08-18T23:57:19.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.811+0000 7fd688fa1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd68415e350 0x7fd6840d47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.811+0000 7fd688fa1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 0x7fd6840d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.811+0000 7fd688fa1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd68415e730 con 0x7fd6840cfd40 2024-08-18T23:57:19.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.811+0000 7fd688fa1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fd6840cef80 con 0x7fd68415e350 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.811+0000 7fd688fa1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd6840cf260 con 0x7fd6840d1d10 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.811+0000 7fd68259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd68415e350 0x7fd6840d47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.811+0000 7fd682d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd6840cfd40 0x7fd684161e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56630/0 (socket says 172.21.15.103:56630) 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.811+0000 7fd682d9d640 1 -- 172.21.15.103:0/2020070993 learned_addr learned my addr 172.21.15.103:0/2020070993 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.812+0000 7fd681d9b640 1 --2- 172.21.15.103:0/2020070993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 0x7fd6840d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.812+0000 7fd68259c640 1 -- 172.21.15.103:0/2020070993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 msgr2=0x7fd6840d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.812+0000 7fd68259c640 1 --2- 172.21.15.103:0/2020070993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 0x7fd6840d2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.812+0000 7fd68259c640 1 -- 172.21.15.103:0/2020070993 >> v1:172.21.15.103:6789/0 conn(0x7fd6840cfd40 legacy=0x7fd684161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.812+0000 7fd68259c640 1 -- 172.21.15.103:0/2020070993 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6840cf540 con 0x7fd68415e350 2024-08-18T23:57:19.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.812+0000 7fd68159a640 1 -- 172.21.15.103:0/2020070993 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017848809 0 0) 0x7fd68415e730 con 0x7fd6840cfd40 2024-08-18T23:57:19.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.812+0000 7fd68259c640 1 --2- 172.21.15.103:0/2020070993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840d47c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd6740097a0 tx=0x7fd67402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7323ed42ab0b6a0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd68159a640 1 -- 172.21.15.103:0/2020070993 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674037070 con 0x7fd68415e350 2024-08-18T23:57:19.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd68159a640 1 -- 172.21.15.103:0/2020070993 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd674032440 con 0x7fd68415e350 2024-08-18T23:57:19.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd68159a640 1 -- 172.21.15.103:0/2020070993 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674032810 con 0x7fd68415e350 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd688fa1640 1 -- 172.21.15.103:0/2020070993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 msgr2=0x7fd6840d47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd688fa1640 1 --2- 172.21.15.103:0/2020070993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840d47c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd6740097a0 tx=0x7fd67402a180 comp rx=0 tx=0).stop 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd688fa1640 1 -- 172.21.15.103:0/2020070993 shutdown_connections 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd688fa1640 1 --2- 172.21.15.103:0/2020070993 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 0x7fd6840d2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd688fa1640 1 --2- 172.21.15.103:0/2020070993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840d47c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd688fa1640 1 -- 172.21.15.103:0/2020070993 >> 172.21.15.103:0/2020070993 conn(0x7fd68409d3f0 msgr2=0x7fd6840d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd688fa1640 1 -- 172.21.15.103:0/2020070993 shutdown_connections 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.813+0000 7fd688fa1640 1 -- 172.21.15.103:0/2020070993 wait complete. 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.815+0000 7fd688fa1640 1 Processor -- start 2024-08-18T23:57:19.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.815+0000 7fd688fa1640 1 -- start start 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.815+0000 7fd688fa1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6840cfd40 0x7fd68414d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.815+0000 7fd688fa1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 0x7fd6840c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.815+0000 7fd688fa1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.815+0000 7fd688fa1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd6840d4d00 con 0x7fd68415e350 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.815+0000 7fd688fa1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd6840cec30 con 0x7fd6840cfd40 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.815+0000 7fd688fa1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd6840d4e80 con 0x7fd6840d1d10 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38722/0 (socket says 172.21.15.103:38722) 2024-08-18T23:57:19.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 -- 172.21.15.103:0/4223139326 learned_addr learned my addr 172.21.15.103:0/4223139326 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd681d9b640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 0x7fd6840c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd68259c640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6840cfd40 0x7fd68414d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 -- 172.21.15.103:0/4223139326 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 msgr2=0x7fd6840c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 0x7fd6840c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 -- 172.21.15.103:0/4223139326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6840cfd40 msgr2=0x7fd68414d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6840cfd40 0x7fd68414d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 -- 172.21.15.103:0/4223139326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6840cb520 con 0x7fd68415e350 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd682d9d640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840ca0f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c700 tx=0x7fd67c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd672ffd640 1 -- 172.21.15.103:0/4223139326 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c018070 con 0x7fd68415e350 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd672ffd640 1 -- 172.21.15.103:0/4223139326 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67c00ce10 con 0x7fd68415e350 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6840cb800 con 0x7fd68415e350 2024-08-18T23:57:19.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd672ffd640 1 -- 172.21.15.103:0/4223139326 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00a860 con 0x7fd68415e350 2024-08-18T23:57:19.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.816+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68415d600 con 0x7fd68415e350 2024-08-18T23:57:19.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.817+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6840d47c0 con 0x7fd68415e350 2024-08-18T23:57:19.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.818+0000 7fd672ffd640 1 -- 172.21.15.103:0/4223139326 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd67c01b070 con 0x7fd68415e350 2024-08-18T23:57:19.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.818+0000 7fd672ffd640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd66406be30 0x7fd66406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:19.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.818+0000 7fd672ffd640 1 -- 172.21.15.103:0/4223139326 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd67c08a600 con 0x7fd68415e350 2024-08-18T23:57:19.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.818+0000 7fd68259c640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd66406be30 0x7fd66406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:19.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.819+0000 7fd68259c640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd66406be30 0x7fd66406e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd674034000 tx=0x7fd67402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:19.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:19.822+0000 7fd672ffd640 1 -- 172.21.15.103:0/4223139326 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd67c0586b0 con 0x7fd68415e350 2024-08-18T23:57:20.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.025+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6840d1660 con 0x7fd68415e350 2024-08-18T23:57:20.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.026+0000 7fd672ffd640 1 -- 172.21.15.103:0/4223139326 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5228 (secure 0 0 0) 0x7fd67c05c9b0 con 0x7fd68415e350 2024-08-18T23:57:20.027 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:20.028 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-18T23:57:12:833627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:57:12.157817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:20.028 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-18T23:57:20.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd66406be30 msgr2=0x7fd66406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd66406be30 0x7fd66406e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd674034000 tx=0x7fd67402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 msgr2=0x7fd6840ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840ca0f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00c700 tx=0x7fd67c00cbc0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 shutdown_connections 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd66406be30 0x7fd66406e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd68415e350 0x7fd6840ca0f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6840d1d10 0x7fd6840c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 --2- 172.21.15.103:0/4223139326 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6840cfd40 0x7fd68414d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 >> 172.21.15.103:0/4223139326 conn(0x7fd68409d3f0 msgr2=0x7fd6840d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 shutdown_connections 2024-08-18T23:57:20.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.028+0000 7fd688fa1640 1 -- 172.21.15.103:0/4223139326 wait complete. 2024-08-18T23:57:20.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T23:56:53.078789+0000', 'modified': '2024-08-18T23:57:12.157817+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6837/1034727243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6835', 'nonce': 1034727243}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 1034727243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4284, 'qdb_cluster': [4284]} 2024-08-18T23:57:20.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T23:57:20.443 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T23:57:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.544+0000 7fccb4bd8640 1 Processor -- start 2024-08-18T23:57:20.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.544+0000 7fccb4bd8640 1 -- start start 2024-08-18T23:57:20.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccb4bd8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fccb015c2d0 0x7fccb006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccb4bd8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fccb00d2b30 0x7fccb00701b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccb4bd8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb00cd870 con 0x7fccb00706f0 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccb4bd8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fccb015c6b0 con 0x7fccb015c2d0 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccb4bd8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fccb00cd620 con 0x7fccb00d2b30 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccae59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fccb015c2d0 0x7fccb006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccae59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fccb015c2d0 0x7fccb006f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38724/0 (socket says 172.21.15.103:38724) 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccae59c640 1 -- 172.21.15.103:0/4122597954 learned_addr learned my addr 172.21.15.103:0/4122597954 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccae59c640 1 -- 172.21.15.103:0/4122597954 >> v2:172.21.15.190:3300/0 conn(0x7fccb00d2b30 msgr2=0x7fccb00701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccae59c640 1 --2- 172.21.15.103:0/4122597954 >> v2:172.21.15.190:3300/0 conn(0x7fccb00d2b30 0x7fccb00701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccae59c640 1 -- 172.21.15.103:0/4122597954 >> v1:172.21.15.190:6789/0 conn(0x7fccb00706f0 legacy=0x7fccb00ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.548 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.545+0000 7fccae59c640 1 -- 172.21.15.103:0/4122597954 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb00cdb50 con 0x7fccb015c2d0 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccae59c640 1 --2- 172.21.15.103:0/4122597954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb015c2d0 0x7fccb006f7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccb00717d0 tx=0x7fcca002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf195281d2c5abe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccadd9b640 1 -- 172.21.15.103:0/4122597954 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0037070 con 0x7fccb015c2d0 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccadd9b640 1 -- 172.21.15.103:0/4122597954 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca0032440 con 0x7fccb015c2d0 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccadd9b640 1 -- 172.21.15.103:0/4122597954 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0032810 con 0x7fccb015c2d0 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccb4bd8640 1 -- 172.21.15.103:0/4122597954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb015c2d0 msgr2=0x7fccb006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/4122597954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb015c2d0 0x7fccb006f7a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fccb00717d0 tx=0x7fcca002a2c0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccb4bd8640 1 -- 172.21.15.103:0/4122597954 shutdown_connections 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/4122597954 >> v2:172.21.15.190:3300/0 conn(0x7fccb00d2b30 0x7fccb00701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/4122597954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb015c2d0 0x7fccb006f7a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccb4bd8640 1 -- 172.21.15.103:0/4122597954 >> 172.21.15.103:0/4122597954 conn(0x7fccb00d1ec0 msgr2=0x7fccb00d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:20.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.546+0000 7fccb4bd8640 1 -- 172.21.15.103:0/4122597954 shutdown_connections 2024-08-18T23:57:20.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.547+0000 7fccb4bd8640 1 -- 172.21.15.103:0/4122597954 wait complete. 2024-08-18T23:57:20.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.548+0000 7fccb4bd8640 1 Processor -- start 2024-08-18T23:57:20.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.548+0000 7fccb4bd8640 1 -- start start 2024-08-18T23:57:20.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccb4bd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb00706f0 0x7fccb01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccb4bd8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fccb00d2b30 0x7fccb0153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccb4bd8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fccb015c2d0 0x7fccb01536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccb4bd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fccb006fce0 con 0x7fccb00706f0 2024-08-18T23:57:20.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccb4bd8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fccb00cfe80 con 0x7fccb00d2b30 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccb4bd8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fccb006fe60 con 0x7fccb015c2d0 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb00706f0 0x7fccb01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb00706f0 0x7fccb01545b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38736/0 (socket says 172.21.15.103:38736) 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 -- 172.21.15.103:0/2983639237 learned_addr learned my addr 172.21.15.103:0/2983639237 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fccb00d2b30 0x7fccb0153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccaed9d640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fccb015c2d0 0x7fccb01536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 -- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fccb015c2d0 msgr2=0x7fccb01536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fccb015c2d0 0x7fccb01536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 -- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fccb00d2b30 msgr2=0x7fccb0153170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fccb00d2b30 0x7fccb0153170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 -- 172.21.15.103:0/2983639237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb01e6880 con 0x7fccb00706f0 2024-08-18T23:57:20.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fccb00d2b30 0x7fccb0153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:20.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccaed9d640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fccb015c2d0 0x7fccb01536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:20.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccae59c640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb00706f0 0x7fccb01545b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:20.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fcca77fe640 1 -- 172.21.15.103:0/2983639237 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0041070 con 0x7fccb00706f0 2024-08-18T23:57:20.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fcca77fe640 1 -- 172.21.15.103:0/2983639237 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca003c870 con 0x7fccb00706f0 2024-08-18T23:57:20.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fcca77fe640 1 -- 172.21.15.103:0/2983639237 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0037040 con 0x7fccb00706f0 2024-08-18T23:57:20.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.549+0000 7fccb4bd8640 1 -- 172.21.15.103:0/2983639237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb01e6b20 con 0x7fccb00706f0 2024-08-18T23:57:20.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.550+0000 7fccb4bd8640 1 -- 172.21.15.103:0/2983639237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb01e70e0 con 0x7fccb00706f0 2024-08-18T23:57:20.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.551+0000 7fcca77fe640 1 -- 172.21.15.103:0/2983639237 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcca0044070 con 0x7fccb00706f0 2024-08-18T23:57:20.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.551+0000 7fcca77fe640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcc9006be60 0x7fcc9006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.551+0000 7fcca77fe640 1 -- 172.21.15.103:0/2983639237 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcca00abcb0 con 0x7fccb00706f0 2024-08-18T23:57:20.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.551+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcc9006be60 0x7fcc9006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.552+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcc9006be60 0x7fcc9006e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fccb01e60a0 tx=0x7fcc98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:20.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.552+0000 7fccb7a70740 1 Processor -- start 2024-08-18T23:57:20.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.552+0000 7fccb7a70740 1 -- start start 2024-08-18T23:57:20.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 0x5630919bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091973d10 0x563091976930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x563091970b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccb7a70740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5630918d9c90 con 0x563091977ce0 2024-08-18T23:57:20.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccb7a70740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563091881990 con 0x563091976550 2024-08-18T23:57:20.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccb7a70740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5630918d5c50 con 0x563091973d10 2024-08-18T23:57:20.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccaed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x563091970b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccaed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x563091970b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38752/0 (socket says 172.21.15.103:38752) 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccaed9d640 1 -- 172.21.15.103:0/2258325716 learned_addr learned my addr 172.21.15.103:0/2258325716 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fccae59c640 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 0x5630919bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.553+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091973d10 0x563091976930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fccaed9d640 1 -- 172.21.15.103:0/2258325716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091973d10 msgr2=0x563091976930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fccaed9d640 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091973d10 0x563091976930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fccaed9d640 1 -- 172.21.15.103:0/2258325716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 msgr2=0x5630919bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fccaed9d640 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 0x5630919bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fccaed9d640 1 -- 172.21.15.103:0/2258325716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563091892440 con 0x563091977ce0 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fccaed9d640 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x563091970b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcca800c450 tx=0x7fcca800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365e62110377c6fb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fcc8ffff640 1 -- 172.21.15.103:0/2258325716 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8007430 con 0x563091977ce0 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fcc8ffff640 1 -- 172.21.15.103:0/2258325716 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca80075d0 con 0x563091977ce0 2024-08-18T23:57:20.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fcc8ffff640 1 -- 172.21.15.103:0/2258325716 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca80079c0 con 0x563091977ce0 2024-08-18T23:57:20.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fccb7a70740 1 -- 172.21.15.103:0/2258325716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 msgr2=0x563091970b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.554+0000 7fccb7a70740 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x563091970b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcca800c450 tx=0x7fcca800c910 comp rx=0 tx=0).stop 2024-08-18T23:57:20.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 -- 172.21.15.103:0/2258325716 shutdown_connections 2024-08-18T23:57:20.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x563091970b40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091973d10 0x563091976930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 --2- 172.21.15.103:0/2258325716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 0x5630919bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 -- 172.21.15.103:0/2258325716 >> 172.21.15.103:0/2258325716 conn(0x563091972d10 msgr2=0x5630919bb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:20.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 -- 172.21.15.103:0/2258325716 shutdown_connections 2024-08-18T23:57:20.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 -- 172.21.15.103:0/2258325716 wait complete. 2024-08-18T23:57:20.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 -- start start 2024-08-18T23:57:20.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.555+0000 7fccb7a70740 1 Processor -- start 2024-08-18T23:57:20.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x56309199e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091977ce0 0x5630919b8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 0x56309199cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccb7a70740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5630919721b0 con 0x563091976550 2024-08-18T23:57:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccb7a70740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x563091895690 con 0x563091977ce0 2024-08-18T23:57:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccb7a70740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5630919bc520 con 0x56309199c800 2024-08-18T23:57:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccb7a70740 10 client.0 _ll_register_callbacks cb 0x563091889080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T23:57:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x56309199e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x56309199e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38764/0 (socket says 172.21.15.103:38764) 2024-08-18T23:57:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccae59c640 1 -- 172.21.15.103:0/1462510659 learned_addr learned my addr 172.21.15.103:0/1462510659 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:20.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fccaed9d640 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 0x56309199cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.556+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091977ce0 0x5630919b8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccae59c640 1 -- 172.21.15.103:0/1462510659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 msgr2=0x56309199cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccae59c640 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 0x56309199cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccae59c640 1 -- 172.21.15.103:0/1462510659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091977ce0 msgr2=0x5630919b8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccae59c640 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091977ce0 0x5630919b8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccae59c640 1 -- 172.21.15.103:0/1462510659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630915ed2d0 con 0x563091976550 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccae59c640 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x56309199e050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcca00a9f30 tx=0x7fcca0079d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8546ae2db191f5e7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fcc8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1462510659 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca004b040 con 0x563091976550 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1462510659 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcca007a110 con 0x563091976550 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 1 -- 172.21.15.103:0/1462510659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcca80075d0 con 0x563091976550 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1462510659 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fcca0082890 con 0x563091976550 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 10 client.4680 fetch_fsmap learned FSMap version 9 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 1 -- 172.21.15.103:0/1462510659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5630916b76b0 con 0x563091976550 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1462510659 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca80075d0 con 0x563091976550 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1462510659 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7fcca0082400 con 0x563091976550 2024-08-18T23:57:20.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 10 client.4680 fetch_fsmap finished waiting for FSMap version 9 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 10 client.4680 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 20 client.4680 populate_metadata read hostname 'smithi103' 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x56309199fe00 0x5630919a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 4 client.4680 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fccb7a70740 1 -- 172.21.15.103:0/1462510659 --> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630918e73c0 con 0x56309199fe00 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.557+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x56309199fe00 0x5630919a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.558+0000 7fcc8d7fa640 10 client.4680 ms_handle_connect on v2:172.21.15.103:6835/1034727243 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.558+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x56309199fe00 0x5630919a01e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9bbf869407644a5 server_cookie=e2e12f22d03a0254 in_seq=0 out_seq=0 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.558+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1462510659 <== mds.0 v2:172.21.15.103:6835/1034727243 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630918e73c0 con 0x56309199fe00 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.558+0000 7fcc8d7fa640 10 client.4680 handle_command_reply: tid=0 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.558+0000 7fccb7a70740 1 client.4680 shutdown 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.558+0000 7fccb7a70740 1 -- 172.21.15.103:0/1462510659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 msgr2=0x56309199e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.558+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x56309199e050 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcca00a9f30 tx=0x7fcca0079d70 comp rx=0 tx=0).stop 2024-08-18T23:57:20.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 1 -- 172.21.15.103:0/1462510659 shutdown_connections 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x56309199fe00 0x5630919a01e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 0x56309199cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091977ce0 0x5630919b8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fcc8d7fa640 0 client.4680 ms_handle_reset on v2:172.21.15.103:6835/1034727243 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1462510659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x56309199e050 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 1 -- 172.21.15.103:0/1462510659 >> 172.21.15.103:0/1462510659 conn(0x563091973d10 msgr2=0x5630919b9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 1 -- 172.21.15.103:0/1462510659 shutdown_connections 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 1 -- 172.21.15.103:0/1462510659 wait complete. 2024-08-18T23:57:20.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.559+0000 7fccb7a70740 20 client.4680 trim_cache size 0 max 16384 2024-08-18T23:57:20.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.576+0000 7fccb7a70740 1 Processor -- start 2024-08-18T23:57:20.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.576+0000 7fccb7a70740 1 -- start start 2024-08-18T23:57:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 0x56309196bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x56309199df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 0x56309199be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fccb7a70740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fccb01ffc80 con 0x563091977ce0 2024-08-18T23:57:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fccb7a70740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fccb01feca0 con 0x563091976550 2024-08-18T23:57:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fccb7a70740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fccb00b62a0 con 0x56309199c800 2024-08-18T23:57:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x56309199df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x56309199df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38772/0 (socket says 172.21.15.103:38772) 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 -- 172.21.15.103:0/2520573371 learned_addr learned my addr 172.21.15.103:0/2520573371 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 -- 172.21.15.103:0/2520573371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 msgr2=0x56309199be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/2520573371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 0x56309199be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 -- 172.21.15.103:0/2520573371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 msgr2=0x56309196bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/2520573371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 0x56309196bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 -- 172.21.15.103:0/2520573371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309199f8e0 con 0x563091977ce0 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.577+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/2520573371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x56309199df30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800db80 tx=0x7fcc98013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01f1c66948a0f19 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fcc8f7fe640 1 -- 172.21.15.103:0/2520573371 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9802f070 con 0x563091977ce0 2024-08-18T23:57:20.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fcc8f7fe640 1 -- 172.21.15.103:0/2520573371 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc9800de90 con 0x563091977ce0 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fcc8f7fe640 1 -- 172.21.15.103:0/2520573371 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc980227e0 con 0x563091977ce0 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 -- 172.21.15.103:0/2520573371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 msgr2=0x56309199df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 --2- 172.21.15.103:0/2520573371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x56309199df30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800db80 tx=0x7fcc98013000 comp rx=0 tx=0).stop 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 -- 172.21.15.103:0/2520573371 shutdown_connections 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 --2- 172.21.15.103:0/2520573371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56309199c800 0x56309199be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 --2- 172.21.15.103:0/2520573371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091977ce0 0x56309199df30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 --2- 172.21.15.103:0/2520573371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563091976550 0x56309196bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 -- 172.21.15.103:0/2520573371 >> 172.21.15.103:0/2520573371 conn(0x563091973d10 msgr2=0x5630919a01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 -- 172.21.15.103:0/2520573371 shutdown_connections 2024-08-18T23:57:20.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.578+0000 7fccb7a70740 1 -- 172.21.15.103:0/2520573371 wait complete. 2024-08-18T23:57:20.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.579+0000 7fccb7a70740 1 -- start start 2024-08-18T23:57:20.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.579+0000 7fccb7a70740 1 Processor -- start 2024-08-18T23:57:20.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x5630919be8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091977ce0 0x563091a2cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccb7a70740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56309199c800 0x563091a2d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccb7a70740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5630919a0d80 con 0x563091976550 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccb7a70740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fccb01fe650 con 0x56309199c800 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccb7a70740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5630919cf3b0 con 0x563091977ce0 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccb7a70740 10 client.0 _ll_register_callbacks cb 0x7fcca0006cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x5630919be8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x5630919be8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38774/0 (socket says 172.21.15.103:38774) 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 -- 172.21.15.103:0/1239192757 learned_addr learned my addr 172.21.15.103:0/1239192757 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccaed9d640 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56309199c800 0x563091a2d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091977ce0 0x563091a2cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 -- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091977ce0 msgr2=0x563091a2cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091977ce0 0x563091a2cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 -- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56309199c800 msgr2=0x563091a2d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56309199c800 0x563091a2d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 -- 172.21.15.103:0/1239192757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563091a2fde0 con 0x563091976550 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccaed9d640 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56309199c800 0x563091a2d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccae59c640 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x5630919be8c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcca002a300 tx=0x7fcca00a9e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1a5b89ba79ebc server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fcc8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1239192757 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca004b070 con 0x563091976550 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1239192757 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcca0079f10 con 0x563091976550 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.580+0000 7fccb7a70740 1 -- 172.21.15.103:0/1239192757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc9800de90 con 0x563091976550 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1239192757 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fcca007a110 con 0x563091976550 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 10 client.4686 fetch_fsmap learned FSMap version 9 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 1 -- 172.21.15.103:0/1239192757 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563091a2fde0 con 0x563091976550 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1239192757 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc9800de90 con 0x563091976550 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1239192757 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7fcca0098070 con 0x563091976550 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 10 client.4686 fetch_fsmap finished waiting for FSMap version 9 2024-08-18T23:57:20.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 10 client.4686 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 20 client.4686 populate_metadata read hostname 'smithi103' 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x563091994e60 0x5630919b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 4 client.4686 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 1 -- 172.21.15.103:0/1239192757 --> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] -- command(tid 0: {"prefix": "status"}) -- 0x5630918e1710 con 0x563091994e60 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x563091994e60 0x5630919b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fcc8d7fa640 10 client.4686 ms_handle_connect on v2:172.21.15.103:6835/1034727243 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fcca5d9b640 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x563091994e60 0x5630919b73b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f91cbf41b8428bf server_cookie=bd964c9236a3e982 in_seq=0 out_seq=0 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fcc8d7fa640 1 -- 172.21.15.103:0/1239192757 <== mds.0 v2:172.21.15.103:6835/1034727243 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5630918e1710 con 0x563091994e60 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fcc8d7fa640 10 client.4686 handle_command_reply: tid=0 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.581+0000 7fccb7a70740 1 client.4686 shutdown 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 -- 172.21.15.103:0/1239192757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 msgr2=0x5630919be8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x5630919be8c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcca002a300 tx=0x7fcca00a9e00 comp rx=0 tx=0).stop 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 -- 172.21.15.103:0/1239192757 shutdown_connections 2024-08-18T23:57:20.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.103:6835/1034727243,v1:172.21.15.103:6837/1034727243] conn(0x563091994e60 0x5630919b73b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56309199c800 0x563091a2d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563091977ce0 0x563091a2cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fcc8d7fa640 0 client.4686 ms_handle_reset on v2:172.21.15.103:6835/1034727243 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 --2- 172.21.15.103:0/1239192757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563091976550 0x5630919be8c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 -- 172.21.15.103:0/1239192757 >> 172.21.15.103:0/1239192757 conn(0x563091973d10 msgr2=0x5630919df9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 -- 172.21.15.103:0/1239192757 shutdown_connections 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 1 -- 172.21.15.103:0/1239192757 wait complete. 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb7a70740 20 client.4686 trim_cache size 0 max 16384 2024-08-18T23:57:20.591 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "c396ba9f-4334-441d-8e0e-0892ec29262b", 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4284, 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 26.838565314, 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 9, 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 24, 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 24, 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 32.879723714999997 2024-08-18T23:57:20.592 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:57:20.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 -- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcc9006be60 msgr2=0x7fcc9006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcc9006be60 0x7fcc9006e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fccb01e60a0 tx=0x7fcc98008040 comp rx=0 tx=0).stop 2024-08-18T23:57:20.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 -- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb00706f0 msgr2=0x7fccb01545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:20.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb00706f0 0x7fccb01545b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca00046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 -- 172.21.15.103:0/2983639237 shutdown_connections 2024-08-18T23:57:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcc9006be60 0x7fcc9006e320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fccb015c2d0 0x7fccb01536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fccb00d2b30 0x7fccb0153170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 --2- 172.21.15.103:0/2983639237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fccb00706f0 0x7fccb01545b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 -- 172.21.15.103:0/2983639237 >> 172.21.15.103:0/2983639237 conn(0x7fccb00d1ec0 msgr2=0x7fccb0159510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:20.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 -- 172.21.15.103:0/2983639237 shutdown_connections 2024-08-18T23:57:20.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:20.582+0000 7fccb4bd8640 1 -- 172.21.15.103:0/2983639237 wait complete. 2024-08-18T23:57:20.596 INFO:teuthology.run_tasks:Running task sequential... 2024-08-18T23:57:20.605 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-18T23:57:20.605 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-18T23:57:20.606 INFO:teuthology.task.print:Enabling mgr modules 2024-08-18T23:57:20.606 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-18T23:57:20.644 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-18T23:57:20.644 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-18T23:57:20.644 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-18T23:57:20.644 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T23:57:20.644 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:20.644 INFO:tasks.ceph_fuse:client.2 config is {} 2024-08-18T23:57:20.645 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T23:57:20.645 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-18T23:57:20.645 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-18T23:57:20.645 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T23:57:20.645 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:20.645 INFO:tasks.ceph_fuse:client.3 config is {} 2024-08-18T23:57:20.645 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-18T23:57:20.645 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-18T23:57:20.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:20.645 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-08-18T23:57:20.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:20.665 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2024-08-18T23:57:20.737 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2024-08-18T23:57:20.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:57:20.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:20.739 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-18T23:57:20.754 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-18T23:57:20.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:20.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-18T23:57:20.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:20.821 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-08-18T23:57:20.927 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-18T23:57:20.927 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-18T23:57:20.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T23:57:21.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.025+0000 7fa05589d640 1 Processor -- start 2024-08-18T23:57:21.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.025+0000 7fa05589d640 1 -- start start 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa05589d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa0500d1d20 0x7fa0500d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa05589d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d0f30 0x7fa0500d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa05589d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05006da00 con 0x7fa05015e300 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa05589d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa0500d0aa0 con 0x7fa0500d1d20 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa05589d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa0500d26a0 con 0x7fa0500d0f30 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa04e7fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa0500d1d20 0x7fa0500d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa04effd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa05015e300 0x7fa0500cc480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56636/0 (socket says 172.21.15.103:56636) 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa04effd640 1 -- 172.21.15.103:0/3668873649 learned_addr learned my addr 172.21.15.103:0/3668873649 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.026+0000 7fa04f7fe640 1 --2- 172.21.15.103:0/3668873649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d0f30 0x7fa0500d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04e7fc640 1 -- 172.21.15.103:0/3668873649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d0f30 msgr2=0x7fa0500d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:21.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04e7fc640 1 --2- 172.21.15.103:0/3668873649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d0f30 0x7fa0500d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04e7fc640 1 -- 172.21.15.103:0/3668873649 >> v1:172.21.15.103:6789/0 conn(0x7fa05015e300 legacy=0x7fa0500cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04e7fc640 1 -- 172.21.15.103:0/3668873649 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0500d0450 con 0x7fa0500d1d20 2024-08-18T23:57:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04dffb640 1 -- 172.21.15.103:0/3668873649 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561499483 0 0) 0x7fa05006da00 con 0x7fa05015e300 2024-08-18T23:57:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04f7fe640 1 --2- 172.21.15.103:0/3668873649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d0f30 0x7fa0500d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04e7fc640 1 --2- 172.21.15.103:0/3668873649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d1d20 0x7fa0500d2160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa0440097a0 tx=0x7fa04402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82c73137bc00ed6 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04dffb640 1 -- 172.21.15.103:0/3668873649 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044037070 con 0x7fa0500d1d20 2024-08-18T23:57:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04dffb640 1 -- 172.21.15.103:0/3668873649 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa044032440 con 0x7fa0500d1d20 2024-08-18T23:57:21.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.027+0000 7fa04dffb640 1 -- 172.21.15.103:0/3668873649 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044032810 con 0x7fa0500d1d20 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.028+0000 7fa05589d640 1 -- 172.21.15.103:0/3668873649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d1d20 msgr2=0x7fa0500d2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.028+0000 7fa05589d640 1 --2- 172.21.15.103:0/3668873649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d1d20 0x7fa0500d2160 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa0440097a0 tx=0x7fa04402a180 comp rx=0 tx=0).stop 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.028+0000 7fa05589d640 1 -- 172.21.15.103:0/3668873649 shutdown_connections 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.028+0000 7fa05589d640 1 --2- 172.21.15.103:0/3668873649 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d0f30 0x7fa0500d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.028+0000 7fa05589d640 1 --2- 172.21.15.103:0/3668873649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d1d20 0x7fa0500d2160 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.028+0000 7fa05589d640 1 -- 172.21.15.103:0/3668873649 >> 172.21.15.103:0/3668873649 conn(0x7fa05009aa40 msgr2=0x7fa05009ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.028+0000 7fa05589d640 1 -- 172.21.15.103:0/3668873649 shutdown_connections 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.028+0000 7fa05589d640 1 -- 172.21.15.103:0/3668873649 wait complete. 2024-08-18T23:57:21.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.029+0000 7fa05589d640 1 Processor -- start 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.029+0000 7fa05589d640 1 -- start start 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa05589d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d0f30 0x7fa0501f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa05589d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d1d20 0x7fa0500afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa05589d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05015e300 0x7fa0500b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa05589d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa0500d18c0 con 0x7fa0500d0f30 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa05589d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa0500d0100 con 0x7fa05015e300 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa05589d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa05006ccb0 con 0x7fa0500d1d20 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d0f30 0x7fa0501f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d0f30 0x7fa0501f3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38800/0 (socket says 172.21.15.103:38800) 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04effd640 1 -- 172.21.15.103:0/2912578378 learned_addr learned my addr 172.21.15.103:0/2912578378 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04f7fe640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05015e300 0x7fa0500b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04e7fc640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d1d20 0x7fa0500afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:21.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04effd640 1 -- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d1d20 msgr2=0x7fa0500afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04effd640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d1d20 0x7fa0500afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04effd640 1 -- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05015e300 msgr2=0x7fa0500b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04effd640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05015e300 0x7fa0500b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04effd640 1 -- 172.21.15.103:0/2912578378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0501f3640 con 0x7fa0500d0f30 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.030+0000 7fa04e7fc640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d1d20 0x7fa0500afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.031+0000 7fa04effd640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d0f30 0x7fa0501f3100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c460 tx=0x7fa04000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.031+0000 7fa037fff640 1 -- 172.21.15.103:0/2912578378 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040018070 con 0x7fa0500d0f30 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.031+0000 7fa037fff640 1 -- 172.21.15.103:0/2912578378 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa040007500 con 0x7fa0500d0f30 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.031+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05015e7f0 con 0x7fa0500d0f30 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.031+0000 7fa037fff640 1 -- 172.21.15.103:0/2912578378 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa040004a20 con 0x7fa0500d0f30 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.031+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05015edb0 con 0x7fa0500d0f30 2024-08-18T23:57:21.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.032+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0500d1380 con 0x7fa0500d0f30 2024-08-18T23:57:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.032+0000 7fa037fff640 1 -- 172.21.15.103:0/2912578378 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa04001b070 con 0x7fa0500d0f30 2024-08-18T23:57:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.033+0000 7fa037fff640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa03c06be30 0x7fa03c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.033+0000 7fa037fff640 1 -- 172.21.15.103:0/2912578378 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa04008a3c0 con 0x7fa0500d0f30 2024-08-18T23:57:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.033+0000 7fa04e7fc640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa03c06be30 0x7fa03c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:21.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.033+0000 7fa04e7fc640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa03c06be30 0x7fa03c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa044034000 tx=0x7fa04402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:21.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.037+0000 7fa037fff640 1 -- 172.21.15.103:0/2912578378 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa040058ac0 con 0x7fa0500d0f30 2024-08-18T23:57:21.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.247+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa0500745f0 con 0x7fa0500d0f30 2024-08-18T23:57:21.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.247+0000 7fa037fff640 1 -- 172.21.15.103:0/2912578378 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fa0400583c0 con 0x7fa0500d0f30 2024-08-18T23:57:21.249 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T23:57:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa03c06be30 msgr2=0x7fa03c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa03c06be30 0x7fa03c06e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa044034000 tx=0x7fa04402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d0f30 msgr2=0x7fa0501f3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d0f30 0x7fa0501f3100 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa04000c460 tx=0x7fa04000c920 comp rx=0 tx=0).stop 2024-08-18T23:57:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 shutdown_connections 2024-08-18T23:57:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa03c06be30 0x7fa03c06e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa05015e300 0x7fa0500b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa0500d1d20 0x7fa0500afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 --2- 172.21.15.103:0/2912578378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0500d0f30 0x7fa0501f3100 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 >> 172.21.15.103:0/2912578378 conn(0x7fa05009aa40 msgr2=0x7fa0500b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.249+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 shutdown_connections 2024-08-18T23:57:21.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21.250+0000 7fa05589d640 1 -- 172.21.15.103:0/2912578378 wait complete. 2024-08-18T23:57:21.262 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T23:57:21.262 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T23:57:21.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-08-18T23:57:21.262 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T23:57:21.262 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:21.262 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T23:57:21.262 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T23:57:21.262 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T23:57:21.263 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T23:57:21.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:21.263 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:21.279 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-08-18T23:57:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:21.280 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:21.280 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T23:57:21.280 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:21.280 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T23:57:21.280 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42851sec preferred_lft 42851sec 2024-08-18T23:57:21.280 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-08-18T23:57:21.280 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:21.280 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T23:57:21.280 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:21.280 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:21.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-08-18T23:57:21.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-08-18T23:57:21.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-08-18T23:57:21.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T23:57:21.281 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:21.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:21.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:21.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:21.417 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T23:57:21.440 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-08-18T23:57:21.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:21.442 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-08-18T23:57:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-08-18T23:57:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T23:57:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T23:57:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T23:57:21.499 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T23:57:21.499 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:21.499 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:21.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T23:57:21.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T23:57:21.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T23:57:21.500 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:21.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:21.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:21.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:21.625 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-18T23:57:21.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:21.641 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-08-18T23:57:21.696 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:21.697 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:21.697 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:21.697 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-18T23:57:21.697 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:21.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:21.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:21.815 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-18T23:57:21.815 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:21.815 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:21.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-18T23:57:21.816 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T23:57:21.816 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-18T23:57:21.816 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-18T23:57:21.816 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-18T23:57:21.816 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:21.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:21.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:21.928 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:21.928 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:21.928 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-08-18T23:57:21.928 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T23:57:21.928 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:21.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:21.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:22.005 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-18T23:57:22.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:22.005 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:22.020 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T23:57:22.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:22.021 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:22.076 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-18T23:57:22.142 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:22.199 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-18T23:57:22.200 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-18T23:57:22.201 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-18T23:57:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T23:57:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T23:57:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T23:57:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T23:57:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-18T23:57:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:22.202 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:22.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:22.202 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-18T23:57:22.255 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-18T23:57:22.255 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-18T23:57:22.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-18T23:57:22.322 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-18T23:57:22.379 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-18T23:57:22.380 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:22.381 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:22.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:22.382 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-18T23:57:22.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-08-18T23:57:22.378+0000 7f7da0b02480 -1 init, newargv = 0x560490e83190 newargc=15 2024-08-18T23:57:22.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[34330]: starting ceph client 2024-08-18T23:57:22.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[34330]: starting fuse 2024-08-18T23:57:22.398 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-08-18T23:57:22.398 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-08-18T23:57:22.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-08-18T23:57:22.398 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-08-18T23:57:22.398 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-08-18T23:57:22.398 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-08-18T23:57:22.398 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-08-18T23:57:22.398 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T23:57:22.399 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T23:57:22.400 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-08-18T23:57:22.400 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-08-18T23:57:22.400 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-08-18T23:57:22.400 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T23:57:22.400 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:22.400 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-08-18T23:57:22.400 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-08-18T23:57:22.515 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.34330.asok 2024-08-18T23:57:22.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:22.525 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34330.asok 2024-08-18T23:57:22.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:22.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34330.asok status 2024-08-18T23:57:22.659 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:57:22.659 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-08-18T23:57:22.659 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T23:57:22.659 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T23:57:22.659 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-08-18T23:57:22.659 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-08-18T23:57:22.659 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-18T23:57:22.659 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "34330", 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4701, 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4701 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2341928819 2024-08-18T23:57:22.660 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2341928819 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4701 192.168.0.1:0/2341928819", 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/2341928819", 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 9, 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 24, 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-08-18T23:57:22.661 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-08-18T23:57:22.662 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-08-18T23:57:22.662 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:57:22.667 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-18T23:57:22.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T23:57:22.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.765+0000 7f67ffe17640 1 Processor -- start 2024-08-18T23:57:22.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.765+0000 7f67ffe17640 1 -- start start 2024-08-18T23:57:22.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67ffe17640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67f815bdd0 0x7f67f80afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67ffe17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f806d020 0x7f67f80cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67ffe17640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67f815c5e0 con 0x7f67f80700c0 2024-08-18T23:57:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67ffe17640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f67f815d3a0 con 0x7f67f815bdd0 2024-08-18T23:57:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67ffe17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f67f815c8c0 con 0x7f67f806d020 2024-08-18T23:57:22.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fdbb3640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f67f815bdd0 0x7f67f80afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:22.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fd3b2640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f67f80700c0 0x7f67f806c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56644/0 (socket says 172.21.15.103:56644) 2024-08-18T23:57:22.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fd3b2640 1 -- 172.21.15.103:0/3129254942 learned_addr learned my addr 172.21.15.103:0/3129254942 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:22.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fdbb3640 1 -- 172.21.15.103:0/3129254942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f806d020 msgr2=0x7f67f80cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:22.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fe3b4640 1 --2- 172.21.15.103:0/3129254942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f806d020 0x7f67f80cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:22.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fcbb1640 1 -- 172.21.15.103:0/3129254942 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420059896 0 0) 0x7f67f815c5e0 con 0x7f67f80700c0 2024-08-18T23:57:22.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fdbb3640 1 --2- 172.21.15.103:0/3129254942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f806d020 0x7f67f80cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fdbb3640 1 -- 172.21.15.103:0/3129254942 >> v1:172.21.15.103:6789/0 conn(0x7f67f80700c0 legacy=0x7f67f806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:22.769 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.766+0000 7f67fdbb3640 1 -- 172.21.15.103:0/3129254942 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f815cba0 con 0x7f67f815bdd0 2024-08-18T23:57:22.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.767+0000 7f67fdbb3640 1 --2- 172.21.15.103:0/3129254942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f80afc60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f67f40097a0 tx=0x7f67f402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573a6c279c3cd9fd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.767+0000 7f67fcbb1640 1 -- 172.21.15.103:0/3129254942 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4037070 con 0x7f67f815bdd0 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.767+0000 7f67fcbb1640 1 -- 172.21.15.103:0/3129254942 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f4032440 con 0x7f67f815bdd0 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.767+0000 7f67fcbb1640 1 -- 172.21.15.103:0/3129254942 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4032810 con 0x7f67f815bdd0 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.768+0000 7f67ffe17640 1 -- 172.21.15.103:0/3129254942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 msgr2=0x7f67f80afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.768+0000 7f67ffe17640 1 --2- 172.21.15.103:0/3129254942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f80afc60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f67f40097a0 tx=0x7f67f402a180 comp rx=0 tx=0).stop 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.768+0000 7f67ffe17640 1 -- 172.21.15.103:0/3129254942 shutdown_connections 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.768+0000 7f67ffe17640 1 --2- 172.21.15.103:0/3129254942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f806d020 0x7f67f80cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.768+0000 7f67ffe17640 1 --2- 172.21.15.103:0/3129254942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f80afc60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.768+0000 7f67ffe17640 1 -- 172.21.15.103:0/3129254942 >> 172.21.15.103:0/3129254942 conn(0x7f67f8071f00 msgr2=0x7f67f8072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:22.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.768+0000 7f67ffe17640 1 -- 172.21.15.103:0/3129254942 shutdown_connections 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.768+0000 7f67ffe17640 1 -- 172.21.15.103:0/3129254942 wait complete. 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.769+0000 7f67ffe17640 1 Processor -- start 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.769+0000 7f67ffe17640 1 -- start start 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ffe17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f806d020 0x7f67f813ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ffe17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80700c0 0x7f67f81596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ffe17640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f814bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ffe17640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f67f80706b0 con 0x7f67f815bdd0 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ffe17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f67f8070530 con 0x7f67f806d020 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ffe17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f67f815c1b0 con 0x7f67f80700c0 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f814bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f814bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38814/0 (socket says 172.21.15.103:38814) 2024-08-18T23:57:22.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 -- 172.21.15.103:0/839822357 learned_addr learned my addr 172.21.15.103:0/839822357 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fdbb3640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f806d020 0x7f67f813ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fd3b2640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80700c0 0x7f67f81596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 -- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80700c0 msgr2=0x7f67f81596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80700c0 0x7f67f81596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 -- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f806d020 msgr2=0x7f67f813ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f806d020 0x7f67f813ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 -- 172.21.15.103:0/839822357 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f8159f20 con 0x7f67f815bdd0 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fd3b2640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80700c0 0x7f67f81596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67fe3b4640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f814bd10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67f000cd60 tx=0x7f67f000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ee7fc640 1 -- 172.21.15.103:0/839822357 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0003b90 con 0x7f67f815bdd0 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ee7fc640 1 -- 172.21.15.103:0/839822357 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f0003d50 con 0x7f67f815bdd0 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ee7fc640 1 -- 172.21.15.103:0/839822357 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0004260 con 0x7f67f815bdd0 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f815a200 con 0x7f67f815bdd0 2024-08-18T23:57:22.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.770+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f814dae0 con 0x7f67f815bdd0 2024-08-18T23:57:22.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.771+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67f80afc60 con 0x7f67f815bdd0 2024-08-18T23:57:22.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.772+0000 7f67ee7fc640 1 -- 172.21.15.103:0/839822357 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f67f0004400 con 0x7f67f815bdd0 2024-08-18T23:57:22.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.772+0000 7f67ee7fc640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f67dc06be30 0x7f67dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:22.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.772+0000 7f67ee7fc640 1 -- 172.21.15.103:0/839822357 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f67f008bca0 con 0x7f67f815bdd0 2024-08-18T23:57:22.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.772+0000 7f67fdbb3640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f67dc06be30 0x7f67dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:22.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.773+0000 7f67fdbb3640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f67dc06be30 0x7f67dc06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67f4034000 tx=0x7f67f402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:22.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.777+0000 7f67ee7fc640 1 -- 172.21.15.103:0/839822357 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f67f005a310 con 0x7f67f815bdd0 2024-08-18T23:57:22.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.978+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f67f814dcb0 con 0x7f67f815bdd0 2024-08-18T23:57:22.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.978+0000 7f67ee7fc640 1 -- 172.21.15.103:0/839822357 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f67f0059c10 con 0x7f67f815bdd0 2024-08-18T23:57:22.980 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f67dc06be30 msgr2=0x7f67dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f67dc06be30 0x7f67dc06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67f4034000 tx=0x7f67f402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 msgr2=0x7f67f814bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f814bd10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f67f000cd60 tx=0x7f67f000a660 comp rx=0 tx=0).stop 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 shutdown_connections 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f67dc06be30 0x7f67dc06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67f815bdd0 0x7f67f814bd10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67f80700c0 0x7f67f81596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 --2- 172.21.15.103:0/839822357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67f806d020 0x7f67f813ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:22.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 >> 172.21.15.103:0/839822357 conn(0x7f67f8071f00 msgr2=0x7f67f8158440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:22.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 shutdown_connections 2024-08-18T23:57:22.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:22.980+0000 7f67ffe17640 1 -- 172.21.15.103:0/839822357 wait complete. 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T23:57:22.993 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-18T23:57:22.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:22.993 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-08-18T23:57:23.009 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:23.009 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:23.009 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:23.009 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.009 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T23:57:23.010 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42849sec preferred_lft 42849sec 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 62:87:9d:8c:df:85 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3c73:aaff:fe53:bd/64 scope link 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T23:57:23.012 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 62:87:9d:8c:df:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:23.012 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::6087:9dff:fe8c:df85/64 scope link tentative 2024-08-18T23:57:23.012 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:23.012 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T23:57:23.073 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-08-18T23:57:23.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:23.075 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-08-18T23:57:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-08-18T23:57:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T23:57:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T23:57:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T23:57:23.132 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T23:57:23.132 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:23.132 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:23.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T23:57:23.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T23:57:23.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T23:57:23.132 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:23.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:23.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:23.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:23.259 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-18T23:57:23.274 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T23:57:23.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:23.275 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-08-18T23:57:23.331 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-18T23:57:23.331 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:23.331 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:23.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:23.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-18T23:57:23.331 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:23.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:23.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:23.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:23.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ee:78:9d:42:ed:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-18T23:57:23.472 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-18T23:57:23.473 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.473 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec78:9dff:fe42:ed2a/64 scope link 2024-08-18T23:57:23.473 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:23.474 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-18T23:57:23.538 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether ee:78:9d:42:ed:2a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.539 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec78:9dff:fe42:ed2a/64 scope link 2024-08-18T23:57:23.540 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:23.541 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-18T23:57:23.541 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:23.541 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:23.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-18T23:57:23.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-18T23:57:23.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-18T23:57:23.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-18T23:57:23.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-18T23:57:23.541 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:23.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:23.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:23.692 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:23.692 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:23.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.1 up 2024-08-18T23:57:23.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.1 master ceph-brx 2024-08-18T23:57:23.693 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:23.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:23.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:23.775 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-08-18T23:57:23.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:23.775 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-18T23:57:23.803 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-18T23:57:23.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:23.803 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-18T23:57:23.858 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-18T23:57:23.924 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:23.979 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-18T23:57:23.980 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-18T23:57:23.981 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:23.982 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:23.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:23.983 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-18T23:57:24.038 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-08-18T23:57:24.038 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-08-18T23:57:24.038 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-08-18T23:57:24.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-18T23:57:24.104 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:24.162 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-18T23:57:24.162 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-18T23:57:24.162 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-18T23:57:24.162 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-18T23:57:24.162 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-18T23:57:24.162 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-18T23:57:24.162 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-18T23:57:24.162 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:24.163 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:24.164 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:24.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:24.166 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-18T23:57:24.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi103.stderr:2024-08-18T23:57:24.161+0000 7fe8831e7480 -1 init, newargv = 0x55a5093886a0 newargc=15 2024-08-18T23:57:24.166 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi103.stderr:ceph-fuse[34828]: starting ceph client 2024-08-18T23:57:24.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi103.stderr:ceph-fuse[34828]: starting fuse 2024-08-18T23:57:24.182 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-08-18T23:57:24.182 INFO:teuthology.orchestra.run.smithi103.stdout:45 2024-08-18T23:57:24.182 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-08-18T23:57:24.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-08-18T23:57:24.182 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-08-18T23:57:24.182 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:24.183 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.2")) 2024-08-18T23:57:24.184 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-08-18T23:57:24.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:57:24.297 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:57:24.300 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.2.34828.asok 2024-08-18T23:57:24.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:24.311 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.34828.asok 2024-08-18T23:57:24.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:24.311 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.34828.asok status 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "2", 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "34828", 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:24.446 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4713, 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4713 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 80882210 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:24.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 80882210 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4713 192.168.0.2:0/80882210", 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/80882210", 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 9, 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 24, 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-08-18T23:57:24.448 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-08-18T23:57:24.449 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:57:24.455 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-18T23:57:24.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T23:57:24.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.553+0000 7fde74a30640 1 Processor -- start 2024-08-18T23:57:24.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.553+0000 7fde74a30640 1 -- start start 2024-08-18T23:57:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde74a30640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde700d4bc0 0x7fde700d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde74a30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde70160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde74a30640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde700d0860 con 0x7fde7015f8a0 2024-08-18T23:57:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde74a30640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fde700cfc00 con 0x7fde700d4bc0 2024-08-18T23:57:24.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde74a30640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fde700b32c0 con 0x7fde70160090 2024-08-18T23:57:24.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde6ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde70160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:24.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde6dd9b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde700d4bc0 0x7fde700d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde6e59c640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fde7015f8a0 0x7fde700d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:58986/0 (socket says 172.21.15.103:58986) 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde6ed9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde70160520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:50884/0 (socket says 172.21.15.103:50884) 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.554+0000 7fde6e59c640 1 -- 172.21.15.103:0/1164729054 learned_addr learned my addr 172.21.15.103:0/1164729054 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.555+0000 7fde6ed9d640 1 -- 172.21.15.103:0/1164729054 >> v2:172.21.15.190:3300/0 conn(0x7fde700d4bc0 msgr2=0x7fde700d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.555+0000 7fde6ed9d640 1 --2- 172.21.15.103:0/1164729054 >> v2:172.21.15.190:3300/0 conn(0x7fde700d4bc0 0x7fde700d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.555+0000 7fde6ed9d640 1 -- 172.21.15.103:0/1164729054 >> v1:172.21.15.190:6789/0 conn(0x7fde7015f8a0 legacy=0x7fde700d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.555+0000 7fde6ed9d640 1 -- 172.21.15.103:0/1164729054 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde700d0090 con 0x7fde70160090 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.555+0000 7fde6dd9b640 1 --2- 172.21.15.103:0/1164729054 >> v2:172.21.15.190:3300/0 conn(0x7fde700d4bc0 0x7fde700d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:24.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.555+0000 7fde6ed9d640 1 --2- 172.21.15.103:0/1164729054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde70160520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fde68009d90 tx=0x7fde6802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d922968bf70c97af server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:24.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde6d59a640 1 -- 172.21.15.103:0/1164729054 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68007740 con 0x7fde70160090 2024-08-18T23:57:24.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde6d59a640 1 -- 172.21.15.103:0/1164729054 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde680078e0 con 0x7fde70160090 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde6d59a640 1 -- 172.21.15.103:0/1164729054 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde68007cb0 con 0x7fde70160090 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde74a30640 1 -- 172.21.15.103:0/1164729054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 msgr2=0x7fde70160520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde74a30640 1 --2- 172.21.15.103:0/1164729054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde70160520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fde68009d90 tx=0x7fde6802a660 comp rx=0 tx=0).stop 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde74a30640 1 -- 172.21.15.103:0/1164729054 shutdown_connections 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde74a30640 1 --2- 172.21.15.103:0/1164729054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde70160520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde74a30640 1 --2- 172.21.15.103:0/1164729054 >> v2:172.21.15.190:3300/0 conn(0x7fde700d4bc0 0x7fde700d11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde74a30640 1 -- 172.21.15.103:0/1164729054 >> 172.21.15.103:0/1164729054 conn(0x7fde700d40a0 msgr2=0x7fde700d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde74a30640 1 -- 172.21.15.103:0/1164729054 shutdown_connections 2024-08-18T23:57:24.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.556+0000 7fde74a30640 1 -- 172.21.15.103:0/1164729054 wait complete. 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde74a30640 1 Processor -- start 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde74a30640 1 -- start start 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde74a30640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde700d4bc0 0x7fde70156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde74a30640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde7015f8a0 0x7fde701f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde74a30640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde7015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde74a30640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde700b2fb0 con 0x7fde7015f8a0 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde74a30640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fde700cf890 con 0x7fde700d4bc0 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde74a30640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fde7015fc80 con 0x7fde70160090 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.558+0000 7fde6dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde7015f8a0 0x7fde701f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:24.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6e59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde700d4bc0 0x7fde70156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde7015f8a0 0x7fde701f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47396/0 (socket says 172.21.15.103:47396) 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6dd9b640 1 -- 172.21.15.103:0/3974498942 learned_addr learned my addr 172.21.15.103:0/3974498942 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6ed9d640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde7015b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6dd9b640 1 -- 172.21.15.103:0/3974498942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 msgr2=0x7fde7015b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6dd9b640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde7015b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6dd9b640 1 -- 172.21.15.103:0/3974498942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde700d4bc0 msgr2=0x7fde70156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6dd9b640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde700d4bc0 0x7fde70156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6dd9b640 1 -- 172.21.15.103:0/3974498942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde701f4e60 con 0x7fde7015f8a0 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6e59c640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde700d4bc0 0x7fde70156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde6dd9b640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde7015f8a0 0x7fde701f4920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde6400e960 tx=0x7fde6400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde5effd640 1 -- 172.21.15.103:0/3974498942 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64017070 con 0x7fde7015f8a0 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde5effd640 1 -- 172.21.15.103:0/3974498942 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde6400c9a0 con 0x7fde7015f8a0 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde700b8950 con 0x7fde7015f8a0 2024-08-18T23:57:24.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde5effd640 1 -- 172.21.15.103:0/3974498942 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6400cd70 con 0x7fde7015f8a0 2024-08-18T23:57:24.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.559+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde700b8f10 con 0x7fde7015f8a0 2024-08-18T23:57:24.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.560+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde70160520 con 0x7fde7015f8a0 2024-08-18T23:57:24.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.561+0000 7fde5effd640 1 -- 172.21.15.103:0/3974498942 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde6401a070 con 0x7fde7015f8a0 2024-08-18T23:57:24.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.561+0000 7fde5effd640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde5006be60 0x7fde5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:24.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.561+0000 7fde5effd640 1 -- 172.21.15.103:0/3974498942 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fde6408af50 con 0x7fde7015f8a0 2024-08-18T23:57:24.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.561+0000 7fde6e59c640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde5006be60 0x7fde5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:24.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.561+0000 7fde6e59c640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde5006be60 0x7fde5006e320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde60007fd0 tx=0x7fde60007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:24.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.565+0000 7fde5effd640 1 -- 172.21.15.103:0/3974498942 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fde701f4e60 con 0x7fde7015f8a0 2024-08-18T23:57:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.767+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fde701612c0 con 0x7fde7015f8a0 2024-08-18T23:57:24.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.767+0000 7fde5effd640 1 -- 172.21.15.103:0/3974498942 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fde64058f70 con 0x7fde7015f8a0 2024-08-18T23:57:24.769 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T23:57:24.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde5006be60 msgr2=0x7fde5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:24.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde5006be60 0x7fde5006e320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde60007fd0 tx=0x7fde60007e80 comp rx=0 tx=0).stop 2024-08-18T23:57:24.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde7015f8a0 msgr2=0x7fde701f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:24.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde7015f8a0 0x7fde701f4920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fde6400e960 tx=0x7fde6400ee20 comp rx=0 tx=0).stop 2024-08-18T23:57:24.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 shutdown_connections 2024-08-18T23:57:24.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fde5006be60 0x7fde5006e320 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde70160090 0x7fde7015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde7015f8a0 0x7fde701f4920 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 --2- 172.21.15.103:0/3974498942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde700d4bc0 0x7fde70156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:24.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 >> 172.21.15.103:0/3974498942 conn(0x7fde700d40a0 msgr2=0x7fde7006ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:24.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 shutdown_connections 2024-08-18T23:57:24.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:24.769+0000 7fde74a30640 1 -- 172.21.15.103:0/3974498942 wait complete. 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T23:57:24.782 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-18T23:57:24.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:24.783 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:24.802 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42817sec preferred_lft 42817sec 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link noprefixroute 2024-08-18T23:57:24.803 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:24.803 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-18T23:57:24.803 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:24.804 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:24.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add name ceph-brx type bridge 2024-08-18T23:57:24.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr flush dev ceph-brx 2024-08-18T23:57:24.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set ceph-brx up 2024-08-18T23:57:24.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-18T23:57:24.804 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:24.897 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:25.004 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:25.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:25.012 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T23:57:25.037 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-08-18T23:57:25.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:25.039 DEBUG:teuthology.orchestra.run.smithi190:> route 2024-08-18T23:57:25.114 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2024-08-18T23:57:25.114 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T23:57:25.114 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T23:57:25.114 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T23:57:25.114 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T23:57:25.114 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:25.114 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:25.115 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T23:57:25.115 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T23:57:25.115 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T23:57:25.115 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:25.201 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:25.390 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:25.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:25.396 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-08-18T23:57:25.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:25.412 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2024-08-18T23:57:25.467 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:25.468 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:25.468 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:25.468 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-18T23:57:25.468 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:25.556 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:25.581 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:25.587 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-18T23:57:25.587 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:25.587 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:25.588 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-18T23:57:25.588 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-18T23:57:25.588 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-18T23:57:25.588 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-18T23:57:25.588 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-18T23:57:25.588 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:25.638 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:25.724 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:25.730 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:25.730 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:25.730 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.0 up 2024-08-18T23:57:25.730 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.0 master ceph-brx 2024-08-18T23:57:25.730 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:25.781 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:25.803 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:25.810 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-18T23:57:25.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:25.810 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:25.825 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-18T23:57:25.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:25.826 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:25.881 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2024-08-18T23:57:25.948 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2024-08-18T23:57:26.004 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/selinux 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:26.005 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2024-08-18T23:57:26.006 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:26.007 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:26.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:26.007 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2024-08-18T23:57:26.058 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-18T23:57:26.059 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-18T23:57:26.101 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2024-08-18T23:57:26.125 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:26.182 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2024-08-18T23:57:26.182 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2024-08-18T23:57:26.182 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2024-08-18T23:57:26.182 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2024-08-18T23:57:26.182 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2024-08-18T23:57:26.182 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2024-08-18T23:57:26.182 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2024-08-18T23:57:26.182 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/selinux 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:26.183 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:26.184 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:26.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:26.185 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2024-08-18T23:57:26.221 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:2024-08-18T23:57:26.220+0000 7fe7fff2b480 -1 init, newargv = 0x55b59e9635a0 newargc=15 2024-08-18T23:57:26.221 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:ceph-fuse[30634]: starting ceph client 2024-08-18T23:57:26.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi190.stderr:ceph-fuse[30634]: starting fuse 2024-08-18T23:57:26.236 INFO:teuthology.orchestra.run.smithi190.stdout:44 2024-08-18T23:57:26.236 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> sudo stdin-killer -- python3 -c ' 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> import glob 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> import re 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> import os 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> import subprocess 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> def _find_admin_socket(client_name): 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> files = glob.glob(asok_path) 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-18T23:57:26.237 DEBUG:teuthology.orchestra.run.smithi190:> 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> # Given a non-glob path, it better be there 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> if "*" not in asok_path: 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> assert(len(files) == 1) 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> return files[0] 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> for f in files: 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> contents = proc_f.read() 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> if mountpoint in contents: 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> return f 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T23:57:26.238 DEBUG:teuthology.orchestra.run.smithi190:> 2024-08-18T23:57:26.239 DEBUG:teuthology.orchestra.run.smithi190:> print(_find_admin_socket("client.1")) 2024-08-18T23:57:26.239 DEBUG:teuthology.orchestra.run.smithi190:> ' 2024-08-18T23:57:26.354 INFO:teuthology.orchestra.run.smithi190.stdout:/var/run/ceph/ceph-client.1.30634.asok 2024-08-18T23:57:26.357 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:26.364 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.30634.asok 2024-08-18T23:57:26.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:26.365 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.30634.asok status 2024-08-18T23:57:26.499 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-08-18T23:57:26.499 INFO:teuthology.orchestra.run.smithi190.stdout: "metadata": { 2024-08-18T23:57:26.499 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T23:57:26.499 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "entity_id": "1", 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "hostname": "smithi190", 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "pid": "30634", 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "root": "/" 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_count": 0, 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_pinned_count": 0, 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4672, 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "inst": { 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "name": { 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "client", 2024-08-18T23:57:26.500 INFO:teuthology.orchestra.run.smithi190.stdout: "num": 4672 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.1:0", 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 3283511861 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.1:0", 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 3283511861 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "inst_str": "client.4672 192.168.0.1:0/3283511861", 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "addr_str": "192.168.0.1:0/3283511861", 2024-08-18T23:57:26.501 INFO:teuthology.orchestra.run.smithi190.stdout: "inode_count": 1, 2024-08-18T23:57:26.502 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_epoch": 9, 2024-08-18T23:57:26.502 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch": 24, 2024-08-18T23:57:26.502 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch_barrier": 0, 2024-08-18T23:57:26.502 INFO:teuthology.orchestra.run.smithi190.stdout: "blocklisted": false, 2024-08-18T23:57:26.502 INFO:teuthology.orchestra.run.smithi190.stdout: "fs_name": "cephfs" 2024-08-18T23:57:26.502 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-08-18T23:57:26.507 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-18T23:57:26.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T23:57:26.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.617+0000 7f7535b33640 1 Processor -- start 2024-08-18T23:57:26.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.617+0000 7f7535b33640 1 -- start start 2024-08-18T23:57:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.618+0000 7f7535b33640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75300b4370 0x7f75300ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.618+0000 7f7535b33640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7530072610 con 0x7f753015ade0 2024-08-18T23:57:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.618+0000 7f7535b33640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75300728f0 con 0x7f753006f770 2024-08-18T23:57:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.618+0000 7f7535b33640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f753006db10 con 0x7f75300b4370 2024-08-18T23:57:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.618+0000 7f752ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75300b4370 0x7f75300ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.618+0000 7f752ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f75300b4370 0x7f75300ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47402/0 (socket says 172.21.15.103:47402) 2024-08-18T23:57:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.618+0000 7f752ffff640 1 -- 172.21.15.103:0/3910221861 learned_addr learned my addr 172.21.15.103:0/3910221861 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:26.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.619+0000 7f752ffff640 1 -- 172.21.15.103:0/3910221861 >> v1:172.21.15.190:6789/0 conn(0x7f753006f770 legacy=0x7f75300ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.619+0000 7f752ffff640 1 -- 172.21.15.103:0/3910221861 >> v1:172.21.15.103:6789/0 conn(0x7f753015ade0 legacy=0x7f753006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.619+0000 7f752e7fc640 1 -- 172.21.15.103:0/3910221861 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796628004 0 0) 0x7f7530072610 con 0x7f753015ade0 2024-08-18T23:57:26.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.619+0000 7f752ffff640 1 -- 172.21.15.103:0/3910221861 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7530072bd0 con 0x7f75300b4370 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.619+0000 7f752ffff640 1 --2- 172.21.15.103:0/3910221861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75300b4370 0x7f75300ae0e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7528009e50 tx=0x7f752802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc7767c2d4d6978 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.619+0000 7f752e7fc640 1 -- 172.21.15.103:0/3910221861 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528036070 con 0x7f75300b4370 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.619+0000 7f752e7fc640 1 -- 172.21.15.103:0/3910221861 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7528031600 con 0x7f75300b4370 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.619+0000 7f752e7fc640 1 -- 172.21.15.103:0/3910221861 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75280319d0 con 0x7f75300b4370 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.620+0000 7f7535b33640 1 -- 172.21.15.103:0/3910221861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75300b4370 msgr2=0x7f75300ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.620+0000 7f7535b33640 1 --2- 172.21.15.103:0/3910221861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75300b4370 0x7f75300ae0e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7528009e50 tx=0x7f752802a730 comp rx=0 tx=0).stop 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.620+0000 7f7535b33640 1 -- 172.21.15.103:0/3910221861 shutdown_connections 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.620+0000 7f7535b33640 1 --2- 172.21.15.103:0/3910221861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f75300b4370 0x7f75300ae0e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:26.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.620+0000 7f7535b33640 1 -- 172.21.15.103:0/3910221861 >> 172.21.15.103:0/3910221861 conn(0x7f75300cfc40 msgr2=0x7f75300d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:26.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.620+0000 7f7535b33640 1 -- 172.21.15.103:0/3910221861 shutdown_connections 2024-08-18T23:57:26.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.620+0000 7f7535b33640 1 -- 172.21.15.103:0/3910221861 wait complete. 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.621+0000 7f7535b33640 1 Processor -- start 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.621+0000 7f7535b33640 1 -- start start 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f7535b33640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753006f770 0x7f75301e46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f7535b33640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75300b4370 0x7f75300ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f7535b33640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753015ade0 0x7f753009cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f7535b33640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f753006d6c0 con 0x7f753006f770 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f7535b33640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f753015b1c0 con 0x7f753015ade0 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f7535b33640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f753006d840 con 0x7f75300b4370 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f752f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753006f770 0x7f75301e46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f752f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753006f770 0x7f75301e46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47408/0 (socket says 172.21.15.103:47408) 2024-08-18T23:57:26.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f752f7fe640 1 -- 172.21.15.103:0/3438841804 learned_addr learned my addr 172.21.15.103:0/3438841804 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f752ffff640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753015ade0 0x7f753009cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.622+0000 7f752effd640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75300b4370 0x7f75300ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f752f7fe640 1 -- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75300b4370 msgr2=0x7f75300ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f752f7fe640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75300b4370 0x7f75300ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f752f7fe640 1 -- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753015ade0 msgr2=0x7f753009cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f752f7fe640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753015ade0 0x7f753009cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f752f7fe640 1 -- 172.21.15.103:0/3438841804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753009e100 con 0x7f753006f770 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f752effd640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75300b4370 0x7f75300ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f752f7fe640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753006f770 0x7f75301e46e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f752000c3c0 tx=0x7f752000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f7517fff640 1 -- 172.21.15.103:0/3438841804 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520017070 con 0x7f753006f770 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f7517fff640 1 -- 172.21.15.103:0/3438841804 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75200035f0 con 0x7f753006f770 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75301e4c20 con 0x7f753006f770 2024-08-18T23:57:26.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f7517fff640 1 -- 172.21.15.103:0/3438841804 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75200039e0 con 0x7f753006f770 2024-08-18T23:57:26.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.623+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75300cf7a0 con 0x7f753006f770 2024-08-18T23:57:26.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.624+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75300b47b0 con 0x7f753006f770 2024-08-18T23:57:26.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.625+0000 7f7517fff640 1 -- 172.21.15.103:0/3438841804 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f752001a070 con 0x7f753006f770 2024-08-18T23:57:26.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.625+0000 7f7517fff640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f751c06be30 0x7f751c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:26.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.625+0000 7f7517fff640 1 -- 172.21.15.103:0/3438841804 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f752008a430 con 0x7f753006f770 2024-08-18T23:57:26.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.625+0000 7f752effd640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f751c06be30 0x7f751c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:26.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.625+0000 7f752effd640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f751c06be30 0x7f751c06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7524007fd0 tx=0x7f7524009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:26.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.629+0000 7f7517fff640 1 -- 172.21.15.103:0/3438841804 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f75200584e0 con 0x7f753006f770 2024-08-18T23:57:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.831+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f75300b04f0 con 0x7f753006f770 2024-08-18T23:57:26.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.831+0000 7f7517fff640 1 -- 172.21.15.103:0/3438841804 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f752005c7e0 con 0x7f753006f770 2024-08-18T23:57:26.833 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f751c06be30 msgr2=0x7f751c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f751c06be30 0x7f751c06e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7524007fd0 tx=0x7f7524009040 comp rx=0 tx=0).stop 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753006f770 msgr2=0x7f75301e46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753006f770 0x7f75301e46e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f752000c3c0 tx=0x7f752000c880 comp rx=0 tx=0).stop 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 shutdown_connections 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f751c06be30 0x7f751c06e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f753015ade0 0x7f753009cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75300b4370 0x7f75300ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 --2- 172.21.15.103:0/3438841804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f753006f770 0x7f75301e46e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 >> 172.21.15.103:0/3438841804 conn(0x7f75300cfc40 msgr2=0x7f75300ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:26.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 shutdown_connections 2024-08-18T23:57:26.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:26.833+0000 7f7535b33640 1 -- 172.21.15.103:0/3438841804 wait complete. 2024-08-18T23:57:26.845 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T23:57:26.845 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T23:57:26.845 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2024-08-18T23:57:26.846 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-18T23:57:26.846 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-18T23:57:26.846 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T23:57:26.846 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T23:57:26.846 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T23:57:26.846 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-18T23:57:26.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:26.846 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2024-08-18T23:57:26.862 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f0 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout: altname enp7s0f1 2024-08-18T23:57:26.863 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42815sec preferred_lft 42815sec 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::ec4:7aff:fe88:7763/64 scope link noprefixroute 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 26:6a:ca:e9:ae:50 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::a0c0:68ff:fee3:ad78/64 scope link 2024-08-18T23:57:26.864 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:26.865 INFO:teuthology.orchestra.run.smithi190.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T23:57:26.865 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 26:6a:ca:e9:ae:50 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:26.865 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::246a:caff:fee9:ae50/64 scope link tentative 2024-08-18T23:57:26.865 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:26.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:26.865 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T23:57:26.927 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-08-18T23:57:26.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:26.929 DEBUG:teuthology.orchestra.run.smithi190:> route 2024-08-18T23:57:26.985 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2024-08-18T23:57:26.985 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T23:57:26.985 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T23:57:26.985 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T23:57:26.985 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T23:57:26.985 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:26.986 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:26.986 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T23:57:26.986 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T23:57:26.986 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T23:57:26.986 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:27.072 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:27.105 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:27.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:27.111 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-08-18T23:57:27.126 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-18T23:57:27.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:27.127 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2024-08-18T23:57:27.182 INFO:teuthology.orchestra.run.smithi190.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-18T23:57:27.182 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:27.182 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:27.182 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-18T23:57:27.182 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-18T23:57:27.182 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:27.269 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:27.291 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:27.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:27.297 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-18T23:57:27.321 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:27.321 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 7e:8e:c5:e4:87:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::7c8e:c5ff:fee4:876b/64 scope link 2024-08-18T23:57:27.322 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:27.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:27.323 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-18T23:57:27.388 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:27.388 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:27.388 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:27.388 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:27.388 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:27.389 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:27.389 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T23:57:27.389 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 7e:8e:c5:e4:87:6b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-18T23:57:27.389 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-18T23:57:27.389 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:27.389 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::7c8e:c5ff:fee4:876b/64 scope link 2024-08-18T23:57:27.389 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:27.390 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-18T23:57:27.390 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:27.390 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:27.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-18T23:57:27.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-18T23:57:27.390 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-18T23:57:27.391 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-18T23:57:27.391 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-18T23:57:27.391 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:27.477 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:27.536 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:27.542 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:27.542 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2024-08-18T23:57:27.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.1 up 2024-08-18T23:57:27.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.1 master ceph-brx 2024-08-18T23:57:27.542 DEBUG:teuthology.orchestra.run.smithi190:> ') 2024-08-18T23:57:27.589 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:27.612 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:27.618 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-08-18T23:57:27.618 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:27.618 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-18T23:57:27.633 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-18T23:57:27.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:27.633 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-18T23:57:27.688 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2024-08-18T23:57:27.753 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:27.810 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2024-08-18T23:57:27.810 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2024-08-18T23:57:27.810 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2024-08-18T23:57:27.810 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/selinux 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2024-08-18T23:57:27.811 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2024-08-18T23:57:27.812 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:27.813 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:27.813 INFO:teuthology.orchestra.run.smithi190.stdout:/home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:27.813 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-18T23:57:27.813 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-18T23:57:27.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:27.813 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2024-08-18T23:57:27.865 INFO:teuthology.orchestra.run.smithi190.stdout:44 2024-08-18T23:57:27.866 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [44] 2024-08-18T23:57:27.866 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-08-18T23:57:27.908 DEBUG:teuthology.orchestra.run.smithi190:> sudo modprobe fuse 2024-08-18T23:57:27.932 DEBUG:teuthology.orchestra.run.smithi190:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:27.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:2024-08-18T23:57:27.988+0000 7fd3b7a7a480 -1 init, newargv = 0x55fa5305c0c0 newargc=15 2024-08-18T23:57:27.989 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:ceph-fuse[31073]: starting ceph client 2024-08-18T23:57:27.990 INFO:teuthology.orchestra.run.smithi190.stdout:/proc 2024-08-18T23:57:27.990 INFO:teuthology.orchestra.run.smithi190.stdout:/sys 2024-08-18T23:57:27.990 INFO:teuthology.orchestra.run.smithi190.stdout:/dev 2024-08-18T23:57:27.990 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/security 2024-08-18T23:57:27.990 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/shm 2024-08-18T23:57:27.990 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/pts 2024-08-18T23:57:27.990 INFO:teuthology.orchestra.run.smithi190.stdout:/run 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/cgroup 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/pstore 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/bpf 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/ 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/selinux 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/debug 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/mqueue 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/tracing 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/dev/hugepages 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/kernel/config 2024-08-18T23:57:27.991 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/run/user/1000 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-4 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-5 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-6 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/var/lib/ceph/osd/ceph-7 2024-08-18T23:57:27.992 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns 2024-08-18T23:57:27.993 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:27.993 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:57:27.993 INFO:teuthology.orchestra.run.smithi190.stdout:/home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:27.993 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-18T23:57:27.993 INFO:teuthology.orchestra.run.smithi190.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-18T23:57:27.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:27.993 DEBUG:teuthology.orchestra.run.smithi190:> ls /sys/fs/fuse/connections 2024-08-18T23:57:27.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi190.stderr:ceph-fuse[31073]: starting fuse 2024-08-18T23:57:28.008 INFO:teuthology.orchestra.run.smithi190.stdout:44 2024-08-18T23:57:28.008 INFO:teuthology.orchestra.run.smithi190.stdout:45 2024-08-18T23:57:28.009 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44, 45] 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> sudo stdin-killer -- python3 -c ' 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> import glob 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> import re 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> import os 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> import subprocess 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> def _find_admin_socket(client_name): 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> files = glob.glob(asok_path) 2024-08-18T23:57:28.009 DEBUG:teuthology.orchestra.run.smithi190:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> # Given a non-glob path, it better be there 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> if "*" not in asok_path: 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> assert(len(files) == 1) 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> return files[0] 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> for f in files: 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T23:57:28.010 DEBUG:teuthology.orchestra.run.smithi190:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T23:57:28.011 DEBUG:teuthology.orchestra.run.smithi190:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T23:57:28.011 DEBUG:teuthology.orchestra.run.smithi190:> contents = proc_f.read() 2024-08-18T23:57:28.011 DEBUG:teuthology.orchestra.run.smithi190:> if mountpoint in contents: 2024-08-18T23:57:28.011 DEBUG:teuthology.orchestra.run.smithi190:> return f 2024-08-18T23:57:28.011 DEBUG:teuthology.orchestra.run.smithi190:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T23:57:28.011 DEBUG:teuthology.orchestra.run.smithi190:> 2024-08-18T23:57:28.011 DEBUG:teuthology.orchestra.run.smithi190:> print(_find_admin_socket("client.3")) 2024-08-18T23:57:28.011 DEBUG:teuthology.orchestra.run.smithi190:> ' 2024-08-18T23:57:28.126 INFO:teuthology.orchestra.run.smithi190.stdout:/var/run/ceph/ceph-client.3.31073.asok 2024-08-18T23:57:28.129 INFO:teuthology.orchestra.run.smithi190.stderr:2024-08-18T23:57:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:28.137 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.31073.asok 2024-08-18T23:57:28.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.137 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.31073.asok status 2024-08-18T23:57:28.269 INFO:teuthology.orchestra.run.smithi190.stdout:{ 2024-08-18T23:57:28.269 INFO:teuthology.orchestra.run.smithi190.stdout: "metadata": { 2024-08-18T23:57:28.269 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: "entity_id": "3", 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: "hostname": "smithi190", 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: "pid": "31073", 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: "root": "/" 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_count": 0, 2024-08-18T23:57:28.270 INFO:teuthology.orchestra.run.smithi190.stdout: "dentry_pinned_count": 0, 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "id": 4687, 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "inst": { 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "name": { 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "client", 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "num": 4687 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.2:0", 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 2011740893 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: } 2024-08-18T23:57:28.271 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": { 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "type": "v1", 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "addr": "192.168.0.2:0", 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "nonce": 2011740893 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: }, 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "inst_str": "client.4687 192.168.0.2:0/2011740893", 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "addr_str": "192.168.0.2:0/2011740893", 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "inode_count": 1, 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "mds_epoch": 9, 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch": 24, 2024-08-18T23:57:28.272 INFO:teuthology.orchestra.run.smithi190.stdout: "osd_epoch_barrier": 0, 2024-08-18T23:57:28.273 INFO:teuthology.orchestra.run.smithi190.stdout: "blocklisted": false, 2024-08-18T23:57:28.273 INFO:teuthology.orchestra.run.smithi190.stdout: "fs_name": "cephfs" 2024-08-18T23:57:28.273 INFO:teuthology.orchestra.run.smithi190.stdout:} 2024-08-18T23:57:28.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.278 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-08-18T23:57:28.278 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:28.297 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-08-18T23:57:28.297 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:28.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:28.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.367 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-08-18T23:57:28.367 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.2 2024-08-18T23:57:28.425 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-08-18T23:57:28.425 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-08-18T23:57:28.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.425 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-18T23:57:28.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.494 DEBUG:teuthology.orchestra.run.smithi190:> stat --file-system '--printf=%T 2024-08-18T23:57:28.494 DEBUG:teuthology.orchestra.run.smithi190:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:28.510 INFO:teuthology.orchestra.run.smithi190.stdout:fuseblk 2024-08-18T23:57:28.510 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:28.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.510 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:28.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.575 DEBUG:teuthology.orchestra.run.smithi190:> stat --file-system '--printf=%T 2024-08-18T23:57:28.575 DEBUG:teuthology.orchestra.run.smithi190:> ' -- /home/ubuntu/cephtest/mnt.3 2024-08-18T23:57:28.631 INFO:teuthology.orchestra.run.smithi190.stdout:fuseblk 2024-08-18T23:57:28.632 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-08-18T23:57:28.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:28.632 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-18T23:57:28.696 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-18T23:57:28.743 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2024-08-18T23:57:28.743 INFO:tasks.cephfs_test_runner:test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-08-18T23:57:28.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.853+0000 7ff123944640 1 Processor -- start 2024-08-18T23:57:28.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.854+0000 7ff123944640 1 -- start start 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.854+0000 7ff123944640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0af050 0x7ff11c166b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.854+0000 7ff123944640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11c071a80 con 0x7ff11c15c980 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.854+0000 7ff123944640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11c071d60 con 0x7ff11c073230 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.854+0000 7ff123944640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c072690 con 0x7ff11c0af050 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff1216e0640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff11c15c980 0x7ff11c072b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56344/0 (socket says 172.21.15.103:56344) 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff1216e0640 1 -- 172.21.15.103:0/421349278 learned_addr learned my addr 172.21.15.103:0/421349278 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff121ee1640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0af050 0x7ff11c166b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 749015116 0 0) 0x7ff11c071a80 con 0x7ff11c15c980 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff108003520 con 0x7ff11c15c980 2024-08-18T23:57:28.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 888795619 0 0) 0x7ff11c071d60 con 0x7ff11c073230 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff11c071a80 con 0x7ff11c073230 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1163602081 0 0) 0x7ff108003520 con 0x7ff11c15c980 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0af050 msgr2=0x7ff11c166b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0af050 0x7ff11c166b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 >> v1:172.21.15.190:6789/0 conn(0x7ff11c073230 legacy=0x7ff11c0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c072040 con 0x7ff11c15c980 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7ff118001670 con 0x7ff11c15c980 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 >> v1:172.21.15.103:6789/0 conn(0x7ff11c15c980 legacy=0x7ff11c072b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff108003b70 0x7ff108003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff108004800 0x7ff108004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1080051c0 0x7ff10800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c072690 con 0x7ff1080051c0 2024-08-18T23:57:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff10800bfb0 con 0x7ff108004800 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff10800c1b0 con 0x7ff108003b70 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff121ee1640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c0af050 0x7ff11c166b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff120edf640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff108004800 0x7ff108004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.855+0000 7ff121ee1640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1080051c0 0x7ff10800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.856+0000 7ff1216e0640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff108003b70 0x7ff108003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.856+0000 7ff120edf640 1 -- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff108003b70 msgr2=0x7ff108003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.856+0000 7ff120edf640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff108003b70 0x7ff108003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.856+0000 7ff120edf640 1 -- 172.21.15.103:0/421349278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1080051c0 msgr2=0x7ff10800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.856+0000 7ff120edf640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1080051c0 0x7ff10800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.856+0000 7ff120edf640 1 -- 172.21.15.103:0/421349278 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff108003520 con 0x7ff108004800 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.856+0000 7ff121ee1640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1080051c0 0x7ff10800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff120edf640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff108004800 0x7ff108004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0018a0 tx=0x7ff108005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=776c125ed2a904b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:28.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0014f0 con 0x7ff108004800 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff10c0052d0 con 0x7ff108004800 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff113fff640 1 -- 172.21.15.103:0/421349278 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c02ac60 con 0x7ff108004800 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff123944640 1 -- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff108004800 msgr2=0x7ff108004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff123944640 1 --2- 172.21.15.103:0/421349278 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff108004800 0x7ff108004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff10c0018a0 tx=0x7ff108005830 comp rx=0 tx=0).stop 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff121ee1640 1 -- 172.21.15.103:0/421349278 reap_dead start 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff123944640 1 -- 172.21.15.103:0/421349278 shutdown_connections 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff123944640 1 -- 172.21.15.103:0/421349278 >> 172.21.15.103:0/421349278 conn(0x7ff11c0cfc40 msgr2=0x7ff11c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff123944640 1 -- 172.21.15.103:0/421349278 shutdown_connections 2024-08-18T23:57:28.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.857+0000 7ff123944640 1 -- 172.21.15.103:0/421349278 wait complete. 2024-08-18T23:57:28.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff123944640 1 Processor -- start 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff123944640 1 -- start start 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff123944640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff108004800 0x7ff11c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff123944640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c156ec0 0x7ff11c155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff123944640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c1588b0 0x7ff11c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff123944640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0ad0b0 con 0x7ff108004800 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff123944640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0acf30 con 0x7ff11c1588b0 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff123944640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c0716a0 con 0x7ff11c156ec0 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff1216e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff108004800 0x7ff11c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff1216e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff108004800 0x7ff11c155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47424/0 (socket says 172.21.15.103:47424) 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.859+0000 7ff1216e0640 1 -- 172.21.15.103:0/963412666 learned_addr learned my addr 172.21.15.103:0/963412666 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff121ee1640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c1588b0 0x7ff11c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff120edf640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c156ec0 0x7ff11c155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:28.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff1216e0640 1 -- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c156ec0 msgr2=0x7ff11c155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff1216e0640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c156ec0 0x7ff11c155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff1216e0640 1 -- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c1588b0 msgr2=0x7ff11c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff1216e0640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c1588b0 0x7ff11c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff1216e0640 1 -- 172.21.15.103:0/963412666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c159830 con 0x7ff108004800 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff120edf640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c156ec0 0x7ff11c155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff1216e0640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff108004800 0x7ff11c155e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1180073a0 tx=0x7ff118007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff111ffb640 1 -- 172.21.15.103:0/963412666 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11801a070 con 0x7ff108004800 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff111ffb640 1 -- 172.21.15.103:0/963412666 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff11800f9c0 con 0x7ff108004800 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c0cd870 con 0x7ff108004800 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff111ffb640 1 -- 172.21.15.103:0/963412666 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11800fdb0 con 0x7ff108004800 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.860+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c0cde30 con 0x7ff108004800 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.861+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c0ae940 con 0x7ff108004800 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.862+0000 7ff111ffb640 1 -- 172.21.15.103:0/963412666 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff11801d070 con 0x7ff108004800 2024-08-18T23:57:28.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.862+0000 7ff111ffb640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff10006be30 0x7ff10006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:28.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.862+0000 7ff111ffb640 1 -- 172.21.15.103:0/963412666 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff11808aad0 con 0x7ff108004800 2024-08-18T23:57:28.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.862+0000 7ff120edf640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff10006be30 0x7ff10006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:28.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.863+0000 7ff120edf640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff10006be30 0x7ff10006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff10c032000 tx=0x7ff10c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:28.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:28.867+0000 7ff111ffb640 1 -- 172.21.15.103:0/963412666 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff11c159830 con 0x7ff108004800 2024-08-18T23:57:29.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.033+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff11c15a370 con 0x7ff108004800 2024-08-18T23:57:29.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.034+0000 7ff111ffb640 1 -- 172.21.15.103:0/963412666 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7ff118058af0 con 0x7ff108004800 2024-08-18T23:57:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:29.036 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":24,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:56:58.135358+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:29.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff10006be30 msgr2=0x7ff10006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff10006be30 0x7ff10006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff10c032000 tx=0x7ff10c009030 comp rx=0 tx=0).stop 2024-08-18T23:57:29.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff108004800 msgr2=0x7ff11c155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff108004800 0x7ff11c155e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff1180073a0 tx=0x7ff118007860 comp rx=0 tx=0).stop 2024-08-18T23:57:29.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 shutdown_connections 2024-08-18T23:57:29.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff10006be30 0x7ff10006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff11c1588b0 0x7ff11c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff11c156ec0 0x7ff11c155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 --2- 172.21.15.103:0/963412666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff108004800 0x7ff11c155e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 >> 172.21.15.103:0/963412666 conn(0x7ff11c0cfc40 msgr2=0x7ff11c152250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:29.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 shutdown_connections 2024-08-18T23:57:29.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.036+0000 7ff123944640 1 -- 172.21.15.103:0/963412666 wait complete. 2024-08-18T23:57:29.049 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-18T23:56:42.194634+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-18T23:56:50.890421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-18T23:56:52.058126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-18T23:56:55.790060+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-18T23:57:29.050 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-18T23:57:29.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.150+0000 7f5f0e88f640 1 Processor -- start 2024-08-18T23:57:29.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.150+0000 7f5f0e88f640 1 -- start start 2024-08-18T23:57:29.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0e88f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f0806b900 0x7f5f0806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0e88f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5f080c5520 0x7f5f08071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0e88f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0806c220 con 0x7f5f080c50e0 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0e88f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5f080c4c50 con 0x7f5f080c5520 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0e88f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5f08159e80 con 0x7f5f0806b900 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0ce2c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5f080c5520 0x7f5f08071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0ce2c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5f080c5520 0x7f5f08071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47434/0 (socket says 172.21.15.103:47434) 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0ce2c640 1 -- 172.21.15.103:0/1177233718 learned_addr learned my addr 172.21.15.103:0/1177233718 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f07fff640 1 --2- 172.21.15.103:0/1177233718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f0806b900 0x7f5f0806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0ce2c640 1 -- 172.21.15.103:0/1177233718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f0806b900 msgr2=0x7f5f0806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0ce2c640 1 --2- 172.21.15.103:0/1177233718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f0806b900 0x7f5f0806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0ce2c640 1 -- 172.21.15.103:0/1177233718 >> v1:172.21.15.190:6789/0 conn(0x7f5f080c50e0 legacy=0x7f5f0815fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.151+0000 7f5f0ce2c640 1 -- 172.21.15.103:0/1177233718 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f080cb5e0 con 0x7f5f080c5520 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f0ce2c640 1 --2- 172.21.15.103:0/1177233718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c5520 0x7f5f08071530 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009e50 tx=0x7f5f0002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07d0dd0e23a6194 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f06ffd640 1 -- 172.21.15.103:0/1177233718 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00036070 con 0x7f5f080c5520 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f06ffd640 1 -- 172.21.15.103:0/1177233718 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f00031600 con 0x7f5f080c5520 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f06ffd640 1 -- 172.21.15.103:0/1177233718 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f000319d0 con 0x7f5f080c5520 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f0e88f640 1 -- 172.21.15.103:0/1177233718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c5520 msgr2=0x7f5f08071530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/1177233718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c5520 0x7f5f08071530 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009e50 tx=0x7f5f0002a710 comp rx=0 tx=0).stop 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f0e88f640 1 -- 172.21.15.103:0/1177233718 shutdown_connections 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/1177233718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c5520 0x7f5f08071530 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/1177233718 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f0806b900 0x7f5f0806bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.152+0000 7f5f0e88f640 1 -- 172.21.15.103:0/1177233718 >> 172.21.15.103:0/1177233718 conn(0x7f5f080cc6e0 msgr2=0x7f5f080ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:29.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.153+0000 7f5f0e88f640 1 -- 172.21.15.103:0/1177233718 shutdown_connections 2024-08-18T23:57:29.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.153+0000 7f5f0e88f640 1 -- 172.21.15.103:0/1177233718 wait complete. 2024-08-18T23:57:29.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.154+0000 7f5f0e88f640 1 Processor -- start 2024-08-18T23:57:29.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.154+0000 7f5f0e88f640 1 -- start start 2024-08-18T23:57:29.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0e88f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f0806b900 0x7f5f0815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0e88f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c50e0 0x7f5f080cea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0e88f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f080c5520 0x7f5f080cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0e88f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5f080cbe80 con 0x7f5f080c50e0 2024-08-18T23:57:29.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0e88f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5f080cbba0 con 0x7f5f0806b900 2024-08-18T23:57:29.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0e88f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5f08160120 con 0x7f5f080c5520 2024-08-18T23:57:29.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c50e0 0x7f5f080cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c50e0 0x7f5f080cea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47436/0 (socket says 172.21.15.103:47436) 2024-08-18T23:57:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 -- 172.21.15.103:0/2169431529 learned_addr learned my addr 172.21.15.103:0/2169431529 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0ce2c640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f080c5520 0x7f5f080cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f07fff640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f0806b900 0x7f5f0815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 -- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f080c5520 msgr2=0x7f5f080cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f080c5520 0x7f5f080cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 -- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f0806b900 msgr2=0x7f5f0815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f0806b900 0x7f5f0815abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 -- 172.21.15.103:0/2169431529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f080cf790 con 0x7f5f080c50e0 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f07fff640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f0806b900 0x7f5f0815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f077fe640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c50e0 0x7f5f080cea20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00c440 tx=0x7f5efc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f04ff9640 1 -- 172.21.15.103:0/2169431529 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0052d0 con 0x7f5f080c50e0 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f04ff9640 1 -- 172.21.15.103:0/2169431529 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc005470 con 0x7f5f080c50e0 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f080ce600 con 0x7f5f080c50e0 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f04ff9640 1 -- 172.21.15.103:0/2169431529 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc007260 con 0x7f5f080c50e0 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.155+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f080cde00 con 0x7f5f080c50e0 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.156+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f0806bce0 con 0x7f5f080c50e0 2024-08-18T23:57:29.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.157+0000 7f5f04ff9640 1 -- 172.21.15.103:0/2169431529 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5efc007400 con 0x7f5f080c50e0 2024-08-18T23:57:29.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.157+0000 7f5f04ff9640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ef406be30 0x7f5ef406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.157+0000 7f5f04ff9640 1 -- 172.21.15.103:0/2169431529 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5efc08a610 con 0x7f5f080c50e0 2024-08-18T23:57:29.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.157+0000 7f5f07fff640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ef406be30 0x7f5ef406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.158+0000 7f5f07fff640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ef406be30 0x7f5ef406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8006fd0 tx=0x7f5ef8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.162+0000 7f5f04ff9640 1 -- 172.21.15.103:0/2169431529 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5efc058630 con 0x7f5f080c50e0 2024-08-18T23:57:29.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.327+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f080cd8f0 con 0x7f5f080c50e0 2024-08-18T23:57:29.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.327+0000 7f5f04ff9640 1 -- 172.21.15.103:0/2169431529 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f5efc05c930 con 0x7f5f080c50e0 2024-08-18T23:57:29.329 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ef406be30 msgr2=0x7f5ef406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ef406be30 0x7f5ef406e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8006fd0 tx=0x7f5ef8008040 comp rx=0 tx=0).stop 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c50e0 msgr2=0x7f5f080cea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c50e0 0x7f5f080cea20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5efc00c440 tx=0x7f5efc001e70 comp rx=0 tx=0).stop 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 shutdown_connections 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ef406be30 0x7f5ef406e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f080c5520 0x7f5f080cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080c50e0 0x7f5f080cea20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 --2- 172.21.15.103:0/2169431529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f0806b900 0x7f5f0815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 >> 172.21.15.103:0/2169431529 conn(0x7f5f080cc6e0 msgr2=0x7f5f0806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 shutdown_connections 2024-08-18T23:57:29.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.329+0000 7f5f0e88f640 1 -- 172.21.15.103:0/2169431529 wait complete. 2024-08-18T23:57:29.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-18T23:57:29.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.441+0000 7f452bb3d640 1 Processor -- start 2024-08-18T23:57:29.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.441+0000 7f452bb3d640 1 -- start start 2024-08-18T23:57:29.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.442+0000 7f452bb3d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f452406c850 0x7f452406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.442+0000 7f452bb3d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4524072e70 0x7f452406ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.442+0000 7f452bb3d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45240b6110 con 0x7f452406d710 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.442+0000 7f452bb3d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f45240b63f0 con 0x7f4524072e70 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.442+0000 7f452bb3d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f45240b3fb0 con 0x7f452406c850 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.442+0000 7f45290d8640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f452406d710 0x7f4524072760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:59012/0 (socket says 172.21.15.103:59012) 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.442+0000 7f45290d8640 1 -- 172.21.15.103:0/2401389883 learned_addr learned my addr 172.21.15.103:0/2401389883 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.442+0000 7f452a0da640 1 --2- 172.21.15.103:0/2401389883 >> v2:172.21.15.190:3300/0 conn(0x7f4524072e70 0x7f452406ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.443+0000 7f45298d9640 1 --2- 172.21.15.103:0/2401389883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f452406c850 0x7f452406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.443+0000 7f45288d7640 1 -- 172.21.15.103:0/2401389883 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860937228 0 0) 0x7f45240b6110 con 0x7f452406d710 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.443+0000 7f45288d7640 1 -- 172.21.15.103:0/2401389883 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4510003520 con 0x7f452406d710 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.443+0000 7f452a0da640 1 -- 172.21.15.103:0/2401389883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f452406c850 msgr2=0x7f452406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.443+0000 7f452a0da640 1 --2- 172.21.15.103:0/2401389883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f452406c850 0x7f452406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.443+0000 7f452a0da640 1 -- 172.21.15.103:0/2401389883 >> v1:172.21.15.190:6789/0 conn(0x7f452406d710 legacy=0x7f4524072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.443+0000 7f452a0da640 1 -- 172.21.15.103:0/2401389883 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45240b4290 con 0x7f4524072e70 2024-08-18T23:57:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452a0da640 1 --2- 172.21.15.103:0/2401389883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4524072e70 0x7f452406ea00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f451c009d90 tx=0x7f451c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14349563bfa5b149 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f45288d7640 1 -- 172.21.15.103:0/2401389883 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c031600 con 0x7f4524072e70 2024-08-18T23:57:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f45288d7640 1 -- 172.21.15.103:0/2401389883 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451c0317a0 con 0x7f4524072e70 2024-08-18T23:57:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f45288d7640 1 -- 172.21.15.103:0/2401389883 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c031b70 con 0x7f4524072e70 2024-08-18T23:57:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452bb3d640 1 -- 172.21.15.103:0/2401389883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4524072e70 msgr2=0x7f452406ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2401389883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4524072e70 0x7f452406ea00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f451c009d90 tx=0x7f451c02a5d0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452bb3d640 1 -- 172.21.15.103:0/2401389883 shutdown_connections 2024-08-18T23:57:29.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2401389883 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4524072e70 0x7f452406ea00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2401389883 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f452406c850 0x7f452406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452bb3d640 1 -- 172.21.15.103:0/2401389883 >> 172.21.15.103:0/2401389883 conn(0x7f45240b2b80 msgr2=0x7f45240b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452bb3d640 1 -- 172.21.15.103:0/2401389883 shutdown_connections 2024-08-18T23:57:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.444+0000 7f452bb3d640 1 -- 172.21.15.103:0/2401389883 wait complete. 2024-08-18T23:57:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.445+0000 7f452bb3d640 1 Processor -- start 2024-08-18T23:57:29.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f452bb3d640 1 -- start start 2024-08-18T23:57:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f452bb3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f452406c850 0x7f452415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f452bb3d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f452406d710 0x7f4524160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f452bb3d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4524072e70 0x7f45241e8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f452bb3d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f452406fd20 con 0x7f452406c850 2024-08-18T23:57:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f452bb3d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f452406fba0 con 0x7f452406d710 2024-08-18T23:57:29.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f452bb3d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f452406fea0 con 0x7f4524072e70 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f45298d9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f452406c850 0x7f452415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f45298d9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f452406c850 0x7f452415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47452/0 (socket says 172.21.15.103:47452) 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.446+0000 7f45298d9640 1 -- 172.21.15.103:0/2609762938 learned_addr learned my addr 172.21.15.103:0/2609762938 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f45290d8640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f452406d710 0x7f4524160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f452a0da640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4524072e70 0x7f45241e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f45298d9640 1 -- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4524072e70 msgr2=0x7f45241e8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f45298d9640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4524072e70 0x7f45241e8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f45298d9640 1 -- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f452406d710 msgr2=0x7f4524160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f45298d9640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f452406d710 0x7f4524160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f45298d9640 1 -- 172.21.15.103:0/2609762938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4524161370 con 0x7f452406c850 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f452a0da640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4524072e70 0x7f45241e8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:29.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f45298d9640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f452406c850 0x7f452415f500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f452000e9b0 tx=0x7f452000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f451a7fc640 1 -- 172.21.15.103:0/2609762938 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520017070 con 0x7f452406c850 2024-08-18T23:57:29.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f451a7fc640 1 -- 172.21.15.103:0/2609762938 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f452000c9a0 con 0x7f452406c850 2024-08-18T23:57:29.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452415e740 con 0x7f452406c850 2024-08-18T23:57:29.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f451a7fc640 1 -- 172.21.15.103:0/2609762938 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452000cd90 con 0x7f452406c850 2024-08-18T23:57:29.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.447+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452415fa40 con 0x7f452406c850 2024-08-18T23:57:29.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.448+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452415f140 con 0x7f452406c850 2024-08-18T23:57:29.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.449+0000 7f451a7fc640 1 -- 172.21.15.103:0/2609762938 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f452001a070 con 0x7f452406c850 2024-08-18T23:57:29.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.449+0000 7f451a7fc640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f450806be30 0x7f450806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.449+0000 7f451a7fc640 1 -- 172.21.15.103:0/2609762938 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f452008b090 con 0x7f452406c850 2024-08-18T23:57:29.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.449+0000 7f45290d8640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f450806be30 0x7f450806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.450+0000 7f45290d8640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f450806be30 0x7f450806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f452415bfd0 tx=0x7f4514007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.453+0000 7f451a7fc640 1 -- 172.21.15.103:0/2609762938 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4520059140 con 0x7f452406c850 2024-08-18T23:57:29.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.616+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f45240b5c50 con 0x7f452406c850 2024-08-18T23:57:29.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.617+0000 7f451a7fc640 1 -- 172.21.15.103:0/2609762938 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f452005d440 con 0x7f452406c850 2024-08-18T23:57:29.618 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-08-18T23:57:29.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f450806be30 msgr2=0x7f450806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f450806be30 0x7f450806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f452415bfd0 tx=0x7f4514007d30 comp rx=0 tx=0).stop 2024-08-18T23:57:29.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f452406c850 msgr2=0x7f452415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f452406c850 0x7f452415f500 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f452000e9b0 tx=0x7f452000ee70 comp rx=0 tx=0).stop 2024-08-18T23:57:29.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 shutdown_connections 2024-08-18T23:57:29.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f450806be30 0x7f450806e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4524072e70 0x7f45241e8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f452406d710 0x7f4524160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 --2- 172.21.15.103:0/2609762938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f452406c850 0x7f452415f500 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.618+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 >> 172.21.15.103:0/2609762938 conn(0x7f45240b2b80 msgr2=0x7f45240b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:29.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.619+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 shutdown_connections 2024-08-18T23:57:29.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.619+0000 7f452bb3d640 1 -- 172.21.15.103:0/2609762938 wait complete. 2024-08-18T23:57:29.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-18T23:57:29.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.731+0000 7f50e4981640 1 Processor -- start 2024-08-18T23:57:29.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.731+0000 7f50e4981640 1 -- start start 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50e4981640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e015f770 0x7f50e00ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50e4981640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f50e00b2d30 0x7f50e00cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50e4981640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f50e00b4cc0 0x7f50e00b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50e4981640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f50e00d2da0 con 0x7f50e00b4cc0 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50e4981640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f50e00d2ac0 con 0x7f50e00b2d30 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50e4981640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50e00d0580 con 0x7f50e015f770 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50ded9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f50e00b4cc0 0x7f50e00b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50ded9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f50e00b4cc0 0x7f50e00b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47464/0 (socket says 172.21.15.103:47464) 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.732+0000 7f50ded9d640 1 -- 172.21.15.103:0/331701218 learned_addr learned my addr 172.21.15.103:0/331701218 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:29.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50de59c640 1 --2- 172.21.15.103:0/331701218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e015f770 0x7f50e00ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50ddd9b640 1 --2- 172.21.15.103:0/331701218 >> v2:172.21.15.190:3300/0 conn(0x7f50e00b2d30 0x7f50e00cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50ded9d640 1 -- 172.21.15.103:0/331701218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e015f770 msgr2=0x7f50e00ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50ded9d640 1 --2- 172.21.15.103:0/331701218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e015f770 0x7f50e00ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50ded9d640 1 -- 172.21.15.103:0/331701218 >> v2:172.21.15.190:3300/0 conn(0x7f50e00b2d30 msgr2=0x7f50e00cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50ded9d640 1 --2- 172.21.15.103:0/331701218 >> v2:172.21.15.190:3300/0 conn(0x7f50e00b2d30 0x7f50e00cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50ded9d640 1 -- 172.21.15.103:0/331701218 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e00d0860 con 0x7f50e00b4cc0 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50ddd9b640 1 --2- 172.21.15.103:0/331701218 >> v2:172.21.15.190:3300/0 conn(0x7f50e00b2d30 0x7f50e00cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.733+0000 7f50ded9d640 1 --2- 172.21.15.103:0/331701218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e00b5130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f50e0072dc0 tx=0x7f50d802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fd9accab8661f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50dd59a640 1 -- 172.21.15.103:0/331701218 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8037070 con 0x7f50e00b4cc0 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50dd59a640 1 -- 172.21.15.103:0/331701218 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d802ae00 con 0x7f50e00b4cc0 2024-08-18T23:57:29.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50dd59a640 1 -- 172.21.15.103:0/331701218 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8032660 con 0x7f50e00b4cc0 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 -- 172.21.15.103:0/331701218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 msgr2=0x7f50e00b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 --2- 172.21.15.103:0/331701218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e00b5130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f50e0072dc0 tx=0x7f50d802a0b0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 -- 172.21.15.103:0/331701218 shutdown_connections 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 --2- 172.21.15.103:0/331701218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e00b5130 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 --2- 172.21.15.103:0/331701218 >> v2:172.21.15.190:3300/0 conn(0x7f50e00b2d30 0x7f50e00cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 --2- 172.21.15.103:0/331701218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e015f770 0x7f50e00ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 -- 172.21.15.103:0/331701218 >> 172.21.15.103:0/331701218 conn(0x7f50e00d1e70 msgr2=0x7f50e00d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 -- 172.21.15.103:0/331701218 shutdown_connections 2024-08-18T23:57:29.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.734+0000 7f50e4981640 1 -- 172.21.15.103:0/331701218 wait complete. 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50e4981640 1 Processor -- start 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50e4981640 1 -- start start 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50e4981640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e00b2d30 0x7f50e0158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50e4981640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e01f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50e4981640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50e015f770 0x7f50e00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50e4981640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50e00b32f0 con 0x7f50e00b4cc0 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50e4981640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50e015fb50 con 0x7f50e015f770 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50e4981640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50e00b3470 con 0x7f50e00b2d30 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50ddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e01f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50ddd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e01f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47478/0 (socket says 172.21.15.103:47478) 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.736+0000 7f50ddd9b640 1 -- 172.21.15.103:0/4174213516 learned_addr learned my addr 172.21.15.103:0/4174213516 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ded9d640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50e015f770 0x7f50e00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50de59c640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e00b2d30 0x7f50e0158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ddd9b640 1 -- 172.21.15.103:0/4174213516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e00b2d30 msgr2=0x7f50e0158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ddd9b640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e00b2d30 0x7f50e0158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ddd9b640 1 -- 172.21.15.103:0/4174213516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50e015f770 msgr2=0x7f50e00c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ddd9b640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50e015f770 0x7f50e00c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ddd9b640 1 -- 172.21.15.103:0/4174213516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e00ca250 con 0x7f50e00b4cc0 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ddd9b640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e01f1f10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50d400e810 tx=0x7f50d400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ceffd640 1 -- 172.21.15.103:0/4174213516 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d400f040 con 0x7f50e00b4cc0 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ceffd640 1 -- 172.21.15.103:0/4174213516 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d4004030 con 0x7f50e00b4cc0 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e00ca530 con 0x7f50e00b4cc0 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50ceffd640 1 -- 172.21.15.103:0/4174213516 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4004400 con 0x7f50e00b4cc0 2024-08-18T23:57:29.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.737+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e00caaf0 con 0x7f50e00b4cc0 2024-08-18T23:57:29.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.738+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e00682f0 con 0x7f50e00b4cc0 2024-08-18T23:57:29.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.739+0000 7f50ceffd640 1 -- 172.21.15.103:0/4174213516 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50d400c6d0 con 0x7f50e00b4cc0 2024-08-18T23:57:29.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.739+0000 7f50ceffd640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50c006be30 0x7f50c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:29.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.739+0000 7f50ceffd640 1 -- 172.21.15.103:0/4174213516 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f50d408ae70 con 0x7f50e00b4cc0 2024-08-18T23:57:29.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.739+0000 7f50de59c640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50c006be30 0x7f50c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:29.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.740+0000 7f50de59c640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50c006be30 0x7f50c006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f50d00073f0 tx=0x7f50d000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:29.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.743+0000 7f50ceffd640 1 -- 172.21.15.103:0/4174213516 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f50d4017020 con 0x7f50e00b4cc0 2024-08-18T23:57:29.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.912+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f50e00cf200 con 0x7f50e00b4cc0 2024-08-18T23:57:29.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.912+0000 7f50ceffd640 1 -- 172.21.15.103:0/4174213516 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f50d40594e0 con 0x7f50e00b4cc0 2024-08-18T23:57:29.914 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-08-18T23:57:29.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50c006be30 msgr2=0x7f50c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50c006be30 0x7f50c006e2f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f50d00073f0 tx=0x7f50d000b040 comp rx=0 tx=0).stop 2024-08-18T23:57:29.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 msgr2=0x7f50e01f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:29.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e01f1f10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50d400e810 tx=0x7f50d400ecd0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 shutdown_connections 2024-08-18T23:57:29.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f50c006be30 0x7f50c006e2f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f50e015f770 0x7f50e00c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50e00b4cc0 0x7f50e01f1f10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 --2- 172.21.15.103:0/4174213516 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50e00b2d30 0x7f50e0158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:29.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 >> 172.21.15.103:0/4174213516 conn(0x7f50e00d1e70 msgr2=0x7f50e0070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:29.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 shutdown_connections 2024-08-18T23:57:29.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:29.914+0000 7f50e4981640 1 -- 172.21.15.103:0/4174213516 wait complete. 2024-08-18T23:57:29.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-18T23:57:30.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.029+0000 7f62b569d640 1 Processor -- start 2024-08-18T23:57:30.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.029+0000 7f62b569d640 1 -- start start 2024-08-18T23:57:30.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62b569d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f62b015e3b0 0x7f62b00d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62b569d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62b00d21b0 0x7f62b00d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62b569d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62b00d4e10 con 0x7f62b00b3000 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62b569d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f62b00d4bc0 con 0x7f62b00d21b0 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62b569d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f62b00cf960 con 0x7f62b015e3b0 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62a67fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f62b00d21b0 0x7f62b00d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62af7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f62b00b3000 0x7f62b00d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56354/0 (socket says 172.21.15.103:56354) 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62af7fe640 1 -- 172.21.15.103:0/162001067 learned_addr learned my addr 172.21.15.103:0/162001067 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62aeffd640 1 --2- 172.21.15.103:0/162001067 >> v2:172.21.15.190:3300/0 conn(0x7f62b015e3b0 0x7f62b00d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62a67fc640 1 -- 172.21.15.103:0/162001067 >> v2:172.21.15.190:3300/0 conn(0x7f62b015e3b0 msgr2=0x7f62b00d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62a67fc640 1 --2- 172.21.15.103:0/162001067 >> v2:172.21.15.190:3300/0 conn(0x7f62b015e3b0 0x7f62b00d2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62a67fc640 1 -- 172.21.15.103:0/162001067 >> v1:172.21.15.103:6789/0 conn(0x7f62b00b3000 legacy=0x7f62b00d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62ae7fc640 1 -- 172.21.15.103:0/162001067 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570143672 0 0) 0x7f62b00d4e10 con 0x7f62b00b3000 2024-08-18T23:57:30.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.030+0000 7f62a67fc640 1 -- 172.21.15.103:0/162001067 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b00cfbb0 con 0x7f62b00d21b0 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62a67fc640 1 --2- 172.21.15.103:0/162001067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00d21b0 0x7f62b00d2c40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f62b008c7a0 tx=0x7f629802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e5de025310e332 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62ae7fc640 1 -- 172.21.15.103:0/162001067 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298037070 con 0x7f62b00d21b0 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62ae7fc640 1 -- 172.21.15.103:0/162001067 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6298032440 con 0x7f62b00d21b0 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62ae7fc640 1 -- 172.21.15.103:0/162001067 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6298032810 con 0x7f62b00d21b0 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62b569d640 1 -- 172.21.15.103:0/162001067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00d21b0 msgr2=0x7f62b00d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62b569d640 1 --2- 172.21.15.103:0/162001067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00d21b0 0x7f62b00d2c40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f62b008c7a0 tx=0x7f629802a1a0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62b569d640 1 -- 172.21.15.103:0/162001067 shutdown_connections 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62b569d640 1 --2- 172.21.15.103:0/162001067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00d21b0 0x7f62b00d2c40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62b569d640 1 --2- 172.21.15.103:0/162001067 >> v2:172.21.15.190:3300/0 conn(0x7f62b015e3b0 0x7f62b00d2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.031+0000 7f62b569d640 1 -- 172.21.15.103:0/162001067 >> 172.21.15.103:0/162001067 conn(0x7f62b00d40a0 msgr2=0x7f62b00d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.032+0000 7f62b569d640 1 -- 172.21.15.103:0/162001067 shutdown_connections 2024-08-18T23:57:30.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.032+0000 7f62b569d640 1 -- 172.21.15.103:0/162001067 wait complete. 2024-08-18T23:57:30.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.033+0000 7f62b569d640 1 Processor -- start 2024-08-18T23:57:30.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.033+0000 7f62b569d640 1 -- start start 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62b569d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00b3000 0x7f62b00b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62b569d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62b00d21b0 0x7f62b01580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62b569d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62b015e3b0 0x7f62b014d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62b569d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f62b015e790 con 0x7f62b00b3000 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62b569d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f62b00d0200 con 0x7f62b00d21b0 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62b569d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f62b015e910 con 0x7f62b015e3b0 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00b3000 0x7f62b00b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00b3000 0x7f62b00b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47494/0 (socket says 172.21.15.103:47494) 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 -- 172.21.15.103:0/1869214744 learned_addr learned my addr 172.21.15.103:0/1869214744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 -- 172.21.15.103:0/1869214744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62b015e3b0 msgr2=0x7f62b014d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62b015e3b0 0x7f62b014d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 -- 172.21.15.103:0/1869214744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62b00d21b0 msgr2=0x7f62b01580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62b00d21b0 0x7f62b01580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 -- 172.21.15.103:0/1869214744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b01f3cc0 con 0x7f62b00b3000 2024-08-18T23:57:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62aeffd640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00b3000 0x7f62b00b9940 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f62a000d5f0 tx=0x7f62a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62a7fff640 1 -- 172.21.15.103:0/1869214744 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00125f0 con 0x7f62b00b3000 2024-08-18T23:57:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62a7fff640 1 -- 172.21.15.103:0/1869214744 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a0019070 con 0x7f62b00b3000 2024-08-18T23:57:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b00cce20 con 0x7f62b00b3000 2024-08-18T23:57:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62a7fff640 1 -- 172.21.15.103:0/1869214744 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a00129d0 con 0x7f62b00b3000 2024-08-18T23:57:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.034+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b00cd3e0 con 0x7f62b00b3000 2024-08-18T23:57:30.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.035+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b00d2700 con 0x7f62b00b3000 2024-08-18T23:57:30.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.036+0000 7f62a7fff640 1 -- 172.21.15.103:0/1869214744 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f62a0012b70 con 0x7f62b00b3000 2024-08-18T23:57:30.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.036+0000 7f62a7fff640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f629006be30 0x7f629006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.036+0000 7f62a67fc640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f629006be30 0x7f629006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.036+0000 7f62a7fff640 1 -- 172.21.15.103:0/1869214744 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f62a008b5b0 con 0x7f62b00b3000 2024-08-18T23:57:30.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.037+0000 7f62a67fc640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f629006be30 0x7f629006e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6298034000 tx=0x7f629802c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:30.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.041+0000 7f62a7fff640 1 -- 172.21.15.103:0/1869214744 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f62a0059c20 con 0x7f62b00b3000 2024-08-18T23:57:30.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.210+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f62b0068df0 con 0x7f62b00b3000 2024-08-18T23:57:30.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.211+0000 7f62a7fff640 1 -- 172.21.15.103:0/1869214744 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f62a0059520 con 0x7f62b00b3000 2024-08-18T23:57:30.212 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f629006be30 msgr2=0x7f629006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f629006be30 0x7f629006e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6298034000 tx=0x7f629802c000 comp rx=0 tx=0).stop 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00b3000 msgr2=0x7f62b00b9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00b3000 0x7f62b00b9940 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f62a000d5f0 tx=0x7f62a000dab0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 shutdown_connections 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f629006be30 0x7f629006e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62b015e3b0 0x7f62b014d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62b00d21b0 0x7f62b01580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 --2- 172.21.15.103:0/1869214744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f62b00b3000 0x7f62b00b9940 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 >> 172.21.15.103:0/1869214744 conn(0x7f62b00d40a0 msgr2=0x7f62b00ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:30.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 shutdown_connections 2024-08-18T23:57:30.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.213+0000 7f62b569d640 1 -- 172.21.15.103:0/1869214744 wait complete. 2024-08-18T23:57:30.226 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2024-08-18T23:57:30.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.324+0000 7f9a36b68640 1 Processor -- start 2024-08-18T23:57:30.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.324+0000 7f9a36b68640 1 -- start start 2024-08-18T23:57:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a36b68640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9a3006f770 0x7f9a300ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a36b68640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a300b4370 0x7f9a300adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a36b68640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a30072610 con 0x7f9a3015ade0 2024-08-18T23:57:30.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a36b68640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3006db10 con 0x7f9a300b4370 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a36b68640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3015b1c0 con 0x7f9a3006f770 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a35105640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9a300b4370 0x7f9a300adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a34904640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9a3015ade0 0x7f9a3006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56366/0 (socket says 172.21.15.103:56366) 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a34904640 1 -- 172.21.15.103:0/2918006982 learned_addr learned my addr 172.21.15.103:0/2918006982 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a35105640 1 -- 172.21.15.103:0/2918006982 >> v2:172.21.15.190:3300/0 conn(0x7f9a3006f770 msgr2=0x7f9a300ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a2ffff640 1 --2- 172.21.15.103:0/2918006982 >> v2:172.21.15.190:3300/0 conn(0x7f9a3006f770 0x7f9a300ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a2f7fe640 1 -- 172.21.15.103:0/2918006982 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534246795 0 0) 0x7f9a30072610 con 0x7f9a3015ade0 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a35105640 1 --2- 172.21.15.103:0/2918006982 >> v2:172.21.15.190:3300/0 conn(0x7f9a3006f770 0x7f9a300ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a35105640 1 -- 172.21.15.103:0/2918006982 >> v1:172.21.15.103:6789/0 conn(0x7f9a3015ade0 legacy=0x7f9a3006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a35105640 1 -- 172.21.15.103:0/2918006982 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a300728f0 con 0x7f9a300b4370 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.325+0000 7f9a2ffff640 1 --2- 172.21.15.103:0/2918006982 >> v2:172.21.15.190:3300/0 conn(0x7f9a3006f770 0x7f9a300ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:30.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.326+0000 7f9a35105640 1 --2- 172.21.15.103:0/2918006982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a300adf10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a300af1c0 tx=0x7f9a2802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcf693700cc5199 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.326+0000 7f9a2f7fe640 1 -- 172.21.15.103:0/2918006982 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28007740 con 0x7f9a300b4370 2024-08-18T23:57:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.326+0000 7f9a2f7fe640 1 -- 172.21.15.103:0/2918006982 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a280078e0 con 0x7f9a300b4370 2024-08-18T23:57:30.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.326+0000 7f9a2f7fe640 1 -- 172.21.15.103:0/2918006982 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a28007cb0 con 0x7f9a300b4370 2024-08-18T23:57:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.327+0000 7f9a36b68640 1 -- 172.21.15.103:0/2918006982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 msgr2=0x7f9a300adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.327+0000 7f9a36b68640 1 --2- 172.21.15.103:0/2918006982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a300adf10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a300af1c0 tx=0x7f9a2802a5f0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.327+0000 7f9a36b68640 1 -- 172.21.15.103:0/2918006982 shutdown_connections 2024-08-18T23:57:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.327+0000 7f9a36b68640 1 --2- 172.21.15.103:0/2918006982 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a300adf10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.327+0000 7f9a36b68640 1 --2- 172.21.15.103:0/2918006982 >> v2:172.21.15.190:3300/0 conn(0x7f9a3006f770 0x7f9a300ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.327+0000 7f9a36b68640 1 -- 172.21.15.103:0/2918006982 >> 172.21.15.103:0/2918006982 conn(0x7f9a300cfc40 msgr2=0x7f9a300d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.327+0000 7f9a36b68640 1 -- 172.21.15.103:0/2918006982 shutdown_connections 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.327+0000 7f9a36b68640 1 -- 172.21.15.103:0/2918006982 wait complete. 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.328+0000 7f9a36b68640 1 Processor -- start 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.328+0000 7f9a36b68640 1 -- start start 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a36b68640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a3006f770 0x7f9a301497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a36b68640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a3014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a36b68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a3015ade0 0x7f9a3015db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a36b68640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3006d6c0 con 0x7f9a300b4370 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a36b68640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9a30072eb0 con 0x7f9a3006f770 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a36b68640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3006d840 con 0x7f9a3015ade0 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a3014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a3014a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47506/0 (socket says 172.21.15.103:47506) 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 -- 172.21.15.103:0/3295636977 learned_addr learned my addr 172.21.15.103:0/3295636977 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a35105640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a3015ade0 0x7f9a3015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a34904640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a3006f770 0x7f9a301497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 -- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a3015ade0 msgr2=0x7f9a3015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a3015ade0 0x7f9a3015db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 -- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a3006f770 msgr2=0x7f9a301497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a3006f770 0x7f9a301497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 -- 172.21.15.103:0/3295636977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a30149d30 con 0x7f9a300b4370 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a34904640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a3006f770 0x7f9a301497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2ffff640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a3014a260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00c7f0 tx=0x7f9a1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:30.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2d7fa640 1 -- 172.21.15.103:0/3295636977 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c015070 con 0x7f9a300b4370 2024-08-18T23:57:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a2d7fa640 1 -- 172.21.15.103:0/3295636977 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a1c007a30 con 0x7f9a300b4370 2024-08-18T23:57:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.329+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3009aed0 con 0x7f9a300b4370 2024-08-18T23:57:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.330+0000 7f9a2d7fa640 1 -- 172.21.15.103:0/3295636977 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c007e00 con 0x7f9a300b4370 2024-08-18T23:57:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.330+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3009b490 con 0x7f9a300b4370 2024-08-18T23:57:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.331+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a300b47b0 con 0x7f9a300b4370 2024-08-18T23:57:30.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.331+0000 7f9a2d7fa640 1 -- 172.21.15.103:0/3295636977 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a1c018070 con 0x7f9a300b4370 2024-08-18T23:57:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.332+0000 7f9a2d7fa640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a1406be30 0x7f9a1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.332+0000 7f9a34904640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a1406be30 0x7f9a1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.332+0000 7f9a2d7fa640 1 -- 172.21.15.103:0/3295636977 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9a1c08b1b0 con 0x7f9a300b4370 2024-08-18T23:57:30.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.332+0000 7f9a34904640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a1406be30 0x7f9a1406e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000f60 tx=0x7f9a24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:30.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.336+0000 7f9a2d7fa640 1 -- 172.21.15.103:0/3295636977 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9a1c059790 con 0x7f9a300b4370 2024-08-18T23:57:30.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.563+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) -- 0x7f9a300cf930 con 0x7f9a300b4370 2024-08-18T23:57:30.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.888+0000 7f9a2d7fa640 1 -- 172.21.15.103:0/3295636977 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v56) ==== 138+0+0 (secure 0 0 0) 0x7f9a1c059090 con 0x7f9a300b4370 2024-08-18T23:57:30.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a1406be30 msgr2=0x7f9a1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a1406be30 0x7f9a1406e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000f60 tx=0x7f9a24009040 comp rx=0 tx=0).stop 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 msgr2=0x7f9a3014a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a3014a260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00c7f0 tx=0x7f9a1c00cbf0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 shutdown_connections 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a1406be30 0x7f9a1406e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a3015ade0 0x7f9a3015db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a300b4370 0x7f9a3014a260 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 --2- 172.21.15.103:0/3295636977 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a3006f770 0x7f9a301497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 >> 172.21.15.103:0/3295636977 conn(0x7f9a300cfc40 msgr2=0x7f9a300aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 shutdown_connections 2024-08-18T23:57:30.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:30.890+0000 7f9a36b68640 1 -- 172.21.15.103:0/3295636977 wait complete. 2024-08-18T23:57:30.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-18T23:57:31.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.005+0000 7ff512d9a640 1 Processor -- start 2024-08-18T23:57:31.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.005+0000 7ff512d9a640 1 -- start start 2024-08-18T23:57:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff512d9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06c850 0x7ff50c06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff512d9a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff50c06d710 0x7ff50c072760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff512d9a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c0b6110 con 0x7ff50c06fba0 2024-08-18T23:57:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff512d9a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff50c0b63f0 con 0x7ff50c06d710 2024-08-18T23:57:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff512d9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c0b3fb0 con 0x7ff50c06c850 2024-08-18T23:57:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff50bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff50c06d710 0x7ff50c072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff50bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff50c06d710 0x7ff50c072760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47522/0 (socket says 172.21.15.103:47522) 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff50bfff640 1 -- 172.21.15.103:0/681093965 learned_addr learned my addr 172.21.15.103:0/681093965 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff50bfff640 1 -- 172.21.15.103:0/681093965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06c850 msgr2=0x7ff50c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff50bfff640 1 --2- 172.21.15.103:0/681093965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06c850 0x7ff50c06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff50bfff640 1 -- 172.21.15.103:0/681093965 >> v1:172.21.15.190:6789/0 conn(0x7ff50c06fba0 legacy=0x7ff50c06ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.006+0000 7ff50bfff640 1 -- 172.21.15.103:0/681093965 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c0b4290 con 0x7ff50c06d710 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.007+0000 7ff50bfff640 1 --2- 172.21.15.103:0/681093965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06d710 0x7ff50c072760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff500009e50 tx=0x7ff50002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa551da9eadd0f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.007+0000 7ff50b7fe640 1 -- 172.21.15.103:0/681093965 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500036070 con 0x7ff50c06d710 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.007+0000 7ff50b7fe640 1 -- 172.21.15.103:0/681093965 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff500031600 con 0x7ff50c06d710 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.007+0000 7ff50b7fe640 1 -- 172.21.15.103:0/681093965 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5000319d0 con 0x7ff50c06d710 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.008+0000 7ff512d9a640 1 -- 172.21.15.103:0/681093965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06d710 msgr2=0x7ff50c072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.008+0000 7ff512d9a640 1 --2- 172.21.15.103:0/681093965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06d710 0x7ff50c072760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff500009e50 tx=0x7ff50002a630 comp rx=0 tx=0).stop 2024-08-18T23:57:31.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.008+0000 7ff512d9a640 1 -- 172.21.15.103:0/681093965 shutdown_connections 2024-08-18T23:57:31.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.008+0000 7ff512d9a640 1 --2- 172.21.15.103:0/681093965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06d710 0x7ff50c072760 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.008+0000 7ff512d9a640 1 --2- 172.21.15.103:0/681093965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06c850 0x7ff50c06b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.008+0000 7ff512d9a640 1 -- 172.21.15.103:0/681093965 >> 172.21.15.103:0/681093965 conn(0x7ff50c0b2b80 msgr2=0x7ff50c0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:31.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.008+0000 7ff512d9a640 1 -- 172.21.15.103:0/681093965 shutdown_connections 2024-08-18T23:57:31.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.008+0000 7ff512d9a640 1 -- 172.21.15.103:0/681093965 wait complete. 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.009+0000 7ff512d9a640 1 Processor -- start 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.009+0000 7ff512d9a640 1 -- start start 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff512d9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06c850 0x7ff50c160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff512d9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c06d710 0x7ff50c153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff512d9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06fba0 0x7ff50c0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff512d9a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c0b5d00 con 0x7ff50c06c850 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff512d9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c0b5b80 con 0x7ff50c06d710 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff512d9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c0b5e80 con 0x7ff50c06fba0 2024-08-18T23:57:31.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06c850 0x7ff50c160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06c850 0x7ff50c160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47528/0 (socket says 172.21.15.103:47528) 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 -- 172.21.15.103:0/2294521404 learned_addr learned my addr 172.21.15.103:0/2294521404 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff50bfff640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c06d710 0x7ff50c153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 -- 172.21.15.103:0/2294521404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06fba0 msgr2=0x7ff50c0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06fba0 0x7ff50c0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 -- 172.21.15.103:0/2294521404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c06d710 msgr2=0x7ff50c153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c06d710 0x7ff50c153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 -- 172.21.15.103:0/2294521404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c153820 con 0x7ff50c06c850 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.010+0000 7ff510b36640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06c850 0x7ff50c160980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00b4a0 tx=0x7ff4fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.011+0000 7ff5097fa640 1 -- 172.21.15.103:0/2294521404 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc014070 con 0x7ff50c06c850 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.011+0000 7ff5097fa640 1 -- 172.21.15.103:0/2294521404 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc010610 con 0x7ff50c06c850 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.011+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c156c90 con 0x7ff50c06c850 2024-08-18T23:57:31.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.011+0000 7ff5097fa640 1 -- 172.21.15.103:0/2294521404 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc010a00 con 0x7ff50c06c850 2024-08-18T23:57:31.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.011+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c160180 con 0x7ff50c06c850 2024-08-18T23:57:31.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.012+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c06b900 con 0x7ff50c06c850 2024-08-18T23:57:31.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.012+0000 7ff5097fa640 1 -- 172.21.15.103:0/2294521404 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4fc017070 con 0x7ff50c06c850 2024-08-18T23:57:31.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.012+0000 7ff5097fa640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff4f806be30 0x7ff4f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.013+0000 7ff50bfff640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff4f806be30 0x7ff4f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.013+0000 7ff5097fa640 1 -- 172.21.15.103:0/2294521404 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff4fc08ab10 con 0x7ff50c06c850 2024-08-18T23:57:31.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.013+0000 7ff50bfff640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff4f806be30 0x7ff4f806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff500033000 tx=0x7ff500009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.017+0000 7ff5097fa640 1 -- 172.21.15.103:0/2294521404 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff4fc059210 con 0x7ff50c06c850 2024-08-18T23:57:31.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.183+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7ff50c0b28f0 con 0x7ff50c06c850 2024-08-18T23:57:31.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.186+0000 7ff5097fa640 1 -- 172.21.15.103:0/2294521404 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7ff4fc058b10 con 0x7ff50c06c850 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff4f806be30 msgr2=0x7ff4f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff4f806be30 0x7ff4f806e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff500033000 tx=0x7ff500009000 comp rx=0 tx=0).stop 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06c850 msgr2=0x7ff50c160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06c850 0x7ff50c160980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00b4a0 tx=0x7ff4fc00b960 comp rx=0 tx=0).stop 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 shutdown_connections 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff4f806be30 0x7ff4f806e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06fba0 0x7ff50c0cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c06d710 0x7ff50c153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 --2- 172.21.15.103:0/2294521404 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50c06c850 0x7ff50c160980 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 >> 172.21.15.103:0/2294521404 conn(0x7ff50c0b2b80 msgr2=0x7ff50c15cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:31.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 shutdown_connections 2024-08-18T23:57:31.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.188+0000 7ff512d9a640 1 -- 172.21.15.103:0/2294521404 wait complete. 2024-08-18T23:57:31.201 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T23:57:31.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T23:57:31.249 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T23:57:31.295 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T23:57:31.296 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:57:31.296 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:31.311 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:57:31.311 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:31.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:31.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.506+0000 7f5c3b1f8640 1 Processor -- start 2024-08-18T23:57:31.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.506+0000 7f5c3b1f8640 1 -- start start 2024-08-18T23:57:31.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c3b1f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c3406b900 0x7f5c3406bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c3b1f8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5c340c50e0 0x7f5c340c5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c3b1f8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c3415fa10 0x7f5c3415fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c3b1f8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5c340c4c50 con 0x7f5c3415fa10 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c3b1f8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5c34159e80 con 0x7f5c340c50e0 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c3b1f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3406c220 con 0x7f5c3406b900 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c39795640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c3415fa10 0x7f5c3415fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c39795640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5c3415fa10 0x7f5c3415fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47536/0 (socket says 172.21.15.103:47536) 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c39795640 1 -- 172.21.15.103:0/753118894 learned_addr learned my addr 172.21.15.103:0/753118894 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c38f94640 1 --2- 172.21.15.103:0/753118894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c3406b900 0x7f5c3406bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.507+0000 7f5c33fff640 1 --2- 172.21.15.103:0/753118894 >> v2:172.21.15.190:3300/0 conn(0x7f5c340c50e0 0x7f5c340c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c39795640 1 -- 172.21.15.103:0/753118894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c3406b900 msgr2=0x7f5c3406bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c39795640 1 --2- 172.21.15.103:0/753118894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c3406b900 0x7f5c3406bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c39795640 1 -- 172.21.15.103:0/753118894 >> v2:172.21.15.190:3300/0 conn(0x7f5c340c50e0 msgr2=0x7f5c340c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:31.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c39795640 1 --2- 172.21.15.103:0/753118894 >> v2:172.21.15.190:3300/0 conn(0x7f5c340c50e0 0x7f5c340c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c39795640 1 -- 172.21.15.103:0/753118894 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c340cb5e0 con 0x7f5c3415fa10 2024-08-18T23:57:31.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c33fff640 1 --2- 172.21.15.103:0/753118894 >> v2:172.21.15.190:3300/0 conn(0x7f5c340c50e0 0x7f5c340c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:31.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c39795640 1 --2- 172.21.15.103:0/753118894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c3415fec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5c3406c480 tx=0x7f5c2c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58275b4a1f18a269 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c337fe640 1 -- 172.21.15.103:0/753118894 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c036070 con 0x7f5c3415fa10 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c337fe640 1 -- 172.21.15.103:0/753118894 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2c031600 con 0x7f5c3415fa10 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.508+0000 7f5c337fe640 1 -- 172.21.15.103:0/753118894 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0319d0 con 0x7f5c3415fa10 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/753118894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 msgr2=0x7f5c3415fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/753118894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c3415fec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5c3406c480 tx=0x7f5c2c02a6a0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/753118894 shutdown_connections 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/753118894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c3415fec0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/753118894 >> v2:172.21.15.190:3300/0 conn(0x7f5c340c50e0 0x7f5c340c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/753118894 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c3406b900 0x7f5c3406bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/753118894 >> 172.21.15.103:0/753118894 conn(0x7f5c340cc6e0 msgr2=0x7f5c340ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/753118894 shutdown_connections 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.509+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/753118894 wait complete. 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.510+0000 7f5c3b1f8640 1 Processor -- start 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.510+0000 7f5c3b1f8640 1 -- start start 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c3b1f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c3406b900 0x7f5c3409ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c3b1f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c340c50e0 0x7f5c341f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c3b1f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c341f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c3b1f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5c340cbe80 con 0x7f5c3415fa10 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c3b1f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5c340cbba0 con 0x7f5c3406b900 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c3b1f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5c34071530 con 0x7f5c340c50e0 2024-08-18T23:57:31.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c39795640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c341f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c39795640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c341f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47550/0 (socket says 172.21.15.103:47550) 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c39795640 1 -- 172.21.15.103:0/3761509116 learned_addr learned my addr 172.21.15.103:0/3761509116 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c38f94640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c3406b900 0x7f5c3409ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c33fff640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c340c50e0 0x7f5c341f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c39795640 1 -- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c340c50e0 msgr2=0x7f5c341f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c39795640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c340c50e0 0x7f5c341f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c39795640 1 -- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c3406b900 msgr2=0x7f5c3409ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c39795640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c3406b900 0x7f5c3409ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c39795640 1 -- 172.21.15.103:0/3761509116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c340b3f20 con 0x7f5c3415fa10 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c33fff640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c340c50e0 0x7f5c341f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.511+0000 7f5c38f94640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c3406b900 0x7f5c3409ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.512+0000 7f5c39795640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c341f5a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c034040 tx=0x7f5c2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.512+0000 7f5c317fa640 1 -- 172.21.15.103:0/3761509116 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c036050 con 0x7f5c3415fa10 2024-08-18T23:57:31.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.512+0000 7f5c317fa640 1 -- 172.21.15.103:0/3761509116 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c2c042070 con 0x7f5c3415fa10 2024-08-18T23:57:31.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.512+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c340b4200 con 0x7f5c3415fa10 2024-08-18T23:57:31.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.512+0000 7f5c317fa640 1 -- 172.21.15.103:0/3761509116 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c009510 con 0x7f5c3415fa10 2024-08-18T23:57:31.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.512+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c340b47c0 con 0x7f5c3415fa10 2024-08-18T23:57:31.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.513+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3406bce0 con 0x7f5c3415fa10 2024-08-18T23:57:31.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.513+0000 7f5c317fa640 1 -- 172.21.15.103:0/3761509116 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c2c007bd0 con 0x7f5c3415fa10 2024-08-18T23:57:31.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.514+0000 7f5c317fa640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5c2006be30 0x7f5c2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.514+0000 7f5c38f94640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5c2006be30 0x7f5c2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.514+0000 7f5c317fa640 1 -- 172.21.15.103:0/3761509116 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5c2c0ac090 con 0x7f5c3415fa10 2024-08-18T23:57:31.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.514+0000 7f5c38f94640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5c2006be30 0x7f5c2006e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c24006fd0 tx=0x7f5c24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.518+0000 7f5c317fa640 1 -- 172.21.15.103:0/3761509116 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5c2c07a700 con 0x7f5c3415fa10 2024-08-18T23:57:31.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.694+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5c340ae4e0 con 0x7f5c3415fa10 2024-08-18T23:57:31.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.695+0000 7f5c317fa640 1 -- 172.21.15.103:0/3761509116 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f5c2c07a000 con 0x7f5c3415fa10 2024-08-18T23:57:31.696 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:31.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5c2006be30 msgr2=0x7f5c2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5c2006be30 0x7f5c2006e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c24006fd0 tx=0x7f5c24008040 comp rx=0 tx=0).stop 2024-08-18T23:57:31.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 msgr2=0x7f5c341f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c341f5a20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c034040 tx=0x7f5c2c004a40 comp rx=0 tx=0).stop 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 shutdown_connections 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5c2006be30 0x7f5c2006e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c3415fa10 0x7f5c341f5a20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c340c50e0 0x7f5c341f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 --2- 172.21.15.103:0/3761509116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c3406b900 0x7f5c3409ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 >> 172.21.15.103:0/3761509116 conn(0x7f5c340cc6e0 msgr2=0x7f5c3406df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 shutdown_connections 2024-08-18T23:57:31.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.697+0000 7f5c3b1f8640 1 -- 172.21.15.103:0/3761509116 wait complete. 2024-08-18T23:57:31.709 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:57:31.709 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:31.726 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:31.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.864+0000 7f564e70c640 1 Processor -- start 2024-08-18T23:57:31.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.864+0000 7f564e70c640 1 -- start start 2024-08-18T23:57:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564e70c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f564815f5c0 0x7f56480ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564e70c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480ceb90 0x7f56480cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564e70c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56480cfa90 0x7f56480cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564e70c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f56480cdd60 con 0x7f56480cfa90 2024-08-18T23:57:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564e70c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f56480d29e0 con 0x7f564815f5c0 2024-08-18T23:57:31.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564e70c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f56480d2cc0 con 0x7f56480ceb90 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564cca9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56480cfa90 0x7f56480cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564cca9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56480cfa90 0x7f56480cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47552/0 (socket says 172.21.15.103:47552) 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564cca9640 1 -- 172.21.15.103:0/1175314507 learned_addr learned my addr 172.21.15.103:0/1175314507 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f5647fff640 1 --2- 172.21.15.103:0/1175314507 >> v2:172.21.15.190:3300/0 conn(0x7f564815f5c0 0x7f56480ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f563ffff640 1 --2- 172.21.15.103:0/1175314507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480ceb90 0x7f56480cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564cca9640 1 -- 172.21.15.103:0/1175314507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480ceb90 msgr2=0x7f56480cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564cca9640 1 --2- 172.21.15.103:0/1175314507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480ceb90 0x7f56480cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564cca9640 1 -- 172.21.15.103:0/1175314507 >> v2:172.21.15.190:3300/0 conn(0x7f564815f5c0 msgr2=0x7f56480ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564cca9640 1 --2- 172.21.15.103:0/1175314507 >> v2:172.21.15.190:3300/0 conn(0x7f564815f5c0 0x7f56480ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.865+0000 7f564cca9640 1 -- 172.21.15.103:0/1175314507 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480cd4c0 con 0x7f56480cfa90 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f564cca9640 1 --2- 172.21.15.103:0/1175314507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480cfa90 0x7f56480cff40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f56480d0fa0 tx=0x7f564002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07df75a9a002599 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f56477fe640 1 -- 172.21.15.103:0/1175314507 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5640036070 con 0x7f56480cfa90 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f56477fe640 1 -- 172.21.15.103:0/1175314507 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5640031600 con 0x7f56480cfa90 2024-08-18T23:57:31.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f56477fe640 1 -- 172.21.15.103:0/1175314507 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56400319d0 con 0x7f56480cfa90 2024-08-18T23:57:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f564e70c640 1 -- 172.21.15.103:0/1175314507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480cfa90 msgr2=0x7f56480cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f564e70c640 1 --2- 172.21.15.103:0/1175314507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480cfa90 0x7f56480cff40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f56480d0fa0 tx=0x7f564002a730 comp rx=0 tx=0).stop 2024-08-18T23:57:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f564e70c640 1 -- 172.21.15.103:0/1175314507 shutdown_connections 2024-08-18T23:57:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f564e70c640 1 --2- 172.21.15.103:0/1175314507 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480cfa90 0x7f56480cff40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f564e70c640 1 --2- 172.21.15.103:0/1175314507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480ceb90 0x7f56480cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f564e70c640 1 --2- 172.21.15.103:0/1175314507 >> v2:172.21.15.190:3300/0 conn(0x7f564815f5c0 0x7f56480ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.866+0000 7f564e70c640 1 -- 172.21.15.103:0/1175314507 >> 172.21.15.103:0/1175314507 conn(0x7f56480d1ec0 msgr2=0x7f56480d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:31.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.867+0000 7f564e70c640 1 -- 172.21.15.103:0/1175314507 shutdown_connections 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.867+0000 7f564e70c640 1 -- 172.21.15.103:0/1175314507 wait complete. 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f564e70c640 1 Processor -- start 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f564e70c640 1 -- start start 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f564e70c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480ceb90 0x7f56480caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f564e70c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480cfa90 0x7f56480b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f564e70c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564815f5c0 0x7f5648154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f564e70c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f564815f9a0 con 0x7f56480ceb90 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f564e70c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f56480cda80 con 0x7f564815f5c0 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f564e70c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f564815fb20 con 0x7f56480cfa90 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.868+0000 7f5647fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480ceb90 0x7f56480caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f5647fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480ceb90 0x7f56480caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47562/0 (socket says 172.21.15.103:47562) 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f5647fff640 1 -- 172.21.15.103:0/1974184194 learned_addr learned my addr 172.21.15.103:0/1974184194 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:31.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f563ffff640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480cfa90 0x7f56480b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f564cca9640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564815f5c0 0x7f5648154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f5647fff640 1 -- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480cfa90 msgr2=0x7f56480b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f5647fff640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480cfa90 0x7f56480b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f5647fff640 1 -- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564815f5c0 msgr2=0x7f5648154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f5647fff640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564815f5c0 0x7f5648154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f5647fff640 1 -- 172.21.15.103:0/1974184194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56480b60f0 con 0x7f56480ceb90 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f563ffff640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480cfa90 0x7f56480b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f564cca9640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564815f5c0 0x7f5648154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f5647fff640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480ceb90 0x7f56480caff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f563800d5f0 tx=0x7f563800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f56457fa640 1 -- 172.21.15.103:0/1974184194 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380125f0 con 0x7f56480ceb90 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f56457fa640 1 -- 172.21.15.103:0/1974184194 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5638019070 con 0x7f56480ceb90 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f56457fa640 1 -- 172.21.15.103:0/1974184194 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380129d0 con 0x7f56480ceb90 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56480b63d0 con 0x7f56480ceb90 2024-08-18T23:57:31.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.869+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56480b6990 con 0x7f56480ceb90 2024-08-18T23:57:31.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.870+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56480ce650 con 0x7f56480ceb90 2024-08-18T23:57:31.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.871+0000 7f56457fa640 1 -- 172.21.15.103:0/1974184194 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5638012b70 con 0x7f56480ceb90 2024-08-18T23:57:31.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.871+0000 7f56457fa640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f562806be30 0x7f562806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:31.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.871+0000 7f56457fa640 1 -- 172.21.15.103:0/1974184194 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f563808b520 con 0x7f56480ceb90 2024-08-18T23:57:31.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.871+0000 7f563ffff640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f562806be30 0x7f562806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:31.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.872+0000 7f563ffff640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f562806be30 0x7f562806e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f56480cd1e0 tx=0x7f5630008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:31.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:31.875+0000 7f56457fa640 1 -- 172.21.15.103:0/1974184194 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5638059c20 con 0x7f56480ceb90 2024-08-18T23:57:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.052+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f564806f950 con 0x7f56480ceb90 2024-08-18T23:57:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.053+0000 7f56457fa640 1 -- 172.21.15.103:0/1974184194 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f5638059520 con 0x7f56480ceb90 2024-08-18T23:57:32.054 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f562806be30 msgr2=0x7f562806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f562806be30 0x7f562806e2f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f56480cd1e0 tx=0x7f5630008040 comp rx=0 tx=0).stop 2024-08-18T23:57:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480ceb90 msgr2=0x7f56480caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480ceb90 0x7f56480caff0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f563800d5f0 tx=0x7f563800dab0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 shutdown_connections 2024-08-18T23:57:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f562806be30 0x7f562806e2f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564815f5c0 0x7f5648154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56480cfa90 0x7f56480b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 --2- 172.21.15.103:0/1974184194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56480ceb90 0x7f56480caff0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 >> 172.21.15.103:0/1974184194 conn(0x7f56480d1ec0 msgr2=0x7f564815e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 shutdown_connections 2024-08-18T23:57:32.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.055+0000 7f564e70c640 1 -- 172.21.15.103:0/1974184194 wait complete. 2024-08-18T23:57:32.067 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-08-18T23:57:32.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:32.067 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:32.092 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:32.093 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:57:32.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:32.093 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T23:57:32.149 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:57:32.149 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:32.169 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:57:32.169 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:32.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:32.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.326+0000 7fa1b06fc640 1 Processor -- start 2024-08-18T23:57:32.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.326+0000 7fa1b06fc640 1 -- start start 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.327+0000 7fa1b06fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.327+0000 7fa1b06fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1a815fbe0 0x7fa1a80ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.327+0000 7fa1b06fc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1a80d0b40 con 0x7fa1a80d0680 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.327+0000 7fa1b06fc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa1a806f830 con 0x7fa1a815fbe0 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.327+0000 7fa1b06fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a80d0e20 con 0x7fa1a80b1540 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1adc97640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1a815fbe0 0x7fa1a80ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1ae498640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1aec99640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa1a80d0680 0x7fa1a815db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:59030/0 (socket says 172.21.15.103:59030) 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1ae498640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:51038/0 (socket says 172.21.15.103:51038) 2024-08-18T23:57:32.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1aec99640 1 -- 172.21.15.103:0/4100769878 learned_addr learned my addr 172.21.15.103:0/4100769878 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1ad496640 1 -- 172.21.15.103:0/4100769878 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839462938 0 0) 0x7fa1a80d0b40 con 0x7fa1a80d0680 2024-08-18T23:57:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1ae498640 1 -- 172.21.15.103:0/4100769878 >> v2:172.21.15.190:3300/0 conn(0x7fa1a815fbe0 msgr2=0x7fa1a80ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1ae498640 1 --2- 172.21.15.103:0/4100769878 >> v2:172.21.15.190:3300/0 conn(0x7fa1a815fbe0 0x7fa1a80ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1ae498640 1 -- 172.21.15.103:0/4100769878 >> v1:172.21.15.190:6789/0 conn(0x7fa1a80d0680 legacy=0x7fa1a815db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.328+0000 7fa1ae498640 1 -- 172.21.15.103:0/4100769878 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a80d1100 con 0x7fa1a80b1540 2024-08-18T23:57:32.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.329+0000 7fa1ae498640 1 --2- 172.21.15.103:0/4100769878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80d0140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009d90 tx=0x7fa1a402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61269d6857b763f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.329+0000 7fa1ad496640 1 -- 172.21.15.103:0/4100769878 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4007740 con 0x7fa1a80b1540 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.329+0000 7fa1ad496640 1 -- 172.21.15.103:0/4100769878 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a40078e0 con 0x7fa1a80b1540 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.329+0000 7fa1ad496640 1 -- 172.21.15.103:0/4100769878 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4007cb0 con 0x7fa1a80b1540 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.329+0000 7fa1b06fc640 1 -- 172.21.15.103:0/4100769878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 msgr2=0x7fa1a80d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.329+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/4100769878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80d0140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009d90 tx=0x7fa1a402a6f0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.329+0000 7fa1b06fc640 1 -- 172.21.15.103:0/4100769878 shutdown_connections 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.330+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/4100769878 >> v2:172.21.15.190:3300/0 conn(0x7fa1a815fbe0 0x7fa1a80ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.330+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/4100769878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80d0140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.330+0000 7fa1b06fc640 1 -- 172.21.15.103:0/4100769878 >> 172.21.15.103:0/4100769878 conn(0x7fa1a80d1ee0 msgr2=0x7fa1a80d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.330+0000 7fa1b06fc640 1 -- 172.21.15.103:0/4100769878 shutdown_connections 2024-08-18T23:57:32.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.330+0000 7fa1b06fc640 1 -- 172.21.15.103:0/4100769878 wait complete. 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.331+0000 7fa1b06fc640 1 Processor -- start 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.331+0000 7fa1b06fc640 1 -- start start 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.331+0000 7fa1b06fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.331+0000 7fa1b06fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80d0680 0x7fa1a815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.331+0000 7fa1b06fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a815fbe0 0x7fa1a80cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.331+0000 7fa1b06fc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a815eb40 con 0x7fa1a80d0680 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.331+0000 7fa1b06fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a815e9c0 con 0x7fa1a815fbe0 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.331+0000 7fa1b06fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1a80ceda0 con 0x7fa1a80b1540 2024-08-18T23:57:32.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80d0680 0x7fa1a815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80d0680 0x7fa1a815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47566/0 (socket says 172.21.15.103:47566) 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 -- 172.21.15.103:0/1389553203 learned_addr learned my addr 172.21.15.103:0/1389553203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1ae498640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1aec99640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a815fbe0 0x7fa1a80cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 -- 172.21.15.103:0/1389553203 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 msgr2=0x7fa1a80b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 -- 172.21.15.103:0/1389553203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a815fbe0 msgr2=0x7fa1a80cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a815fbe0 0x7fa1a80cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 -- 172.21.15.103:0/1389553203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a80c7de0 con 0x7fa1a80d0680 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1adc97640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80d0680 0x7fa1a815dfd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa19800e870 tx=0x7fa19800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa19effd640 1 -- 172.21.15.103:0/1389553203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa198017070 con 0x7fa1a80d0680 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa19effd640 1 -- 172.21.15.103:0/1389553203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa19800ee60 con 0x7fa1a80d0680 2024-08-18T23:57:32.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a80c80c0 con 0x7fa1a80d0680 2024-08-18T23:57:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa19effd640 1 -- 172.21.15.103:0/1389553203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19800cb40 con 0x7fa1a80d0680 2024-08-18T23:57:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.332+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a80c8680 con 0x7fa1a80d0680 2024-08-18T23:57:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.333+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1a80cf100 con 0x7fa1a80d0680 2024-08-18T23:57:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.334+0000 7fa19effd640 1 -- 172.21.15.103:0/1389553203 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa19801a070 con 0x7fa1a80d0680 2024-08-18T23:57:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.334+0000 7fa19effd640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa18c06be60 0x7fa18c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.334+0000 7fa19effd640 1 -- 172.21.15.103:0/1389553203 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa19808b210 con 0x7fa1a80d0680 2024-08-18T23:57:32.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.334+0000 7fa1ae498640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa18c06be60 0x7fa18c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.335+0000 7fa1ae498640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa18c06be60 0x7fa18c06e320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4034000 tx=0x7fa1a402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:32.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.338+0000 7fa19effd640 1 -- 172.21.15.103:0/1389553203 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa1980592c0 con 0x7fa1a80d0680 2024-08-18T23:57:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.516+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa1a80b7e60 con 0x7fa1a80d0680 2024-08-18T23:57:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.517+0000 7fa19effd640 1 -- 172.21.15.103:0/1389553203 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fa19805d5c0 con 0x7fa1a80d0680 2024-08-18T23:57:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:32.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.518+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa18c06be60 msgr2=0x7fa18c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.518+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa18c06be60 0x7fa18c06e320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4034000 tx=0x7fa1a402f000 comp rx=0 tx=0).stop 2024-08-18T23:57:32.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.518+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80d0680 msgr2=0x7fa1a815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.518+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80d0680 0x7fa1a815dfd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa19800e870 tx=0x7fa19800ed30 comp rx=0 tx=0).stop 2024-08-18T23:57:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.519+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 shutdown_connections 2024-08-18T23:57:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.519+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa18c06be60 0x7fa18c06e320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.519+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1a815fbe0 0x7fa1a80cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.519+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80d0680 0x7fa1a815dfd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.519+0000 7fa1b06fc640 1 --2- 172.21.15.103:0/1389553203 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1a80b1540 0x7fa1a80b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.519+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 >> 172.21.15.103:0/1389553203 conn(0x7fa1a80d1ee0 msgr2=0x7fa1a80b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.519+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 shutdown_connections 2024-08-18T23:57:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.519+0000 7fa1b06fc640 1 -- 172.21.15.103:0/1389553203 wait complete. 2024-08-18T23:57:32.531 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:57:32.531 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:32.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:32.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.649+0000 7f9208ba1640 1 Processor -- start 2024-08-18T23:57:32.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.649+0000 7f9208ba1640 1 -- start start 2024-08-18T23:57:32.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.649+0000 7f9208ba1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f920406cc20 0x7f9204070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9208ba1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9204071000 con 0x7f92040d1770 2024-08-18T23:57:32.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9208ba1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92040cc690 con 0x7f920406db30 2024-08-18T23:57:32.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9208ba1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f920406c760 con 0x7f920406cc20 2024-08-18T23:57:32.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9202d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f920406cc20 0x7f9204070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f920259c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f92040d1770 0x7f920406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:56368/0 (socket says 172.21.15.103:56368) 2024-08-18T23:57:32.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9202d9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f920406cc20 0x7f9204070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47572/0 (socket says 172.21.15.103:47572) 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f920259c640 1 -- 172.21.15.103:0/3929588248 learned_addr learned my addr 172.21.15.103:0/3929588248 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9202d9d640 1 -- 172.21.15.103:0/3929588248 >> v1:172.21.15.190:6789/0 conn(0x7f920406db30 legacy=0x7f92040cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9202d9d640 1 -- 172.21.15.103:0/3929588248 >> v1:172.21.15.103:6789/0 conn(0x7f92040d1770 legacy=0x7f920406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9202d9d640 1 -- 172.21.15.103:0/3929588248 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92040cc970 con 0x7f920406cc20 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.650+0000 7f9201d9b640 1 -- 172.21.15.103:0/3929588248 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589220583 0 0) 0x7f9204071000 con 0x7f92040d1770 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9202d9d640 1 --2- 172.21.15.103:0/3929588248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f920406cc20 0x7f9204070920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009d90 tx=0x7f91fc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60af5385aa9e5d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9201d9b640 1 -- 172.21.15.103:0/3929588248 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc031600 con 0x7f920406cc20 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9201d9b640 1 -- 172.21.15.103:0/3929588248 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc0317a0 con 0x7f920406cc20 2024-08-18T23:57:32.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9201d9b640 1 -- 172.21.15.103:0/3929588248 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc031b70 con 0x7f920406cc20 2024-08-18T23:57:32.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9208ba1640 1 -- 172.21.15.103:0/3929588248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f920406cc20 msgr2=0x7f9204070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9208ba1640 1 --2- 172.21.15.103:0/3929588248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f920406cc20 0x7f9204070920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009d90 tx=0x7f91fc02a610 comp rx=0 tx=0).stop 2024-08-18T23:57:32.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9208ba1640 1 -- 172.21.15.103:0/3929588248 shutdown_connections 2024-08-18T23:57:32.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9208ba1640 1 --2- 172.21.15.103:0/3929588248 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f920406cc20 0x7f9204070920 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9208ba1640 1 -- 172.21.15.103:0/3929588248 >> 172.21.15.103:0/3929588248 conn(0x7f92040d1ec0 msgr2=0x7f92040d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:32.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9208ba1640 1 -- 172.21.15.103:0/3929588248 shutdown_connections 2024-08-18T23:57:32.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.651+0000 7f9208ba1640 1 -- 172.21.15.103:0/3929588248 wait complete. 2024-08-18T23:57:32.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.653+0000 7f9208ba1640 1 Processor -- start 2024-08-18T23:57:32.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.653+0000 7f9208ba1640 1 -- start start 2024-08-18T23:57:32.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9208ba1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920406cc20 0x7f92040b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9208ba1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920406db30 0x7f9204153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9208ba1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92040d1770 0x7f92040aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9208ba1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f92040cd880 con 0x7f92040d1770 2024-08-18T23:57:32.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9208ba1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f92040ccce0 con 0x7f920406db30 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9208ba1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f92040cda00 con 0x7f920406cc20 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92040d1770 0x7f92040aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92040d1770 0x7f92040aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47584/0 (socket says 172.21.15.103:47584) 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 -- 172.21.15.103:0/2531912338 learned_addr learned my addr 172.21.15.103:0/2531912338 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f920259c640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920406cc20 0x7f92040b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f91f9d9b640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920406db30 0x7f9204153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 -- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920406cc20 msgr2=0x7f92040b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920406cc20 0x7f92040b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 -- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920406db30 msgr2=0x7f9204153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920406db30 0x7f9204153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 -- 172.21.15.103:0/2531912338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9204154a10 con 0x7f92040d1770 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f91f9d9b640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920406db30 0x7f9204153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:32.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f9202d9d640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92040d1770 0x7f92040aec10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009d90 tx=0x7f91fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:32.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f91fb7fe640 1 -- 172.21.15.103:0/2531912338 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc040070 con 0x7f92040d1770 2024-08-18T23:57:32.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.654+0000 7f91fb7fe640 1 -- 172.21.15.103:0/2531912338 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc030be0 con 0x7f92040d1770 2024-08-18T23:57:32.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.655+0000 7f91fb7fe640 1 -- 172.21.15.103:0/2531912338 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc009450 con 0x7f92040d1770 2024-08-18T23:57:32.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.655+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9204154cf0 con 0x7f92040d1770 2024-08-18T23:57:32.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.655+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92041523b0 con 0x7f92040d1770 2024-08-18T23:57:32.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.656+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9204151ec0 con 0x7f92040d1770 2024-08-18T23:57:32.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.656+0000 7f91fb7fe640 1 -- 172.21.15.103:0/2531912338 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91fc039040 con 0x7f92040d1770 2024-08-18T23:57:32.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.657+0000 7f91fb7fe640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91e406be30 0x7f91e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:32.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.657+0000 7f920259c640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91e406be30 0x7f91e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:32.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.657+0000 7f91fb7fe640 1 -- 172.21.15.103:0/2531912338 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f91fc0abf90 con 0x7f92040d1770 2024-08-18T23:57:32.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.657+0000 7f920259c640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91e406be30 0x7f91e406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f91f4007fd0 tx=0x7f91f4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:32.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.661+0000 7f91fb7fe640 1 -- 172.21.15.103:0/2531912338 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f91fc079fb0 con 0x7f92040d1770 2024-08-18T23:57:32.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.840+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9204070920 con 0x7f92040d1770 2024-08-18T23:57:32.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.840+0000 7f91fb7fe640 1 -- 172.21.15.103:0/2531912338 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f91fc07e2b0 con 0x7f92040d1770 2024-08-18T23:57:32.842 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:32.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91e406be30 msgr2=0x7f91e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91e406be30 0x7f91e406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f91f4007fd0 tx=0x7f91f4007de0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92040d1770 msgr2=0x7f92040aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:32.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92040d1770 0x7f92040aec10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009d90 tx=0x7f91fc004a40 comp rx=0 tx=0).stop 2024-08-18T23:57:32.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 shutdown_connections 2024-08-18T23:57:32.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f91e406be30 0x7f91e406e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92040d1770 0x7f92040aec10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f920406db30 0x7f9204153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 --2- 172.21.15.103:0/2531912338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f920406cc20 0x7f92040b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:32.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 >> 172.21.15.103:0/2531912338 conn(0x7f92040d1ec0 msgr2=0x7f92040c7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:32.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.842+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 shutdown_connections 2024-08-18T23:57:32.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:32.843+0000 7f9208ba1640 1 -- 172.21.15.103:0/2531912338 wait complete. 2024-08-18T23:57:32.855 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi190.front.sepia.ceph.com... 2024-08-18T23:57:32.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:32.855 DEBUG:teuthology.orchestra.run.smithi190:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-08-18T23:57:32.885 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:32.886 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:57:32.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:32.886 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-18T23:57:32.957 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:57:32.957 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:32.973 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:57:32.973 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:33.029 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:33.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.168+0000 7f628117a640 1 Processor -- start 2024-08-18T23:57:33.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.168+0000 7f628117a640 1 -- start start 2024-08-18T23:57:33.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f628117a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f627c15ea60 0x7f627c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f628117a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c0c6170 0x7f627c0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f628117a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f627c0721d0 con 0x7f627c15ae70 2024-08-18T23:57:33.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f628117a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f627c15b250 con 0x7f627c15ea60 2024-08-18T23:57:33.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f628117a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f627c0c65c0 con 0x7f627c0c6170 2024-08-18T23:57:33.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f627a59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f627c15ea60 0x7f627c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f627a59c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f627c15ea60 0x7f627c0c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39042/0 (socket says 172.21.15.103:39042) 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f627a59c640 1 -- 172.21.15.103:0/970169535 learned_addr learned my addr 172.21.15.103:0/970169535 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f627a59c640 1 -- 172.21.15.103:0/970169535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c0c6170 msgr2=0x7f627c0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f627b59e640 1 --2- 172.21.15.103:0/970169535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c0c6170 0x7f627c0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f627a59c640 1 --2- 172.21.15.103:0/970169535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c0c6170 0x7f627c0ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f627a59c640 1 -- 172.21.15.103:0/970169535 >> v1:172.21.15.190:6789/0 conn(0x7f627c15ae70 legacy=0x7f627c15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.169+0000 7f627a59c640 1 -- 172.21.15.103:0/970169535 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c072450 con 0x7f627c15ea60 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.170+0000 7f627a59c640 1 --2- 172.21.15.103:0/970169535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ea60 0x7f627c0c5c30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f627c0cc6b0 tx=0x7f627002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e493670380564e1c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.170+0000 7f6279d9b640 1 -- 172.21.15.103:0/970169535 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270037070 con 0x7f627c15ea60 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.170+0000 7f6279d9b640 1 -- 172.21.15.103:0/970169535 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627002ae50 con 0x7f627c15ea60 2024-08-18T23:57:33.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.170+0000 7f6279d9b640 1 -- 172.21.15.103:0/970169535 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270032660 con 0x7f627c15ea60 2024-08-18T23:57:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.171+0000 7f628117a640 1 -- 172.21.15.103:0/970169535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ea60 msgr2=0x7f627c0c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.171+0000 7f628117a640 1 --2- 172.21.15.103:0/970169535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ea60 0x7f627c0c5c30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f627c0cc6b0 tx=0x7f627002a140 comp rx=0 tx=0).stop 2024-08-18T23:57:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.171+0000 7f628117a640 1 -- 172.21.15.103:0/970169535 shutdown_connections 2024-08-18T23:57:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.171+0000 7f628117a640 1 --2- 172.21.15.103:0/970169535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c0c6170 0x7f627c0ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.171+0000 7f628117a640 1 --2- 172.21.15.103:0/970169535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ea60 0x7f627c0c5c30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.171+0000 7f628117a640 1 -- 172.21.15.103:0/970169535 >> 172.21.15.103:0/970169535 conn(0x7f627c0cc6e0 msgr2=0x7f627c0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.171+0000 7f628117a640 1 -- 172.21.15.103:0/970169535 shutdown_connections 2024-08-18T23:57:33.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.171+0000 7f628117a640 1 -- 172.21.15.103:0/970169535 wait complete. 2024-08-18T23:57:33.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.172+0000 7f628117a640 1 Processor -- start 2024-08-18T23:57:33.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.172+0000 7f628117a640 1 -- start start 2024-08-18T23:57:33.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f628117a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f627c0c6170 0x7f627c154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f628117a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ae70 0x7f627c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f628117a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c15ea60 0x7f627c0ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f628117a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f627c072cf0 con 0x7f627c15ae70 2024-08-18T23:57:33.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f628117a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f627c072a10 con 0x7f627c0c6170 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f628117a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f627c072fd0 con 0x7f627c15ea60 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f627a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ae70 0x7f627c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f627a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ae70 0x7f627c0b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39050/0 (socket says 172.21.15.103:39050) 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f627a59c640 1 -- 172.21.15.103:0/332417090 learned_addr learned my addr 172.21.15.103:0/332417090 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f627ad9d640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f627c0c6170 0x7f627c154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.173+0000 7f627b59e640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c15ea60 0x7f627c0ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f627a59c640 1 -- 172.21.15.103:0/332417090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c15ea60 msgr2=0x7f627c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f627a59c640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c15ea60 0x7f627c0ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f627a59c640 1 -- 172.21.15.103:0/332417090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f627c0c6170 msgr2=0x7f627c154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f627a59c640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f627c0c6170 0x7f627c154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f627a59c640 1 -- 172.21.15.103:0/332417090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f627c09dd50 con 0x7f627c15ae70 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f627a59c640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ae70 0x7f627c0b1d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6270000c00 tx=0x7f62700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f62637fe640 1 -- 172.21.15.103:0/332417090 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270041070 con 0x7f627c15ae70 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f62637fe640 1 -- 172.21.15.103:0/332417090 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627003c670 con 0x7f627c15ae70 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f62637fe640 1 -- 172.21.15.103:0/332417090 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270037040 con 0x7f627c15ae70 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f627c154fa0 con 0x7f627c15ae70 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.174+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f627c1f82d0 con 0x7f627c15ae70 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.175+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627c0734f0 con 0x7f627c15ae70 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.176+0000 7f62637fe640 1 -- 172.21.15.103:0/332417090 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6270044070 con 0x7f627c15ae70 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.176+0000 7f62637fe640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f626806be30 0x7f626806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.176+0000 7f62637fe640 1 -- 172.21.15.103:0/332417090 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f62700ab990 con 0x7f627c15ae70 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.176+0000 7f627ad9d640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f626806be30 0x7f626806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.176+0000 7f627ad9d640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f626806be30 0x7f626806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f626c004f60 tx=0x7f626c007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.180+0000 7f62637fe640 1 -- 172.21.15.103:0/332417090 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f627c0721d0 con 0x7f627c15ae70 2024-08-18T23:57:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.357+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f627c0af500 con 0x7f627c15ae70 2024-08-18T23:57:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.357+0000 7f62637fe640 1 -- 172.21.15.103:0/332417090 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f6270079b60 con 0x7f627c15ae70 2024-08-18T23:57:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f626806be30 msgr2=0x7f626806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f626806be30 0x7f626806e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f626c004f60 tx=0x7f626c007e30 comp rx=0 tx=0).stop 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ae70 msgr2=0x7f627c0b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ae70 0x7f627c0b1d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6270000c00 tx=0x7f62700046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 shutdown_connections 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f626806be30 0x7f626806e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f627c15ea60 0x7f627c0ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f627c15ae70 0x7f627c0b1d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 --2- 172.21.15.103:0/332417090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f627c0c6170 0x7f627c154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 >> 172.21.15.103:0/332417090 conn(0x7f627c0cc6e0 msgr2=0x7f627c0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 shutdown_connections 2024-08-18T23:57:33.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.359+0000 7f628117a640 1 -- 172.21.15.103:0/332417090 wait complete. 2024-08-18T23:57:33.371 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:57:33.371 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:33.387 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.525+0000 7f5019d93640 1 Processor -- start 2024-08-18T23:57:33.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.525+0000 7f5019d93640 1 -- start start 2024-08-18T23:57:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.526+0000 7f5019d93640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f501406db30 0x7f5014070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.526+0000 7f5019d93640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f501406cc20 0x7f50140cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.526+0000 7f5019d93640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5014071000 con 0x7f50140d1770 2024-08-18T23:57:33.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.526+0000 7f5019d93640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f501406c760 con 0x7f501406cc20 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.526+0000 7f5019d93640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f50140ccce0 con 0x7f501406db30 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.526+0000 7f5013fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f501406cc20 0x7f50140cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.526+0000 7f50137fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f50140d1770 0x7f501406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39682/0 (socket says 172.21.15.103:39682) 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.526+0000 7f50137fe640 1 -- 172.21.15.103:0/3474702023 learned_addr learned my addr 172.21.15.103:0/3474702023 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.527+0000 7f5012ffd640 1 --2- 172.21.15.103:0/3474702023 >> v2:172.21.15.190:3300/0 conn(0x7f501406db30 0x7f5014070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.527+0000 7f5013fff640 1 -- 172.21.15.103:0/3474702023 >> v2:172.21.15.190:3300/0 conn(0x7f501406db30 msgr2=0x7f5014070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.527+0000 7f5013fff640 1 --2- 172.21.15.103:0/3474702023 >> v2:172.21.15.190:3300/0 conn(0x7f501406db30 0x7f5014070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.527+0000 7f5013fff640 1 -- 172.21.15.103:0/3474702023 >> v1:172.21.15.103:6789/0 conn(0x7f50140d1770 legacy=0x7f501406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.527+0000 7f5013fff640 1 -- 172.21.15.103:0/3474702023 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50140cc690 con 0x7f501406cc20 2024-08-18T23:57:33.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.527+0000 7f50127fc640 1 -- 172.21.15.103:0/3474702023 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238600044 0 0) 0x7f5014071000 con 0x7f50140d1770 2024-08-18T23:57:33.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.527+0000 7f5013fff640 1 --2- 172.21.15.103:0/3474702023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406cc20 0x7f50140cd170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50140b3940 tx=0x7f500c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b45e23a050ba24 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.527+0000 7f50127fc640 1 -- 172.21.15.103:0/3474702023 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c007740 con 0x7f501406cc20 2024-08-18T23:57:33.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f50127fc640 1 -- 172.21.15.103:0/3474702023 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c0078e0 con 0x7f501406cc20 2024-08-18T23:57:33.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f50127fc640 1 -- 172.21.15.103:0/3474702023 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c007cb0 con 0x7f501406cc20 2024-08-18T23:57:33.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f5019d93640 1 -- 172.21.15.103:0/3474702023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406cc20 msgr2=0x7f50140cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f5019d93640 1 --2- 172.21.15.103:0/3474702023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406cc20 0x7f50140cd170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50140b3940 tx=0x7f500c02a5f0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f5019d93640 1 -- 172.21.15.103:0/3474702023 shutdown_connections 2024-08-18T23:57:33.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f5019d93640 1 --2- 172.21.15.103:0/3474702023 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406cc20 0x7f50140cd170 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f5019d93640 1 --2- 172.21.15.103:0/3474702023 >> v2:172.21.15.190:3300/0 conn(0x7f501406db30 0x7f5014070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f5019d93640 1 -- 172.21.15.103:0/3474702023 >> 172.21.15.103:0/3474702023 conn(0x7f50140d1ec0 msgr2=0x7f50140d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:33.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f5019d93640 1 -- 172.21.15.103:0/3474702023 shutdown_connections 2024-08-18T23:57:33.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.528+0000 7f5019d93640 1 -- 172.21.15.103:0/3474702023 wait complete. 2024-08-18T23:57:33.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.529+0000 7f5019d93640 1 Processor -- start 2024-08-18T23:57:33.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.529+0000 7f5019d93640 1 -- start start 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5019d93640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501406cc20 0x7f501409c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5019d93640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406db30 0x7f501409e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5019d93640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50140d1770 0x7f501409ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5019d93640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50140cd6b0 con 0x7f501406db30 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5019d93640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f50140d1b50 con 0x7f501406cc20 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5019d93640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f50140cd830 con 0x7f50140d1770 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5012ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406db30 0x7f501409e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5012ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406db30 0x7f501409e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39066/0 (socket says 172.21.15.103:39066) 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5012ffd640 1 -- 172.21.15.103:0/1188385008 learned_addr learned my addr 172.21.15.103:0/1188385008 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f50137fe640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501406cc20 0x7f501409c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.530+0000 7f5013fff640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50140d1770 0x7f501409ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f5012ffd640 1 -- 172.21.15.103:0/1188385008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50140d1770 msgr2=0x7f501409ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f5012ffd640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50140d1770 0x7f501409ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f5012ffd640 1 -- 172.21.15.103:0/1188385008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501406cc20 msgr2=0x7f501409c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f5012ffd640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501406cc20 0x7f501409c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f5012ffd640 1 -- 172.21.15.103:0/1188385008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501409f0f0 con 0x7f501406db30 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f5012ffd640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406db30 0x7f501409e530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f500800d800 tx=0x7f500800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f4ffbfff640 1 -- 172.21.15.103:0/1188385008 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500800b6c0 con 0x7f501406db30 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f4ffbfff640 1 -- 172.21.15.103:0/1188385008 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5008019070 con 0x7f501406db30 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f4ffbfff640 1 -- 172.21.15.103:0/1188385008 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500800ba80 con 0x7f501406db30 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501409f3d0 con 0x7f501406db30 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.531+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501409f990 con 0x7f501406db30 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.532+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50140cd150 con 0x7f501406db30 2024-08-18T23:57:33.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.532+0000 7f4ffbfff640 1 -- 172.21.15.103:0/1188385008 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f500800bc20 con 0x7f501406db30 2024-08-18T23:57:33.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.533+0000 7f4ffbfff640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f500006be30 0x7f500006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.533+0000 7f4ffbfff640 1 -- 172.21.15.103:0/1188385008 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f500808b520 con 0x7f501406db30 2024-08-18T23:57:33.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.533+0000 7f50137fe640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f500006be30 0x7f500006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.533+0000 7f50137fe640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f500006be30 0x7f500006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5004007fd0 tx=0x7f5004007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.537+0000 7f4ffbfff640 1 -- 172.21.15.103:0/1188385008 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5008059540 con 0x7f501406db30 2024-08-18T23:57:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.713+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f50140d0420 con 0x7f501406db30 2024-08-18T23:57:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.713+0000 7f4ffbfff640 1 -- 172.21.15.103:0/1188385008 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f500805d840 con 0x7f501406db30 2024-08-18T23:57:33.715 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.715+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f500006be30 msgr2=0x7f500006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.715+0000 7f5019d93640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f500006be30 0x7f500006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5004007fd0 tx=0x7f5004007de0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.715+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406db30 msgr2=0x7f501409e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406db30 0x7f501409e530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f500800d800 tx=0x7f500800dcc0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 shutdown_connections 2024-08-18T23:57:33.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f500006be30 0x7f500006e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f50140d1770 0x7f501409ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f501406db30 0x7f501409e530 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 --2- 172.21.15.103:0/1188385008 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f501406cc20 0x7f501409c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 >> 172.21.15.103:0/1188385008 conn(0x7f50140d1ec0 msgr2=0x7f50140b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:33.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 shutdown_connections 2024-08-18T23:57:33.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.716+0000 7f5019d93640 1 -- 172.21.15.103:0/1188385008 wait complete. 2024-08-18T23:57:33.728 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-08-18T23:57:33.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:33.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-08-18T23:57:33.753 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:33.753 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:57:33.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:33.754 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-18T23:57:33.809 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:57:33.809 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:33.828 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:57:33.828 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:33.887 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:33.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.985+0000 7fdb53525640 1 Processor -- start 2024-08-18T23:57:33.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.985+0000 7fdb53525640 1 -- start start 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb53525640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c06b900 0x7fdb4c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb53525640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb4c0c50e0 0x7fdb4c0c5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb53525640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4c06c220 con 0x7fdb4c15fa10 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb53525640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4c0c4c50 con 0x7fdb4c0c50e0 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb53525640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4c159e80 con 0x7fdb4c06b900 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb50ac0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdb4c0c50e0 0x7fdb4c0c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb51ac2640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fdb4c15fa10 0x7fdb4c071530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39686/0 (socket says 172.21.15.103:39686) 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb51ac2640 1 -- 172.21.15.103:0/1943633303 learned_addr learned my addr 172.21.15.103:0/1943633303 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.986+0000 7fdb512c1640 1 --2- 172.21.15.103:0/1943633303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c06b900 0x7fdb4c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb50ac0640 1 -- 172.21.15.103:0/1943633303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c06b900 msgr2=0x7fdb4c06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:33.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb50ac0640 1 --2- 172.21.15.103:0/1943633303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c06b900 0x7fdb4c06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb50ac0640 1 -- 172.21.15.103:0/1943633303 >> v1:172.21.15.103:6789/0 conn(0x7fdb4c15fa10 legacy=0x7fdb4c071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb43fff640 1 -- 172.21.15.103:0/1943633303 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3109003597 0 0) 0x7fdb4c06c220 con 0x7fdb4c15fa10 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb50ac0640 1 -- 172.21.15.103:0/1943633303 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c0cb5e0 con 0x7fdb4c0c50e0 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb512c1640 1 --2- 172.21.15.103:0/1943633303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c06b900 0x7fdb4c06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb50ac0640 1 --2- 172.21.15.103:0/1943633303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0c50e0 0x7fdb4c0c5520 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0097a0 tx=0x7fdb3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44087227fd173bd server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb43fff640 1 -- 172.21.15.103:0/1943633303 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c037070 con 0x7fdb4c0c50e0 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb43fff640 1 -- 172.21.15.103:0/1943633303 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb3c032440 con 0x7fdb4c0c50e0 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.987+0000 7fdb43fff640 1 -- 172.21.15.103:0/1943633303 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c032810 con 0x7fdb4c0c50e0 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.988+0000 7fdb53525640 1 -- 172.21.15.103:0/1943633303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0c50e0 msgr2=0x7fdb4c0c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.988+0000 7fdb53525640 1 --2- 172.21.15.103:0/1943633303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0c50e0 0x7fdb4c0c5520 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0097a0 tx=0x7fdb3c02a180 comp rx=0 tx=0).stop 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.988+0000 7fdb53525640 1 -- 172.21.15.103:0/1943633303 shutdown_connections 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.988+0000 7fdb53525640 1 --2- 172.21.15.103:0/1943633303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c0c50e0 0x7fdb4c0c5520 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.988+0000 7fdb53525640 1 --2- 172.21.15.103:0/1943633303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c06b900 0x7fdb4c06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.988+0000 7fdb53525640 1 -- 172.21.15.103:0/1943633303 >> 172.21.15.103:0/1943633303 conn(0x7fdb4c0cc6e0 msgr2=0x7fdb4c0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:33.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.988+0000 7fdb53525640 1 -- 172.21.15.103:0/1943633303 shutdown_connections 2024-08-18T23:57:33.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.988+0000 7fdb53525640 1 -- 172.21.15.103:0/1943633303 wait complete. 2024-08-18T23:57:33.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.989+0000 7fdb53525640 1 Processor -- start 2024-08-18T23:57:33.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.989+0000 7fdb53525640 1 -- start start 2024-08-18T23:57:33.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb53525640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb4c06b900 0x7fdb4c0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb53525640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c0c50e0 0x7fdb4c0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb53525640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c15fa10 0x7fdb4c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb53525640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c0cbe80 con 0x7fdb4c15fa10 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb53525640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4c0cbba0 con 0x7fdb4c06b900 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb53525640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4c071c40 con 0x7fdb4c0c50e0 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c15fa10 0x7fdb4c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c15fa10 0x7fdb4c1f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39084/0 (socket says 172.21.15.103:39084) 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 -- 172.21.15.103:0/3979446944 learned_addr learned my addr 172.21.15.103:0/3979446944 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb50ac0640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c0c50e0 0x7fdb4c0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb512c1640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb4c06b900 0x7fdb4c0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 -- 172.21.15.103:0/3979446944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c0c50e0 msgr2=0x7fdb4c0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c0c50e0 0x7fdb4c0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 -- 172.21.15.103:0/3979446944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb4c06b900 msgr2=0x7fdb4c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb4c06b900 0x7fdb4c0b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 -- 172.21.15.103:0/3979446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4c0b30f0 con 0x7fdb4c15fa10 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.990+0000 7fdb51ac2640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c15fa10 0x7fdb4c1f5a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c700 tx=0x7fdb4400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.991+0000 7fdb41ffb640 1 -- 172.21.15.103:0/3979446944 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb44018070 con 0x7fdb4c15fa10 2024-08-18T23:57:33.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.991+0000 7fdb41ffb640 1 -- 172.21.15.103:0/3979446944 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb4400ce10 con 0x7fdb4c15fa10 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.991+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4c09c630 con 0x7fdb4c15fa10 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.991+0000 7fdb41ffb640 1 -- 172.21.15.103:0/3979446944 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400a860 con 0x7fdb4c15fa10 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.991+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb4c1f6750 con 0x7fdb4c15fa10 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.992+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb4c15fec0 con 0x7fdb4c15fa10 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.992+0000 7fdb41ffb640 1 -- 172.21.15.103:0/3979446944 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb4401b070 con 0x7fdb4c15fa10 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.993+0000 7fdb41ffb640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdb3006be30 0x7fdb3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.993+0000 7fdb512c1640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdb3006be30 0x7fdb3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.993+0000 7fdb41ffb640 1 -- 172.21.15.103:0/3979446944 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdb4408a690 con 0x7fdb4c15fa10 2024-08-18T23:57:33.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.993+0000 7fdb512c1640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdb3006be30 0x7fdb3006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800a990 tx=0x7fdb48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:33.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:33.997+0000 7fdb41ffb640 1 -- 172.21.15.103:0/3979446944 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdb44058d90 con 0x7fdb4c15fa10 2024-08-18T23:57:34.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.173+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdb4c06f950 con 0x7fdb4c15fa10 2024-08-18T23:57:34.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.174+0000 7fdb41ffb640 1 -- 172.21.15.103:0/3979446944 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fdb44058690 con 0x7fdb4c15fa10 2024-08-18T23:57:34.175 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdb3006be30 msgr2=0x7fdb3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdb3006be30 0x7fdb3006e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800a990 tx=0x7fdb48008040 comp rx=0 tx=0).stop 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c15fa10 msgr2=0x7fdb4c1f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c15fa10 0x7fdb4c1f5a20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400c700 tx=0x7fdb4400cbc0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 shutdown_connections 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdb3006be30 0x7fdb3006e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdb4c15fa10 0x7fdb4c1f5a20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdb4c0c50e0 0x7fdb4c0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 --2- 172.21.15.103:0/3979446944 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdb4c06b900 0x7fdb4c0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 >> 172.21.15.103:0/3979446944 conn(0x7fdb4c0cc6e0 msgr2=0x7fdb4c06de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:34.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 shutdown_connections 2024-08-18T23:57:34.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.176+0000 7fdb53525640 1 -- 172.21.15.103:0/3979446944 wait complete. 2024-08-18T23:57:34.189 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:57:34.189 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:57:34.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:57:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.306+0000 7f246857a640 1 Processor -- start 2024-08-18T23:57:34.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.307+0000 7f246857a640 1 -- start start 2024-08-18T23:57:34.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f246857a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24600c6340 0x7f2460165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f246857a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24600721d0 con 0x7f246015ea60 2024-08-18T23:57:34.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f246857a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24600cf0d0 con 0x7f246015ae70 2024-08-18T23:57:34.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f246857a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f246015b250 con 0x7f24600c6340 2024-08-18T23:57:34.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465b15640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f246015ea60 0x7f24600c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39698/0 (socket says 172.21.15.103:39698) 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465b15640 1 -- 172.21.15.103:0/1631120250 learned_addr learned my addr 172.21.15.103:0/1631120250 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2466b17640 1 --2- 172.21.15.103:0/1631120250 >> v2:172.21.15.190:3300/0 conn(0x7f24600c6340 0x7f2460165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818788370 0 0) 0x7f245c001110 con 0x7f246015ea60 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f244c003520 con 0x7f246015ea60 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2962128426 0 0) 0x7f244c003520 con 0x7f246015ea60 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 >> v2:172.21.15.190:3300/0 conn(0x7f24600c6340 msgr2=0x7f2460165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 --2- 172.21.15.103:0/1631120250 >> v2:172.21.15.190:3300/0 conn(0x7f24600c6340 0x7f2460165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 >> v1:172.21.15.190:6789/0 conn(0x7f246015ae70 legacy=0x7f246015f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2460072450 con 0x7f246015ea60 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f245c001840 con 0x7f246015ea60 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 >> v1:172.21.15.103:6789/0 conn(0x7f246015ea60 legacy=0x7f24600c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f244c0039b0 0x7f244c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f244c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f244c0051c0 0x7f244c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f244c00c130 con 0x7f244c004800 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f244c00c2e0 con 0x7f244c0051c0 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f244c00c4e0 con 0x7f244c0039b0 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2465b15640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f244c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2466316640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f244c0039b0 0x7f244c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.308+0000 7f2466b17640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f244c0051c0 0x7f244c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.309+0000 7f2465b15640 1 -- 172.21.15.103:0/1631120250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f244c0039b0 msgr2=0x7f244c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.309+0000 7f2465b15640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f244c0039b0 0x7f244c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.309+0000 7f2465b15640 1 -- 172.21.15.103:0/1631120250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f244c0051c0 msgr2=0x7f244c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.309+0000 7f2465b15640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f244c0051c0 0x7f244c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.309+0000 7f2466b17640 1 -- 172.21.15.103:0/1631120250 reap_dead start 2024-08-18T23:57:34.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.309+0000 7f2465b15640 1 -- 172.21.15.103:0/1631120250 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244c003520 con 0x7f244c004800 2024-08-18T23:57:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f2465b15640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f244c004c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f245c00c490 tx=0x7f244c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ff16884245bed8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c00c0e0 con 0x7f244c004800 2024-08-18T23:57:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245c02c040 con 0x7f244c004800 2024-08-18T23:57:34.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f2465314640 1 -- 172.21.15.103:0/1631120250 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c005d70 con 0x7f244c004800 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f246857a640 1 -- 172.21.15.103:0/1631120250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 msgr2=0x7f244c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f246857a640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f244c004c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f245c00c490 tx=0x7f244c005830 comp rx=0 tx=0).stop 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f246857a640 1 -- 172.21.15.103:0/1631120250 shutdown_connections 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f246857a640 1 --2- 172.21.15.103:0/1631120250 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f244c004c80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f246857a640 1 -- 172.21.15.103:0/1631120250 >> 172.21.15.103:0/1631120250 conn(0x7f24600cc6e0 msgr2=0x7f24600ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f246857a640 1 -- 172.21.15.103:0/1631120250 shutdown_connections 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.310+0000 7f246857a640 1 -- 172.21.15.103:0/1631120250 wait complete. 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.311+0000 7f246857a640 1 Processor -- start 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.311+0000 7f246857a640 1 -- start start 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f246857a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f2460150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f246857a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24600acd70 0x7f2460152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f246857a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24600adc60 0x7f246006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f246857a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2460072cf0 con 0x7f244c004800 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f246857a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2460072a10 con 0x7f24600acd70 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f246857a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2460072fd0 con 0x7f24600adc60 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f2466316640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f2460150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f2466316640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f2460150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39100/0 (socket says 172.21.15.103:39100) 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f2466316640 1 -- 172.21.15.103:0/3186951483 learned_addr learned my addr 172.21.15.103:0/3186951483 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f2466b17640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24600adc60 0x7f246006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.312+0000 7f2465b15640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24600acd70 0x7f2460152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2466316640 1 -- 172.21.15.103:0/3186951483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24600adc60 msgr2=0x7f246006e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2466316640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24600adc60 0x7f246006e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2466316640 1 -- 172.21.15.103:0/3186951483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24600acd70 msgr2=0x7f2460152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2466316640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24600acd70 0x7f2460152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2466316640 1 -- 172.21.15.103:0/3186951483 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24600ae4c0 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2466316640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f2460150790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f245000f620 tx=0x7f245000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2456ffd640 1 -- 172.21.15.103:0/3186951483 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24500052e0 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2456ffd640 1 -- 172.21.15.103:0/3186951483 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2450018070 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f246015ce10 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f2456ffd640 1 -- 172.21.15.103:0/3186951483 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2450003810 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.313+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f246015d3d0 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.314+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24600734f0 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.314+0000 7f2456ffd640 1 -- 172.21.15.103:0/3186951483 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24500039b0 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.315+0000 7f2456ffd640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f244406bdd0 0x7f244406e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.315+0000 7f2456ffd640 1 -- 172.21.15.103:0/3186951483 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f245008adb0 con 0x7f244c004800 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.315+0000 7f2465b15640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f244406bdd0 0x7f244406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.315+0000 7f2465b15640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f244406bdd0 0x7f244406e290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f245c033000 tx=0x7f245c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:34.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.319+0000 7f2456ffd640 1 -- 172.21.15.103:0/3186951483 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2450058dd0 con 0x7f244c004800 2024-08-18T23:57:34.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.496+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f24600af500 con 0x7f244c004800 2024-08-18T23:57:34.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.497+0000 7f2456ffd640 1 -- 172.21.15.103:0/3186951483 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f245005d0d0 con 0x7f244c004800 2024-08-18T23:57:34.498 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:57:34.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.498+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f244406bdd0 msgr2=0x7f244406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.498+0000 7f246857a640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f244406bdd0 0x7f244406e290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f245c033000 tx=0x7f245c02e000 comp rx=0 tx=0).stop 2024-08-18T23:57:34.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 msgr2=0x7f2460150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f2460150790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f245000f620 tx=0x7f245000fae0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 shutdown_connections 2024-08-18T23:57:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f244406bdd0 0x7f244406e290 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24600adc60 0x7f246006e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24600acd70 0x7f2460152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 --2- 172.21.15.103:0/3186951483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f244c004800 0x7f2460150790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 >> 172.21.15.103:0/3186951483 conn(0x7f24600cc6e0 msgr2=0x7f2460074c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 shutdown_connections 2024-08-18T23:57:34.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.499+0000 7f246857a640 1 -- 172.21.15.103:0/3186951483 wait complete. 2024-08-18T23:57:34.511 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi190.front.sepia.ceph.com... 2024-08-18T23:57:34.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:34.511 DEBUG:teuthology.orchestra.run.smithi190:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-08-18T23:57:34.542 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:34.542 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:57:34.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:34.542 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-18T23:57:34.601 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-18T23:57:34.602 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:34.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.699+0000 7f59efa7d640 1 Processor -- start 2024-08-18T23:57:34.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.699+0000 7f59efa7d640 1 -- start start 2024-08-18T23:57:34.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59efa7d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80cfd10 0x7f59e806c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59efa7d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59e80d00f0 0x7f59e806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59efa7d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f59e815e610 0x7f59e815eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59efa7d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f59e815f340 con 0x7f59e80d00f0 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59efa7d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f59e815f920 con 0x7f59e815e610 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59efa7d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f59e815fc00 con 0x7f59e80cfd10 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59ed018640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59e80d00f0 0x7f59e806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59ed018640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f59e80d00f0 0x7f59e806ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39106/0 (socket says 172.21.15.103:39106) 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.700+0000 7f59ed018640 1 -- 172.21.15.103:0/310206749 learned_addr learned my addr 172.21.15.103:0/310206749 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ee01a640 1 --2- 172.21.15.103:0/310206749 >> v2:172.21.15.190:3300/0 conn(0x7f59e815e610 0x7f59e815eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ed819640 1 --2- 172.21.15.103:0/310206749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80cfd10 0x7f59e806c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ed018640 1 -- 172.21.15.103:0/310206749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80cfd10 msgr2=0x7f59e806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ed018640 1 --2- 172.21.15.103:0/310206749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80cfd10 0x7f59e806c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ed018640 1 -- 172.21.15.103:0/310206749 >> v2:172.21.15.190:3300/0 conn(0x7f59e815e610 msgr2=0x7f59e815eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:34.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ed018640 1 --2- 172.21.15.103:0/310206749 >> v2:172.21.15.190:3300/0 conn(0x7f59e815e610 0x7f59e815eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ed018640 1 -- 172.21.15.103:0/310206749 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e815fee0 con 0x7f59e80d00f0 2024-08-18T23:57:34.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ee01a640 1 --2- 172.21.15.103:0/310206749 >> v2:172.21.15.190:3300/0 conn(0x7f59e815e610 0x7f59e815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:34.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ed819640 1 --2- 172.21.15.103:0/310206749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80cfd10 0x7f59e806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:34.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.701+0000 7f59ed018640 1 --2- 172.21.15.103:0/310206749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e80d00f0 0x7f59e806ce50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59e815c070 tx=0x7f59d802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadff74220485432 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:34.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59ec817640 1 -- 172.21.15.103:0/310206749 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8037070 con 0x7f59e80d00f0 2024-08-18T23:57:34.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59ec817640 1 -- 172.21.15.103:0/310206749 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d8032440 con 0x7f59e80d00f0 2024-08-18T23:57:34.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59ec817640 1 -- 172.21.15.103:0/310206749 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8032810 con 0x7f59e80d00f0 2024-08-18T23:57:34.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 -- 172.21.15.103:0/310206749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e80d00f0 msgr2=0x7f59e806ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 --2- 172.21.15.103:0/310206749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e80d00f0 0x7f59e806ce50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59e815c070 tx=0x7f59d802a1e0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 -- 172.21.15.103:0/310206749 shutdown_connections 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 --2- 172.21.15.103:0/310206749 >> v2:172.21.15.190:3300/0 conn(0x7f59e815e610 0x7f59e815eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 --2- 172.21.15.103:0/310206749 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e80d00f0 0x7f59e806ce50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 --2- 172.21.15.103:0/310206749 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80cfd10 0x7f59e806c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 -- 172.21.15.103:0/310206749 >> 172.21.15.103:0/310206749 conn(0x7f59e8071f00 msgr2=0x7f59e8072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 -- 172.21.15.103:0/310206749 shutdown_connections 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.702+0000 7f59efa7d640 1 -- 172.21.15.103:0/310206749 wait complete. 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.703+0000 7f59efa7d640 1 Processor -- start 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.703+0000 7f59efa7d640 1 -- start start 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59efa7d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e80cfd10 0x7f59e81f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59efa7d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80d00f0 0x7f59e815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59efa7d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e815e610 0x7f59e8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59efa7d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f59e81547c0 con 0x7f59e815e610 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59efa7d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f59e815f000 con 0x7f59e80cfd10 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59efa7d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f59e8154940 con 0x7f59e80d00f0 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59ee01a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e815e610 0x7f59e8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59ee01a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e815e610 0x7f59e8153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39118/0 (socket says 172.21.15.103:39118) 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59ee01a640 1 -- 172.21.15.103:0/4180601532 learned_addr learned my addr 172.21.15.103:0/4180601532 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59ee01a640 1 -- 172.21.15.103:0/4180601532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80d00f0 msgr2=0x7f59e815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59ee01a640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80d00f0 0x7f59e815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59ed819640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e80cfd10 0x7f59e81f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59ee01a640 1 -- 172.21.15.103:0/4180601532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e80cfd10 msgr2=0x7f59e81f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.704+0000 7f59ee01a640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e80cfd10 0x7f59e81f4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.705+0000 7f59ee01a640 1 -- 172.21.15.103:0/4180601532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e81f4a90 con 0x7f59e815e610 2024-08-18T23:57:34.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.705+0000 7f59ee01a640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e815e610 0x7f59e8153c90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59e0007ea0 tx=0x7f59e0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:34.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.705+0000 7f59de7fc640 1 -- 172.21.15.103:0/4180601532 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e001a070 con 0x7f59e815e610 2024-08-18T23:57:34.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.705+0000 7f59de7fc640 1 -- 172.21.15.103:0/4180601532 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e0003bb0 con 0x7f59e815e610 2024-08-18T23:57:34.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.705+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e80b3a40 con 0x7f59e815e610 2024-08-18T23:57:34.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.705+0000 7f59de7fc640 1 -- 172.21.15.103:0/4180601532 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e000de70 con 0x7f59e815e610 2024-08-18T23:57:34.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.705+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e8159940 con 0x7f59e815e610 2024-08-18T23:57:34.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.706+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e806cd80 con 0x7f59e815e610 2024-08-18T23:57:34.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.706+0000 7f59de7fc640 1 -- 172.21.15.103:0/4180601532 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f59e001d070 con 0x7f59e815e610 2024-08-18T23:57:34.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.707+0000 7f59de7fc640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f59cc06be30 0x7f59cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:34.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.707+0000 7f59de7fc640 1 -- 172.21.15.103:0/4180601532 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f59e008b340 con 0x7f59e815e610 2024-08-18T23:57:34.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.707+0000 7f59ed819640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f59cc06be30 0x7f59cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:34.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.707+0000 7f59ed819640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f59cc06be30 0x7f59cc06e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59e4006fd0 tx=0x7f59e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:34.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.711+0000 7f59de7fc640 1 -- 172.21.15.103:0/4180601532 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f59e806cd80 con 0x7f59e815e610 2024-08-18T23:57:34.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.916+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59e80681f0 con 0x7f59e815e610 2024-08-18T23:57:34.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.918+0000 7f59de7fc640 1 -- 172.21.15.103:0/4180601532 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5228 (secure 0 0 0) 0x7f59e81f4a90 con 0x7f59e815e610 2024-08-18T23:57:34.919 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:34.919 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-18T23:57:12:833627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:57:12.157817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:34.920 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f59cc06be30 msgr2=0x7f59cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f59cc06be30 0x7f59cc06e2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59e4006fd0 tx=0x7f59e4008040 comp rx=0 tx=0).stop 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e815e610 msgr2=0x7f59e8153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e815e610 0x7f59e8153c90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59e0007ea0 tx=0x7f59e0007f90 comp rx=0 tx=0).stop 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 shutdown_connections 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f59cc06be30 0x7f59cc06e2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f59e815e610 0x7f59e8153c90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e80d00f0 0x7f59e815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 --2- 172.21.15.103:0/4180601532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59e80cfd10 0x7f59e81f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:34.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 >> 172.21.15.103:0/4180601532 conn(0x7f59e8071f00 msgr2=0x7f59e80b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:34.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 shutdown_connections 2024-08-18T23:57:34.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:34.920+0000 7f59efa7d640 1 -- 172.21.15.103:0/4180601532 wait complete. 2024-08-18T23:57:34.932 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:35.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.029+0000 7fedfca0a640 1 Processor -- start 2024-08-18T23:57:35.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.029+0000 7fedfca0a640 1 -- start start 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.030+0000 7fedfca0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80d4bc0 0x7fedf80d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.030+0000 7fedfca0a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fedf8160090 0x7fedf8160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.030+0000 7fedfca0a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf80d0860 con 0x7fedf815f8a0 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.030+0000 7fedfca0a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fedf80cfc00 con 0x7fedf8160090 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.030+0000 7fedfca0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80b32c0 con 0x7fedf80d4bc0 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.030+0000 7fedf659c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fedf815f8a0 0x7fedf80d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39708/0 (socket says 172.21.15.103:39708) 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.030+0000 7fedf659c640 1 -- 172.21.15.103:0/4003568461 learned_addr learned my addr 172.21.15.103:0/4003568461 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf6d9d640 1 --2- 172.21.15.103:0/4003568461 >> v2:172.21.15.190:3300/0 conn(0x7fedf8160090 0x7fedf8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586403280 0 0) 0x7fedf80d0860 con 0x7fedf815f8a0 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede0003520 con 0x7fedf815f8a0 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3399699150 0 0) 0x7fede0003520 con 0x7fedf815f8a0 2024-08-18T23:57:35.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80d4bc0 msgr2=0x7fedf80d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80d4bc0 0x7fedf80d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 >> v2:172.21.15.190:3300/0 conn(0x7fedf8160090 msgr2=0x7fedf8160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 --2- 172.21.15.103:0/4003568461 >> v2:172.21.15.190:3300/0 conn(0x7fedf8160090 0x7fedf8160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80d0090 con 0x7fedf815f8a0 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fede80019f0 con 0x7fedf815f8a0 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 >> v1:172.21.15.103:6789/0 conn(0x7fedf815f8a0 legacy=0x7fedf80d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80d4bc0 0x7fede00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0003f30 0x7fede0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fede0004d40 0x7fede00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80cfc00 con 0x7fede0004d40 2024-08-18T23:57:35.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80b32c0 con 0x7fede0003f30 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fede000baf0 con 0x7fedf80d4bc0 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf6d9d640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fede0004d40 0x7fede00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf659c640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80d4bc0 0x7fede00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf5d9b640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0003f30 0x7fede0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf6d9d640 1 -- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80d4bc0 msgr2=0x7fede00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf6d9d640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80d4bc0 0x7fede00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf6d9d640 1 -- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0003f30 msgr2=0x7fede0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf6d9d640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0003f30 0x7fede0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf6d9d640 1 -- 172.21.15.103:0/4003568461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede0003520 con 0x7fede0004d40 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf659c640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80d4bc0 0x7fede00039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:35.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.031+0000 7fedf5d9b640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0003f30 0x7fede0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:35.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.032+0000 7fedf6d9d640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fede0004d40 0x7fede00051c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009ac0 tx=0x7fede0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3096f2c7c9df3af4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.032+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0036070 con 0x7fede0004d40 2024-08-18T23:57:35.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.032+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedf0031400 con 0x7fede0004d40 2024-08-18T23:57:35.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.032+0000 7fedf559a640 1 -- 172.21.15.103:0/4003568461 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf0009690 con 0x7fede0004d40 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.033+0000 7fedfca0a640 1 -- 172.21.15.103:0/4003568461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fede0004d40 msgr2=0x7fede00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.033+0000 7fedfca0a640 1 --2- 172.21.15.103:0/4003568461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fede0004d40 0x7fede00051c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009ac0 tx=0x7fede0005830 comp rx=0 tx=0).stop 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.033+0000 7fedf6d9d640 1 -- 172.21.15.103:0/4003568461 reap_dead start 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.033+0000 7fedfca0a640 1 -- 172.21.15.103:0/4003568461 shutdown_connections 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.033+0000 7fedfca0a640 1 -- 172.21.15.103:0/4003568461 >> 172.21.15.103:0/4003568461 conn(0x7fedf80d40a0 msgr2=0x7fedf80d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.033+0000 7fedfca0a640 1 -- 172.21.15.103:0/4003568461 shutdown_connections 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.033+0000 7fedfca0a640 1 -- 172.21.15.103:0/4003568461 wait complete. 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.034+0000 7fedfca0a640 1 Processor -- start 2024-08-18T23:57:35.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.034+0000 7fedfca0a640 1 -- start start 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedfca0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0004d40 0x7fedf80b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedfca0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf80b9550 0x7fedf80b8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedfca0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b39a0 0x7fedf80b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedfca0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80b2fb0 con 0x7fedf80b9550 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedfca0a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80cf890 con 0x7fede0004d40 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedfca0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fedf815fc80 con 0x7fedf80b39a0 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf80b9550 0x7fedf80b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf80b9550 0x7fedf80b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39130/0 (socket says 172.21.15.103:39130) 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf5d9b640 1 -- 172.21.15.103:0/3992034121 learned_addr learned my addr 172.21.15.103:0/3992034121 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf659c640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0004d40 0x7fedf80b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf5d9b640 1 -- 172.21.15.103:0/3992034121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b39a0 msgr2=0x7fedf80b3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf5d9b640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b39a0 0x7fedf80b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf5d9b640 1 -- 172.21.15.103:0/3992034121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0004d40 msgr2=0x7fedf80b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf5d9b640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0004d40 0x7fedf80b6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.035+0000 7fedf5d9b640 1 -- 172.21.15.103:0/3992034121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf80b74b0 con 0x7fedf80b9550 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.036+0000 7fedf5d9b640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf80b9550 0x7fedf80b8550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedec006c90 tx=0x7fedec00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.036+0000 7fede6ffd640 1 -- 172.21.15.103:0/3992034121 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec018020 con 0x7fedf80b9550 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.036+0000 7fede6ffd640 1 -- 172.21.15.103:0/3992034121 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedec014620 con 0x7fedf80b9550 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.036+0000 7fede6ffd640 1 -- 172.21.15.103:0/3992034121 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec0149d0 con 0x7fedf80b9550 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.036+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf80b7790 con 0x7fedf80b9550 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.036+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf80b7d50 con 0x7fedf80b9550 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.037+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf808d870 con 0x7fedf80b9550 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.037+0000 7fede6ffd640 1 -- 172.21.15.103:0/3992034121 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fedec01b020 con 0x7fedf80b9550 2024-08-18T23:57:35.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.038+0000 7fede6ffd640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fedd806be60 0x7fedd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.038+0000 7fede6ffd640 1 -- 172.21.15.103:0/3992034121 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7fedec08b650 con 0x7fedf80b9550 2024-08-18T23:57:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.038+0000 7fedf659c640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fedd806be60 0x7fedd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.038+0000 7fedf659c640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fedd806be60 0x7fedd806e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fede80012e0 tx=0x7fede8001270 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.042+0000 7fede6ffd640 1 -- 172.21.15.103:0/3992034121 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fedf808d870 con 0x7fedf80b9550 2024-08-18T23:57:35.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.241+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedf80d32c0 con 0x7fedf80b9550 2024-08-18T23:57:35.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.242+0000 7fede6ffd640 1 -- 172.21.15.103:0/3992034121 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5228 (secure 0 0 0) 0x7fedf80d32c0 con 0x7fedf80b9550 2024-08-18T23:57:35.243 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:35.243 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-18T23:57:12:833627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:57:12.157817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-18T23:57:35.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fedd806be60 msgr2=0x7fedd806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fedd806be60 0x7fedd806e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fede80012e0 tx=0x7fede8001270 comp rx=0 tx=0).stop 2024-08-18T23:57:35.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf80b9550 msgr2=0x7fedf80b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf80b9550 0x7fedf80b8550 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fedec006c90 tx=0x7fedec00da30 comp rx=0 tx=0).stop 2024-08-18T23:57:35.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 shutdown_connections 2024-08-18T23:57:35.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fedd806be60 0x7fedd806e320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedf80b39a0 0x7fedf80b3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf80b9550 0x7fedf80b8550 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 --2- 172.21.15.103:0/3992034121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fede0004d40 0x7fedf80b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 >> 172.21.15.103:0/3992034121 conn(0x7fedf80d40a0 msgr2=0x7fedf80b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:35.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 shutdown_connections 2024-08-18T23:57:35.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.244+0000 7fedfca0a640 1 -- 172.21.15.103:0/3992034121 wait complete. 2024-08-18T23:57:35.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.354+0000 7fc304305640 1 Processor -- start 2024-08-18T23:57:35.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.354+0000 7fc304305640 1 -- start start 2024-08-18T23:57:35.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc304305640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2fc0cecc0 0x7fc2fc0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc304305640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2fc0b2cb0 0x7fc2fc15b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc304305640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc071d90 0x7fc2fc0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc304305640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc2fc0b46c0 con 0x7fc2fc0b2cb0 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc304305640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc2fc15b990 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc304305640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2fc072720 con 0x7fc2fc071d90 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3018a0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2fc0b2cb0 0x7fc2fc15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3018a0640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2fc0b2cb0 0x7fc2fc15b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39146/0 (socket says 172.21.15.103:39146) 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3018a0640 1 -- 172.21.15.103:0/1253219421 learned_addr learned my addr 172.21.15.103:0/1253219421 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3020a1640 1 --2- 172.21.15.103:0/1253219421 >> v2:172.21.15.190:3300/0 conn(0x7fc2fc0cecc0 0x7fc2fc0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3028a2640 1 --2- 172.21.15.103:0/1253219421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc071d90 0x7fc2fc0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3018a0640 1 -- 172.21.15.103:0/1253219421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc071d90 msgr2=0x7fc2fc0721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3018a0640 1 --2- 172.21.15.103:0/1253219421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc071d90 0x7fc2fc0721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3018a0640 1 -- 172.21.15.103:0/1253219421 >> v2:172.21.15.190:3300/0 conn(0x7fc2fc0cecc0 msgr2=0x7fc2fc0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3018a0640 1 --2- 172.21.15.103:0/1253219421 >> v2:172.21.15.190:3300/0 conn(0x7fc2fc0cecc0 0x7fc2fc0cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.355+0000 7fc3018a0640 1 -- 172.21.15.103:0/1253219421 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc0b3190 con 0x7fc2fc0b2cb0 2024-08-18T23:57:35.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.356+0000 7fc3018a0640 1 --2- 172.21.15.103:0/1253219421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0b2cb0 0x7fc2fc15b450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0718a0 tx=0x7fc2f802c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ccd581ec7b06b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.356+0000 7fc30109f640 1 -- 172.21.15.103:0/1253219421 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f803a070 con 0x7fc2fc0b2cb0 2024-08-18T23:57:35.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.356+0000 7fc30109f640 1 -- 172.21.15.103:0/1253219421 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8032480 con 0x7fc2fc0b2cb0 2024-08-18T23:57:35.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.356+0000 7fc30109f640 1 -- 172.21.15.103:0/1253219421 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8032850 con 0x7fc2fc0b2cb0 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.356+0000 7fc304305640 1 -- 172.21.15.103:0/1253219421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0b2cb0 msgr2=0x7fc2fc15b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.356+0000 7fc304305640 1 --2- 172.21.15.103:0/1253219421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0b2cb0 0x7fc2fc15b450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0718a0 tx=0x7fc2f802c670 comp rx=0 tx=0).stop 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.357+0000 7fc304305640 1 -- 172.21.15.103:0/1253219421 shutdown_connections 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.357+0000 7fc304305640 1 --2- 172.21.15.103:0/1253219421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc071d90 0x7fc2fc0721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.357+0000 7fc304305640 1 --2- 172.21.15.103:0/1253219421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0b2cb0 0x7fc2fc15b450 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.357+0000 7fc304305640 1 --2- 172.21.15.103:0/1253219421 >> v2:172.21.15.190:3300/0 conn(0x7fc2fc0cecc0 0x7fc2fc0cf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.357+0000 7fc304305640 1 -- 172.21.15.103:0/1253219421 >> 172.21.15.103:0/1253219421 conn(0x7fc2fc0cfc40 msgr2=0x7fc2fc0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.357+0000 7fc304305640 1 -- 172.21.15.103:0/1253219421 shutdown_connections 2024-08-18T23:57:35.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.357+0000 7fc304305640 1 -- 172.21.15.103:0/1253219421 wait complete. 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.358+0000 7fc304305640 1 Processor -- start 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.358+0000 7fc304305640 1 -- start start 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc304305640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2fc071d90 0x7fc2fc1f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc304305640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc0b2cb0 0x7fc2fc142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc304305640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0cecc0 0x7fc2fc155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc304305640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc0b3a30 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc304305640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc0b3750 con 0x7fc2fc071d90 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc304305640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc2fc06d6c0 con 0x7fc2fc0b2cb0 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0cecc0 0x7fc2fc155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0cecc0 0x7fc2fc155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39162/0 (socket says 172.21.15.103:39162) 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 -- 172.21.15.103:0/207319662 learned_addr learned my addr 172.21.15.103:0/207319662 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:35.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3020a1640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2fc071d90 0x7fc2fc1f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3018a0640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc0b2cb0 0x7fc2fc142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 -- 172.21.15.103:0/207319662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc0b2cb0 msgr2=0x7fc2fc142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc0b2cb0 0x7fc2fc142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 -- 172.21.15.103:0/207319662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2fc071d90 msgr2=0x7fc2fc1f0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2fc071d90 0x7fc2fc1f0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 -- 172.21.15.103:0/207319662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc155ac0 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc3028a2640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0cecc0 0x7fc2fc155000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400efc0 tx=0x7fc2f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc2f2ffd640 1 -- 172.21.15.103:0/207319662 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4018020 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc2f2ffd640 1 -- 172.21.15.103:0/207319662 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f4014480 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc2f2ffd640 1 -- 172.21.15.103:0/207319662 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4014870 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc155540 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.359+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc1431e0 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.360+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2fc142fe0 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.361+0000 7fc2f2ffd640 1 -- 172.21.15.103:0/207319662 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2f4005d10 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.361+0000 7fc2f2ffd640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc2e006be30 0x7fc2e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.361+0000 7fc2f2ffd640 1 -- 172.21.15.103:0/207319662 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7fc2f408beb0 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.361+0000 7fc3020a1640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc2e006be30 0x7fc2e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.362+0000 7fc3020a1640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc2e006be30 0x7fc2e006e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009ac0 tx=0x7fc2ec009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.366+0000 7fc2f2ffd640 1 -- 172.21.15.103:0/207319662 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc2f4022030 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.531+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2fc15c740 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.533+0000 7fc2f2ffd640 1 -- 172.21.15.103:0/207319662 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18986 (secure 0 0 0) 0x7fc2f4010040 con 0x7fc2fc0cecc0 2024-08-18T23:57:35.534 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:35.534 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:57:34.896791+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:35.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc2e006be30 msgr2=0x7fc2e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc2e006be30 0x7fc2e006e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec009ac0 tx=0x7fc2ec009190 comp rx=0 tx=0).stop 2024-08-18T23:57:35.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0cecc0 msgr2=0x7fc2fc155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0cecc0 0x7fc2fc155000 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400efc0 tx=0x7fc2f400c490 comp rx=0 tx=0).stop 2024-08-18T23:57:35.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 shutdown_connections 2024-08-18T23:57:35.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc2e006be30 0x7fc2e006e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2fc0cecc0 0x7fc2fc155000 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2fc0b2cb0 0x7fc2fc142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.534+0000 7fc304305640 1 --2- 172.21.15.103:0/207319662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2fc071d90 0x7fc2fc1f0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.535+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 >> 172.21.15.103:0/207319662 conn(0x7fc2fc0cfc40 msgr2=0x7fc2fc15c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:35.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.535+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 shutdown_connections 2024-08-18T23:57:35.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.535+0000 7fc304305640 1 -- 172.21.15.103:0/207319662 wait complete. 2024-08-18T23:57:35.547 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T23:57:35.547 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:35.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.643+0000 7fd78bdf1640 1 Processor -- start 2024-08-18T23:57:35.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.643+0000 7fd78bdf1640 1 -- start start 2024-08-18T23:57:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.644+0000 7fd78bdf1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd7841671c0 0x7fd7841695b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.644+0000 7fd78bdf1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7840d0860 con 0x7fd78415f8a0 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.644+0000 7fd78bdf1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7840d18d0 con 0x7fd7840d4bc0 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.644+0000 7fd78bdf1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd7840cfc00 con 0x7fd7841671c0 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.644+0000 7fd789b8d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd78415f8a0 0x7fd7840d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39724/0 (socket says 172.21.15.103:39724) 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.644+0000 7fd789b8d640 1 -- 172.21.15.103:0/1154877532 learned_addr learned my addr 172.21.15.103:0/1154877532 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd78a38e640 1 --2- 172.21.15.103:0/1154877532 >> v2:172.21.15.190:3300/0 conn(0x7fd7841671c0 0x7fd7841695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3331527149 0 0) 0x7fd7840d0860 con 0x7fd78415f8a0 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd770003520 con 0x7fd78415f8a0 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 196806310 0 0) 0x7fd770003520 con 0x7fd78415f8a0 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 >> v2:172.21.15.190:3300/0 conn(0x7fd7841671c0 msgr2=0x7fd7841695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 --2- 172.21.15.103:0/1154877532 >> v2:172.21.15.190:3300/0 conn(0x7fd7841671c0 0x7fd7841695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 >> v1:172.21.15.190:6789/0 conn(0x7fd7840d4bc0 legacy=0x7fd7840d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7840b32c0 con 0x7fd78415f8a0 2024-08-18T23:57:35.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fd780001670 con 0x7fd78415f8a0 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 >> v1:172.21.15.103:6789/0 conn(0x7fd78415f8a0 legacy=0x7fd7840d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7700039b0 0x7fd770003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd770004800 0x7fd770004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700051c0 0x7fd77000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7840cfc00 con 0x7fd7700039b0 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd77000c090 con 0x7fd7700051c0 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd77000c290 con 0x7fd770004800 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd789b8d640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7700039b0 0x7fd770003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd78a38e640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700051c0 0x7fd77000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd78938c640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd770004800 0x7fd770004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd789b8d640 1 -- 172.21.15.103:0/1154877532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd770004800 msgr2=0x7fd770004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd789b8d640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd770004800 0x7fd770004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd789b8d640 1 -- 172.21.15.103:0/1154877532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700051c0 msgr2=0x7fd77000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd789b8d640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700051c0 0x7fd77000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd789b8d640 1 -- 172.21.15.103:0/1154877532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd770003520 con 0x7fd7700039b0 2024-08-18T23:57:35.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.645+0000 7fd78a38e640 1 -- 172.21.15.103:0/1154877532 reap_dead start 2024-08-18T23:57:35.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.646+0000 7fd789b8d640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7700039b0 0x7fd770003df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c210 tx=0x7fd770005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e702646f00228de server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.646+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780007d10 con 0x7fd7700039b0 2024-08-18T23:57:35.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.646+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd780005ad0 con 0x7fd7700039b0 2024-08-18T23:57:35.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.646+0000 7fd788b8b640 1 -- 172.21.15.103:0/1154877532 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd780007070 con 0x7fd7700039b0 2024-08-18T23:57:35.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.647+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1154877532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7700039b0 msgr2=0x7fd770003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.647+0000 7fd78bdf1640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7700039b0 0x7fd770003df0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c210 tx=0x7fd770005830 comp rx=0 tx=0).stop 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.647+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1154877532 shutdown_connections 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.647+0000 7fd78bdf1640 1 --2- 172.21.15.103:0/1154877532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7700039b0 0x7fd770003df0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.647+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1154877532 >> 172.21.15.103:0/1154877532 conn(0x7fd7840d40a0 msgr2=0x7fd7840d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.647+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1154877532 shutdown_connections 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.647+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1154877532 wait complete. 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.648+0000 7fd78bdf1640 1 Processor -- start 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.648+0000 7fd78bdf1640 1 -- start start 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78bdf1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700039b0 0x7fd78415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78bdf1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd78414c760 0x7fd78414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78bdf1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7840b8e40 0x7fd7840b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78bdf1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7840cf890 con 0x7fd7840b8e40 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78bdf1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd7840d0580 con 0x7fd7700039b0 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78bdf1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd7840b2fb0 con 0x7fd78414c760 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7840b8e40 0x7fd7840b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7840b8e40 0x7fd7840b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39182/0 (socket says 172.21.15.103:39182) 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 -- 172.21.15.103:0/1803447340 learned_addr learned my addr 172.21.15.103:0/1803447340 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd789b8d640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700039b0 0x7fd78415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78938c640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd78414c760 0x7fd78414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 -- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd78414c760 msgr2=0x7fd78414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd78414c760 0x7fd78414cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 -- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700039b0 msgr2=0x7fd78415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700039b0 0x7fd78415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 -- 172.21.15.103:0/1803447340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7840b6f70 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd789b8d640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700039b0 0x7fd78415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd78a38e640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7840b8e40 0x7fd7840b92c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd7840cea60 tx=0x7fd77c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd77a7fc640 1 -- 172.21.15.103:0/1803447340 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c011de0 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.649+0000 7fd77a7fc640 1 -- 172.21.15.103:0/1803447340 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd77c01b070 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.650+0000 7fd77a7fc640 1 -- 172.21.15.103:0/1803447340 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c003990 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.650+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd78414d100 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.650+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7840b74f0 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.650+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd78415fc80 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.651+0000 7fd77a7fc640 1 -- 172.21.15.103:0/1803447340 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd77c003b30 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.651+0000 7fd77a7fc640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd76806be30 0x7fd76806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.651+0000 7fd77a7fc640 1 -- 172.21.15.103:0/1803447340 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7fd77c08baa0 con 0x7fd7840b8e40 2024-08-18T23:57:35.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.651+0000 7fd789b8d640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd76806be30 0x7fd76806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.652+0000 7fd789b8d640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd76806be30 0x7fd76806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c210 tx=0x7fd780009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.655+0000 7fd77a7fc640 1 -- 172.21.15.103:0/1803447340 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd77c003e20 con 0x7fd7840b8e40 2024-08-18T23:57:35.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.856+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7840d4590 con 0x7fd7840b8e40 2024-08-18T23:57:35.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.856+0000 7fd77a7fc640 1 -- 172.21.15.103:0/1803447340 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5228 (secure 0 0 0) 0x7fd77c05a030 con 0x7fd7840b8e40 2024-08-18T23:57:35.858 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:35.858 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-18T23:57:12:833627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:57:12.157817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:35.858 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd76806be30 msgr2=0x7fd76806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd76806be30 0x7fd76806e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd78000c210 tx=0x7fd780009030 comp rx=0 tx=0).stop 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7840b8e40 msgr2=0x7fd7840b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7840b8e40 0x7fd7840b92c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd7840cea60 tx=0x7fd77c0115a0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 shutdown_connections 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd76806be30 0x7fd76806e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7840b8e40 0x7fd7840b92c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd78414c760 0x7fd78414cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 --2- 172.21.15.103:0/1803447340 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7700039b0 0x7fd78415ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 >> 172.21.15.103:0/1803447340 conn(0x7fd7840d40a0 msgr2=0x7fd7840b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:35.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 shutdown_connections 2024-08-18T23:57:35.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.858+0000 7fd78bdf1640 1 -- 172.21.15.103:0/1803447340 wait complete. 2024-08-18T23:57:35.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.972+0000 7fd6144cb640 1 Processor -- start 2024-08-18T23:57:35.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.972+0000 7fd6144cb640 1 -- start start 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd6144cb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd60c15c980 0x7fd60c072b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd6144cb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c0af050 0x7fd60c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd6144cb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c0734a0 con 0x7fd60c073060 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd6144cb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd60c072690 con 0x7fd60c15c980 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd6144cb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c071a80 con 0x7fd60c0af050 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612a68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c0af050 0x7fd60c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612267640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd60c15c980 0x7fd60c072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612a68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c0af050 0x7fd60c15cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:36370/0 (socket says 172.21.15.103:36370) 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612267640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd60c15c980 0x7fd60c072b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:48792/0 (socket says 172.21.15.103:48792) 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612a68640 1 -- 172.21.15.103:0/998697761 learned_addr learned my addr 172.21.15.103:0/998697761 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:35.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd611a66640 1 --1- 172.21.15.103:0/998697761 >> v1:172.21.15.190:6789/0 conn(0x7fd60c073060 0x7fd60c0ae940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:60508/0 (socket says 172.21.15.103:60508) 2024-08-18T23:57:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612a68640 1 -- 172.21.15.103:0/998697761 >> v2:172.21.15.190:3300/0 conn(0x7fd60c15c980 msgr2=0x7fd60c072b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612a68640 1 --2- 172.21.15.103:0/998697761 >> v2:172.21.15.190:3300/0 conn(0x7fd60c15c980 0x7fd60c072b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612a68640 1 -- 172.21.15.103:0/998697761 >> v1:172.21.15.190:6789/0 conn(0x7fd60c073060 legacy=0x7fd60c0ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612a68640 1 -- 172.21.15.103:0/998697761 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c071d60 con 0x7fd60c0af050 2024-08-18T23:57:35.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.973+0000 7fd612267640 1 --2- 172.21.15.103:0/998697761 >> v2:172.21.15.190:3300/0 conn(0x7fd60c15c980 0x7fd60c072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.974+0000 7fd612a68640 1 --2- 172.21.15.103:0/998697761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c0af050 0x7fd60c15cd60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd604009e50 tx=0x7fd60402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faf4a62bbbc46046 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.974+0000 7fd611265640 1 -- 172.21.15.103:0/998697761 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604036070 con 0x7fd60c0af050 2024-08-18T23:57:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.974+0000 7fd611265640 1 -- 172.21.15.103:0/998697761 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd604031600 con 0x7fd60c0af050 2024-08-18T23:57:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.974+0000 7fd611265640 1 -- 172.21.15.103:0/998697761 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6040319d0 con 0x7fd60c0af050 2024-08-18T23:57:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.975+0000 7fd6144cb640 1 -- 172.21.15.103:0/998697761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c0af050 msgr2=0x7fd60c15cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.975+0000 7fd6144cb640 1 --2- 172.21.15.103:0/998697761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c0af050 0x7fd60c15cd60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd604009e50 tx=0x7fd60402a710 comp rx=0 tx=0).stop 2024-08-18T23:57:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.975+0000 7fd6144cb640 1 -- 172.21.15.103:0/998697761 shutdown_connections 2024-08-18T23:57:35.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.975+0000 7fd6144cb640 1 --2- 172.21.15.103:0/998697761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c0af050 0x7fd60c15cd60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.975+0000 7fd6144cb640 1 --2- 172.21.15.103:0/998697761 >> v2:172.21.15.190:3300/0 conn(0x7fd60c15c980 0x7fd60c072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.975+0000 7fd6144cb640 1 -- 172.21.15.103:0/998697761 >> 172.21.15.103:0/998697761 conn(0x7fd60c0cfc40 msgr2=0x7fd60c0d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.975+0000 7fd6144cb640 1 -- 172.21.15.103:0/998697761 shutdown_connections 2024-08-18T23:57:35.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.975+0000 7fd6144cb640 1 -- 172.21.15.103:0/998697761 wait complete. 2024-08-18T23:57:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.976+0000 7fd6144cb640 1 Processor -- start 2024-08-18T23:57:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.976+0000 7fd6144cb640 1 -- start start 2024-08-18T23:57:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd6144cb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd60c073060 0x7fd60c1f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd6144cb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd60c0af050 0x7fd60c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd6144cb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c15c980 0x7fd60c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd6144cb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0acf30 con 0x7fd60c073060 2024-08-18T23:57:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd6144cb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c072320 con 0x7fd60c0af050 2024-08-18T23:57:35.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd6144cb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c0ad0b0 con 0x7fd60c15c980 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612267640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd60c073060 0x7fd60c1f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612267640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd60c073060 0x7fd60c1f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39188/0 (socket says 172.21.15.103:39188) 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612267640 1 -- 172.21.15.103:0/1158325040 learned_addr learned my addr 172.21.15.103:0/1158325040 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd611a66640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd60c0af050 0x7fd60c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612a68640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c15c980 0x7fd60c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612267640 1 -- 172.21.15.103:0/1158325040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c15c980 msgr2=0x7fd60c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612267640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c15c980 0x7fd60c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612267640 1 -- 172.21.15.103:0/1158325040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd60c0af050 msgr2=0x7fd60c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612267640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd60c0af050 0x7fd60c15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.977+0000 7fd612267640 1 -- 172.21.15.103:0/1158325040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c0cab20 con 0x7fd60c073060 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.978+0000 7fd612267640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd60c073060 0x7fd60c1f3ec0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd60800e960 tx=0x7fd60800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.978+0000 7fd602ffd640 1 -- 172.21.15.103:0/1158325040 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608017070 con 0x7fd60c073060 2024-08-18T23:57:35.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.978+0000 7fd602ffd640 1 -- 172.21.15.103:0/1158325040 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60800ca00 con 0x7fd60c073060 2024-08-18T23:57:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.978+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c0b4da0 con 0x7fd60c073060 2024-08-18T23:57:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.978+0000 7fd602ffd640 1 -- 172.21.15.103:0/1158325040 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60800cdd0 con 0x7fd60c073060 2024-08-18T23:57:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.978+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c1f47a0 con 0x7fd60c073060 2024-08-18T23:57:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.979+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c0716a0 con 0x7fd60c073060 2024-08-18T23:57:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.979+0000 7fd602ffd640 1 -- 172.21.15.103:0/1158325040 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd60801a070 con 0x7fd60c073060 2024-08-18T23:57:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.980+0000 7fd602ffd640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd5f006be30 0x7fd5f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.980+0000 7fd602ffd640 1 -- 172.21.15.103:0/1158325040 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd60808b0e0 con 0x7fd60c073060 2024-08-18T23:57:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.980+0000 7fd611a66640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd5f006be30 0x7fd5f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.980+0000 7fd611a66640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd5f006be30 0x7fd5f006e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd60c15c060 tx=0x7fd5fc007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:35.984+0000 7fd602ffd640 1 -- 172.21.15.103:0/1158325040 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fd60c0b4da0 con 0x7fd60c073060 2024-08-18T23:57:36.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.191+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd60c156530 con 0x7fd60c073060 2024-08-18T23:57:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.191+0000 7fd602ffd640 1 -- 172.21.15.103:0/1158325040 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5228 (secure 0 0 0) 0x7fd608058fa0 con 0x7fd60c073060 2024-08-18T23:57:36.193 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:36.193 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-18T23:57:12:833627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/462275802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":462275802},{"type":"v1","addr":"172.21.15.190:6834","nonce":462275802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/3987040612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":3987040612},{"type":"v1","addr":"172.21.15.190:6835","nonce":3987040612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/3394317332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":3394317332},{"type":"v1","addr":"172.21.15.103:6836","nonce":3394317332}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:56:53.078789+0000","modified":"2024-08-18T23:57:12.157817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6837/1034727243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":1034727243},{"type":"v1","addr":"172.21.15.103:6837","nonce":1034727243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1}]} 2024-08-18T23:57:36.193 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-18T23:57:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd5f006be30 msgr2=0x7fd5f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd5f006be30 0x7fd5f006e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd60c15c060 tx=0x7fd5fc007e80 comp rx=0 tx=0).stop 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd60c073060 msgr2=0x7fd60c1f3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd60c073060 0x7fd60c1f3ec0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd60800e960 tx=0x7fd60800ee20 comp rx=0 tx=0).stop 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 shutdown_connections 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fd5f006be30 0x7fd5f006e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd60c15c980 0x7fd60c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd60c0af050 0x7fd60c15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 --2- 172.21.15.103:0/1158325040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd60c073060 0x7fd60c1f3ec0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 >> 172.21.15.103:0/1158325040 conn(0x7fd60c0cfc40 msgr2=0x7fd60c0b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 shutdown_connections 2024-08-18T23:57:36.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.194+0000 7fd6144cb640 1 -- 172.21.15.103:0/1158325040 wait complete. 2024-08-18T23:57:36.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:36.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.304+0000 7f53892b5640 1 Processor -- start 2024-08-18T23:57:36.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.304+0000 7f53892b5640 1 -- start start 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f53892b5640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f53841620d0 0x7f53841624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f53892b5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f53840d1820 0x7f5384161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f53892b5640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53840cf8b0 con 0x7f53840d4b80 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f53892b5640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f53840d1c30 con 0x7f53841620d0 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f53892b5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f53840d30d0 con 0x7f53840d1820 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f5382ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f53841620d0 0x7f53841624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f53837fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f53840d4b80 0x7f53840d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39734/0 (socket says 172.21.15.103:39734) 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f53837fe640 1 -- 172.21.15.103:0/834167260 learned_addr learned my addr 172.21.15.103:0/834167260 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f537bfff640 1 --2- 172.21.15.103:0/834167260 >> v2:172.21.15.190:3300/0 conn(0x7f53840d1820 0x7f5384161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f5382ffd640 1 -- 172.21.15.103:0/834167260 >> v2:172.21.15.190:3300/0 conn(0x7f53840d1820 msgr2=0x7f5384161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:36.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f5382ffd640 1 --2- 172.21.15.103:0/834167260 >> v2:172.21.15.190:3300/0 conn(0x7f53840d1820 0x7f5384161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f5382ffd640 1 -- 172.21.15.103:0/834167260 >> v1:172.21.15.103:6789/0 conn(0x7f53840d4b80 legacy=0x7f53840d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f5382ffd640 1 -- 172.21.15.103:0/834167260 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53840cfb90 con 0x7f53841620d0 2024-08-18T23:57:36.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.305+0000 7f537bfff640 1 --2- 172.21.15.103:0/834167260 >> v2:172.21.15.190:3300/0 conn(0x7f53840d1820 0x7f5384161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.306+0000 7f5382ffd640 1 --2- 172.21.15.103:0/834167260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53841620d0 0x7f53841624b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5384162f20 tx=0x7f537402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb3e9f0d0b949fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.306+0000 7f53827fc640 1 -- 172.21.15.103:0/834167260 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374037070 con 0x7f53841620d0 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.306+0000 7f53827fc640 1 -- 172.21.15.103:0/834167260 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537402add0 con 0x7f53841620d0 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.306+0000 7f53827fc640 1 -- 172.21.15.103:0/834167260 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374032660 con 0x7f53841620d0 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.307+0000 7f53892b5640 1 -- 172.21.15.103:0/834167260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53841620d0 msgr2=0x7f53841624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.307+0000 7f53892b5640 1 --2- 172.21.15.103:0/834167260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53841620d0 0x7f53841624b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5384162f20 tx=0x7f537402a080 comp rx=0 tx=0).stop 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.307+0000 7f53892b5640 1 -- 172.21.15.103:0/834167260 shutdown_connections 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.307+0000 7f53892b5640 1 --2- 172.21.15.103:0/834167260 >> v2:172.21.15.190:3300/0 conn(0x7f53840d1820 0x7f5384161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.307+0000 7f53892b5640 1 --2- 172.21.15.103:0/834167260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53841620d0 0x7f53841624b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.307+0000 7f53892b5640 1 -- 172.21.15.103:0/834167260 >> 172.21.15.103:0/834167260 conn(0x7f53840d4060 msgr2=0x7f53840d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:36.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.307+0000 7f53892b5640 1 -- 172.21.15.103:0/834167260 shutdown_connections 2024-08-18T23:57:36.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.307+0000 7f53892b5640 1 -- 172.21.15.103:0/834167260 wait complete. 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.308+0000 7f53892b5640 1 Processor -- start 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.308+0000 7f53892b5640 1 -- start start 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53892b5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53840d4b80 0x7f53840b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53892b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53841620d0 0x7f53840b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53892b5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53840b8bf0 0x7f53840b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53892b5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f53840b3b20 con 0x7f53840d4b80 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53892b5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f53840b39a0 con 0x7f53841620d0 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53892b5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f53841629f0 con 0x7f53840b8bf0 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53840d4b80 0x7f53840b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53840d4b80 0x7f53840b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39200/0 (socket says 172.21.15.103:39200) 2024-08-18T23:57:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 -- 172.21.15.103:0/1553094793 learned_addr learned my addr 172.21.15.103:0/1553094793 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f537bfff640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53841620d0 0x7f53840b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 -- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53840b8bf0 msgr2=0x7f53840b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53837fe640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53840b8bf0 0x7f53840b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53840b8bf0 0x7f53840b71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 -- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53841620d0 msgr2=0x7f53840b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53841620d0 0x7f53840b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 -- 172.21.15.103:0/1553094793 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53840cc6c0 con 0x7f53840d4b80 2024-08-18T23:57:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f537bfff640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53841620d0 0x7f53840b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53837fe640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53840b8bf0 0x7f53840b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f5382ffd640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53840d4b80 0x7f53840b21f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5374009890 tx=0x7f53740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f537b7fe640 1 -- 172.21.15.103:0/1553094793 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374037040 con 0x7f53840d4b80 2024-08-18T23:57:36.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f537b7fe640 1 -- 172.21.15.103:0/1553094793 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5374042070 con 0x7f53840d4b80 2024-08-18T23:57:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53840b9160 con 0x7f53840d4b80 2024-08-18T23:57:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.309+0000 7f537b7fe640 1 -- 172.21.15.103:0/1553094793 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537403b890 con 0x7f53840d4b80 2024-08-18T23:57:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.310+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53840b9720 con 0x7f53840d4b80 2024-08-18T23:57:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.311+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53841624b0 con 0x7f53840d4b80 2024-08-18T23:57:36.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.311+0000 7f537b7fe640 1 -- 172.21.15.103:0/1553094793 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f537402ac90 con 0x7f53840d4b80 2024-08-18T23:57:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.311+0000 7f537b7fe640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f536406be30 0x7f536406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.311+0000 7f537b7fe640 1 -- 172.21.15.103:0/1553094793 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f53740ab840 con 0x7f53840d4b80 2024-08-18T23:57:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.312+0000 7f537bfff640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f536406be30 0x7f536406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.312+0000 7f537bfff640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f536406be30 0x7f536406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f536c006fd0 tx=0x7f536c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.316+0000 7f537b7fe640 1 -- 172.21.15.103:0/1553094793 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5374079dd0 con 0x7f53840d4b80 2024-08-18T23:57:36.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.482+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53840d15d0 con 0x7f53840d4b80 2024-08-18T23:57:36.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.483+0000 7f537b7fe640 1 -- 172.21.15.103:0/1553094793 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18986 (secure 0 0 0) 0x7f53740796d0 con 0x7f53840d4b80 2024-08-18T23:57:36.484 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:36.485 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:57:35.900708+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:56:50.890421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-18T23:56:52.058126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-18T23:56:55.790060+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":1}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:36.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f536406be30 msgr2=0x7f536406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f536406be30 0x7f536406e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f536c006fd0 tx=0x7f536c008040 comp rx=0 tx=0).stop 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53840d4b80 msgr2=0x7f53840b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53840d4b80 0x7f53840b21f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5374009890 tx=0x7f53740046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 shutdown_connections 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f536406be30 0x7f536406e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53840b8bf0 0x7f53840b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53841620d0 0x7f53840b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 --2- 172.21.15.103:0/1553094793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53840d4b80 0x7f53840b21f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 >> 172.21.15.103:0/1553094793 conn(0x7f53840d4060 msgr2=0x7f53840b4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 shutdown_connections 2024-08-18T23:57:36.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.485+0000 7f53892b5640 1 -- 172.21.15.103:0/1553094793 wait complete. 2024-08-18T23:57:36.498 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T23:57:36.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.596+0000 7f539de17640 1 Processor -- start 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.596+0000 7f539de17640 1 -- start start 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f539de17640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f539815ee80 0x7f539806de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f539de17640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f539815f3c0 con 0x7f53980b3c60 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f539de17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f539806ba30 con 0x7f5398158520 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f539de17640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f539815f6a0 con 0x7f539815ee80 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f5396ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f53980b3c60 0x7f539815e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39744/0 (socket says 172.21.15.103:39744) 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f5396ffd640 1 -- 172.21.15.103:0/2990803269 learned_addr learned my addr 172.21.15.103:0/2990803269 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f5397fff640 1 --2- 172.21.15.103:0/2990803269 >> v2:172.21.15.190:3300/0 conn(0x7f539815ee80 0x7f539806de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842059415 0 0) 0x7f539815f3c0 con 0x7f53980b3c60 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5380003520 con 0x7f53980b3c60 2024-08-18T23:57:36.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642782648 0 0) 0x7f539806ba30 con 0x7f5398158520 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f539815f3c0 con 0x7f5398158520 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2199502746 0 0) 0x7f5380003520 con 0x7f53980b3c60 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 >> v2:172.21.15.190:3300/0 conn(0x7f539815ee80 msgr2=0x7f539806de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 --2- 172.21.15.103:0/2990803269 >> v2:172.21.15.190:3300/0 conn(0x7f539815ee80 0x7f539806de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 >> v1:172.21.15.190:6789/0 conn(0x7f5398158520 legacy=0x7f53980b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539806bd10 con 0x7f53980b3c60 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f5397fff640 1 --2- 172.21.15.103:0/2990803269 >> v2:172.21.15.190:3300/0 conn(0x7f539815ee80 0x7f539806de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.597+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f538c001670 con 0x7f53980b3c60 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 >> v1:172.21.15.103:6789/0 conn(0x7f53980b3c60 legacy=0x7f539815e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f53967fc640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5380003b40 0x7f5380003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f53967fc640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5380004800 0x7f5380004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f53967fc640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800051c0 0x7f538000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f539815f6a0 con 0x7f53800051c0 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f538000c0f0 con 0x7f5380003b40 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f538000c2f0 con 0x7f5380004800 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f5397fff640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800051c0 0x7f538000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f53977fe640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5380003b40 0x7f5380003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f5396ffd640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5380004800 0x7f5380004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f5397fff640 1 -- 172.21.15.103:0/2990803269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5380004800 msgr2=0x7f5380004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f5397fff640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5380004800 0x7f5380004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f5397fff640 1 -- 172.21.15.103:0/2990803269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5380003b40 msgr2=0x7f5380003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f5397fff640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5380003b40 0x7f5380003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.598+0000 7f5397fff640 1 -- 172.21.15.103:0/2990803269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5380003520 con 0x7f53800051c0 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f5397fff640 1 -- 172.21.15.103:0/2990803269 reap_dead start 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f5397fff640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800051c0 0x7f538000b9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f539000e350 tx=0x7f5380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2090d50b86e31c87 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390009de0 con 0x7f53800051c0 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539002e680 con 0x7f53800051c0 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f53967fc640 1 -- 172.21.15.103:0/2990803269 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539002ea70 con 0x7f53800051c0 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f539de17640 1 -- 172.21.15.103:0/2990803269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800051c0 msgr2=0x7f538000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f539de17640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800051c0 0x7f538000b9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f539000e350 tx=0x7f5380005830 comp rx=0 tx=0).stop 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f539de17640 1 -- 172.21.15.103:0/2990803269 shutdown_connections 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f539de17640 1 --2- 172.21.15.103:0/2990803269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53800051c0 0x7f538000b9c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f539de17640 1 -- 172.21.15.103:0/2990803269 >> 172.21.15.103:0/2990803269 conn(0x7f53980d05c0 msgr2=0x7f53980d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f539de17640 1 -- 172.21.15.103:0/2990803269 shutdown_connections 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.599+0000 7f539de17640 1 -- 172.21.15.103:0/2990803269 wait complete. 2024-08-18T23:57:36.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.600+0000 7f539de17640 1 Processor -- start 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f539de17640 1 -- start start 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f539de17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53800051c0 0x7f5398141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f539de17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53980cea40 0x7f53980cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f539de17640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53980ceea0 0x7f53980aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f539de17640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5398158a80 con 0x7f53980ceea0 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f539de17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5398158900 con 0x7f53800051c0 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f539de17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5398158c00 con 0x7f53980cea40 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f5397fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53980ceea0 0x7f53980aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f5397fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53980ceea0 0x7f53980aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39224/0 (socket says 172.21.15.103:39224) 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f5397fff640 1 -- 172.21.15.103:0/345898839 learned_addr learned my addr 172.21.15.103:0/345898839 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.601+0000 7f53977fe640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53800051c0 0x7f5398141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f5396ffd640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53980cea40 0x7f53980cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f5397fff640 1 -- 172.21.15.103:0/345898839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53980cea40 msgr2=0x7f53980cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f5397fff640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53980cea40 0x7f53980cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f5397fff640 1 -- 172.21.15.103:0/345898839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53800051c0 msgr2=0x7f5398141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f5397fff640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53800051c0 0x7f5398141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f5397fff640 1 -- 172.21.15.103:0/345898839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53980cf9b0 con 0x7f53980ceea0 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f5397fff640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53980ceea0 0x7f53980aeb80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f539002ef00 tx=0x7f5390009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f537ffff640 1 -- 172.21.15.103:0/345898839 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390003b90 con 0x7f53980ceea0 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f537ffff640 1 -- 172.21.15.103:0/345898839 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539003c040 con 0x7f53980ceea0 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53980cfc90 con 0x7f53980ceea0 2024-08-18T23:57:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f537ffff640 1 -- 172.21.15.103:0/345898839 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5390004020 con 0x7f53980ceea0 2024-08-18T23:57:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.602+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53980cd220 con 0x7f53980ceea0 2024-08-18T23:57:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.603+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539806de90 con 0x7f53980ceea0 2024-08-18T23:57:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.604+0000 7f537ffff640 1 -- 172.21.15.103:0/345898839 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f53900041c0 con 0x7f53980ceea0 2024-08-18T23:57:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.604+0000 7f537ffff640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f538406be30 0x7f538406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.604+0000 7f53977fe640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f538406be30 0x7f538406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.604+0000 7f537ffff640 1 -- 172.21.15.103:0/345898839 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f53900abdc0 con 0x7f53980ceea0 2024-08-18T23:57:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.605+0000 7f53977fe640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f538406be30 0x7f538406e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5388000c00 tx=0x7f5388009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.608+0000 7f537ffff640 1 -- 172.21.15.103:0/345898839 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5390032030 con 0x7f53980ceea0 2024-08-18T23:57:36.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.809+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5398143a40 con 0x7f53980ceea0 2024-08-18T23:57:36.811 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-08-18T23:57:36.810+0000 7f4856028640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T23:57:36.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.811+0000 7f537ffff640 1 -- 172.21.15.103:0/345898839 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f5390079e50 con 0x7f53980ceea0 2024-08-18T23:57:36.812 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f538406be30 msgr2=0x7f538406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f538406be30 0x7f538406e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5388000c00 tx=0x7f5388009040 comp rx=0 tx=0).stop 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53980ceea0 msgr2=0x7f53980aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53980ceea0 0x7f53980aeb80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f539002ef00 tx=0x7f5390009750 comp rx=0 tx=0).stop 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 shutdown_connections 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f538406be30 0x7f538406e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53980ceea0 0x7f53980aeb80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53980cea40 0x7f53980cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 --2- 172.21.15.103:0/345898839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53800051c0 0x7f5398141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 >> 172.21.15.103:0/345898839 conn(0x7f53980d05c0 msgr2=0x7f5398162380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:36.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 shutdown_connections 2024-08-18T23:57:36.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.814+0000 7f539de17640 1 -- 172.21.15.103:0/345898839 wait complete. 2024-08-18T23:57:36.817 INFO:tasks.ceph.mds.a.smithi103.stderr: -3193> 2024-08-18T23:56:58.725+0000 7fdcfc928640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T23:57:36.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T23:57:36.846 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-08-18T23:57:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.930+0000 7f3c3a23e640 1 Processor -- start 2024-08-18T23:57:36.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.930+0000 7f3c3a23e640 1 -- start start 2024-08-18T23:57:36.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.931+0000 7f3c3a23e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3c34158a50 0x7f3c340b5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.931+0000 7f3c3a23e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c340b5000 con 0x7f3c340d15b0 2024-08-18T23:57:36.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.931+0000 7f3c3a23e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c340afb50 con 0x7f3c340d1140 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.931+0000 7f3c3a23e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3c340734a0 con 0x7f3c34158a50 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.931+0000 7f3c33fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3c340d15b0 0x7f3c34072d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39748/0 (socket says 172.21.15.103:39748) 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.931+0000 7f3c33fff640 1 -- 172.21.15.103:0/1439672687 learned_addr learned my addr 172.21.15.103:0/1439672687 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.932+0000 7f3c337fe640 1 --2- 172.21.15.103:0/1439672687 >> v2:172.21.15.190:3300/0 conn(0x7f3c34158a50 0x7f3c340b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.932+0000 7f3c32ffd640 1 -- 172.21.15.103:0/1439672687 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027246230 0 0) 0x7f3c2c001490 con 0x7f3c340d15b0 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.932+0000 7f3c32ffd640 1 -- 172.21.15.103:0/1439672687 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c20003520 con 0x7f3c340d15b0 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.932+0000 7f3c337fe640 1 -- 172.21.15.103:0/1439672687 >> v1:172.21.15.190:6789/0 conn(0x7f3c340d1140 legacy=0x7f3c34072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.932+0000 7f3c337fe640 1 -- 172.21.15.103:0/1439672687 >> v1:172.21.15.103:6789/0 conn(0x7f3c340d15b0 legacy=0x7f3c34072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.932+0000 7f3c337fe640 1 -- 172.21.15.103:0/1439672687 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3415b560 con 0x7f3c34158a50 2024-08-18T23:57:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c337fe640 1 --2- 172.21.15.103:0/1439672687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 0x7f3c340b5310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c240097a0 tx=0x7f3c2402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c01253abe6204794 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c32ffd640 1 -- 172.21.15.103:0/1439672687 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24037070 con 0x7f3c34158a50 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c32ffd640 1 -- 172.21.15.103:0/1439672687 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c24032440 con 0x7f3c34158a50 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c32ffd640 1 -- 172.21.15.103:0/1439672687 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24032810 con 0x7f3c34158a50 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1439672687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 msgr2=0x7f3c340b5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c3a23e640 1 --2- 172.21.15.103:0/1439672687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 0x7f3c340b5310 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c240097a0 tx=0x7f3c2402a230 comp rx=0 tx=0).stop 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1439672687 shutdown_connections 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c3a23e640 1 --2- 172.21.15.103:0/1439672687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 0x7f3c340b5310 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.933+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1439672687 >> 172.21.15.103:0/1439672687 conn(0x7f3c340b2c80 msgr2=0x7f3c340b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.934+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1439672687 shutdown_connections 2024-08-18T23:57:36.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.934+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1439672687 wait complete. 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.935+0000 7f3c3a23e640 1 Processor -- start 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.935+0000 7f3c3a23e640 1 -- start start 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c3a23e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c340d1140 0x7f3c341e6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c3a23e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c340d15b0 0x7f3c3415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c3a23e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 0x7f3c341e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c3a23e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3415be00 con 0x7f3c340d15b0 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c3a23e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3415bb20 con 0x7f3c34158a50 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c3a23e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3c340d1a00 con 0x7f3c340d1140 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c340d15b0 0x7f3c3415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c340d15b0 0x7f3c3415aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39240/0 (socket says 172.21.15.103:39240) 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 -- 172.21.15.103:0/1918259446 learned_addr learned my addr 172.21.15.103:0/1918259446 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:36.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c33fff640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 0x7f3c341e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c337fe640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c340d1140 0x7f3c341e6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 -- 172.21.15.103:0/1918259446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c340d1140 msgr2=0x7f3c341e6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c340d1140 0x7f3c341e6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 -- 172.21.15.103:0/1918259446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 msgr2=0x7f3c341e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 0x7f3c341e54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 -- 172.21.15.103:0/1918259446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c341e5d10 con 0x7f3c340d15b0 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c2affd640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c340d15b0 0x7f3c3415aa00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00c430 tx=0x7f3c1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c30ff9640 1 -- 172.21.15.103:0/1918259446 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0052d0 con 0x7f3c340d15b0 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c30ff9640 1 -- 172.21.15.103:0/1918259446 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1c005490 con 0x7f3c340d15b0 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c341e5ff0 con 0x7f3c340d15b0 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c30ff9640 1 -- 172.21.15.103:0/1918259446 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c007260 con 0x7f3c340d15b0 2024-08-18T23:57:36.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.936+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c341e65b0 con 0x7f3c340d15b0 2024-08-18T23:57:36.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.937+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3406ec90 con 0x7f3c340d15b0 2024-08-18T23:57:36.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.938+0000 7f3c30ff9640 1 -- 172.21.15.103:0/1918259446 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c1c007400 con 0x7f3c340d15b0 2024-08-18T23:57:36.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.938+0000 7f3c30ff9640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3c1406be30 0x7f3c1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:36.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.939+0000 7f3c337fe640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3c1406be30 0x7f3c1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:36.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.939+0000 7f3c30ff9640 1 -- 172.21.15.103:0/1918259446 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f3c1c08a750 con 0x7f3c340d15b0 2024-08-18T23:57:36.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.939+0000 7f3c337fe640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3c1406be30 0x7f3c1406e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3c24034000 tx=0x7f3c2402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:36.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:36.943+0000 7f3c30ff9640 1 -- 172.21.15.103:0/1918259446 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3c340afb50 con 0x7f3c340d15b0 2024-08-18T23:57:37.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.144+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3c341e7310 con 0x7f3c340d15b0 2024-08-18T23:57:37.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.813+0000 7f3c30ff9640 1 -- 172.21.15.103:0/1918259446 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f3c1c058630 con 0x7f3c340d15b0 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3c1406be30 msgr2=0x7f3c1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3c1406be30 0x7f3c1406e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3c24034000 tx=0x7f3c2402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c340d15b0 msgr2=0x7f3c3415aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c340d15b0 0x7f3c3415aa00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00c430 tx=0x7f3c1c00c8f0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 shutdown_connections 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f3c1406be30 0x7f3c1406e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3c34158a50 0x7f3c341e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c340d15b0 0x7f3c3415aa00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 --2- 172.21.15.103:0/1918259446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3c340d1140 0x7f3c341e6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 >> 172.21.15.103:0/1918259446 conn(0x7f3c340b2c80 msgr2=0x7f3c340b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:37.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 shutdown_connections 2024-08-18T23:57:37.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.816+0000 7f3c3a23e640 1 -- 172.21.15.103:0/1918259446 wait complete. 2024-08-18T23:57:37.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T23:57:37.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.981+0000 7f0faf1ea640 1 Processor -- start 2024-08-18T23:57:37.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.981+0000 7f0faf1ea640 1 -- start start 2024-08-18T23:57:37.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0faf1ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d2a10 0x7f0fa806f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:37.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0faf1ea640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0fa80d03f0 0x7f0fa80d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:37.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0faf1ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fa80cf0b0 con 0x7f0fa815bf90 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0faf1ea640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f0fa80ccc50 con 0x7f0fa80d03f0 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0faf1ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa80cf390 con 0x7f0fa80d2a10 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0fad787640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0fa80d03f0 0x7f0fa80d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0fad787640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0fa80d03f0 0x7f0fa80d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39250/0 (socket says 172.21.15.103:39250) 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0fad787640 1 -- 172.21.15.103:0/753085361 learned_addr learned my addr 172.21.15.103:0/753085361 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.982+0000 7f0f9ffff640 1 --2- 172.21.15.103:0/753085361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d2a10 0x7f0fa806f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.983+0000 7f0fad787640 1 -- 172.21.15.103:0/753085361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d2a10 msgr2=0x7f0fa806f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.983+0000 7f0fad787640 1 --2- 172.21.15.103:0/753085361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d2a10 0x7f0fa806f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.983+0000 7f0fad787640 1 -- 172.21.15.103:0/753085361 >> v1:172.21.15.190:6789/0 conn(0x7f0fa815bf90 legacy=0x7f0fa80cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.983+0000 7f0fad787640 1 -- 172.21.15.103:0/753085361 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa815c370 con 0x7f0fa80d03f0 2024-08-18T23:57:37.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.983+0000 7f0f9f7fe640 1 -- 172.21.15.103:0/753085361 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3901803303 0 0) 0x7f0fa80cf0b0 con 0x7f0fa815bf90 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0fad787640 1 --2- 172.21.15.103:0/753085361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d03f0 0x7f0fa80d08a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009e50 tx=0x7f0fa002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be183bfbd9b61b06 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0f9f7fe640 1 -- 172.21.15.103:0/753085361 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0036070 con 0x7f0fa80d03f0 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0f9f7fe640 1 -- 172.21.15.103:0/753085361 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa0031600 con 0x7f0fa80d03f0 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0f9f7fe640 1 -- 172.21.15.103:0/753085361 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00319d0 con 0x7f0fa80d03f0 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0faf1ea640 1 -- 172.21.15.103:0/753085361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d03f0 msgr2=0x7f0fa80d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/753085361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d03f0 0x7f0fa80d08a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009e50 tx=0x7f0fa002a710 comp rx=0 tx=0).stop 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0faf1ea640 1 -- 172.21.15.103:0/753085361 shutdown_connections 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/753085361 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d03f0 0x7f0fa80d08a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/753085361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d2a10 0x7f0fa806f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0faf1ea640 1 -- 172.21.15.103:0/753085361 >> 172.21.15.103:0/753085361 conn(0x7f0fa80d1e10 msgr2=0x7f0fa80d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.984+0000 7f0faf1ea640 1 -- 172.21.15.103:0/753085361 shutdown_connections 2024-08-18T23:57:37.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.985+0000 7f0faf1ea640 1 -- 172.21.15.103:0/753085361 wait complete. 2024-08-18T23:57:37.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.986+0000 7f0faf1ea640 1 Processor -- start 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.986+0000 7f0faf1ea640 1 -- start start 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0faf1ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d03f0 0x7f0fa815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0faf1ea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d2a10 0x7f0fa815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0faf1ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa815bf90 0x7f0fa815d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0faf1ea640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa80cd260 con 0x7f0fa80d2a10 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0faf1ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa80cd0e0 con 0x7f0fa815bf90 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0faf1ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa80cd3e0 con 0x7f0fa80d03f0 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d2a10 0x7f0fa815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d2a10 0x7f0fa815a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39260/0 (socket says 172.21.15.103:39260) 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 -- 172.21.15.103:0/2850907525 learned_addr learned my addr 172.21.15.103:0/2850907525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:37.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0facf86640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d03f0 0x7f0fa815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0fad787640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa815bf90 0x7f0fa815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 -- 172.21.15.103:0/2850907525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d03f0 msgr2=0x7f0fa815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d03f0 0x7f0fa815b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 -- 172.21.15.103:0/2850907525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa815bf90 msgr2=0x7f0fa815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa815bf90 0x7f0fa815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 -- 172.21.15.103:0/2850907525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa80b4230 con 0x7f0fa80d2a10 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9ffff640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d2a10 0x7f0fa815a4a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e9e0 tx=0x7f0f9800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9d7fa640 1 -- 172.21.15.103:0/2850907525 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98017070 con 0x7f0fa80d2a10 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9d7fa640 1 -- 172.21.15.103:0/2850907525 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f9800c970 con 0x7f0fa80d2a10 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa80b4510 con 0x7f0fa80d2a10 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.987+0000 7f0f9d7fa640 1 -- 172.21.15.103:0/2850907525 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9800cd60 con 0x7f0fa80d2a10 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.988+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa815c640 con 0x7f0fa80d2a10 2024-08-18T23:57:37.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.988+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa806f800 con 0x7f0fa80d2a10 2024-08-18T23:57:37.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.989+0000 7f0f9d7fa640 1 -- 172.21.15.103:0/2850907525 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f9801a070 con 0x7f0fa80d2a10 2024-08-18T23:57:37.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.989+0000 7f0f9d7fa640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0f9406be30 0x7f0f9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:37.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.989+0000 7f0f9d7fa640 1 -- 172.21.15.103:0/2850907525 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f0f9808b140 con 0x7f0fa80d2a10 2024-08-18T23:57:37.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.989+0000 7f0facf86640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0f9406be30 0x7f0f9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:37.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.990+0000 7f0facf86640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0f9406be30 0x7f0f9406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4000f60 tx=0x7f0fa4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:37.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:37.994+0000 7f0f9d7fa640 1 -- 172.21.15.103:0/2850907525 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f0f980590b0 con 0x7f0fa80d2a10 2024-08-18T23:57:38.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.157+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0fa8075400 con 0x7f0fa80d2a10 2024-08-18T23:57:38.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.925+0000 7f0f9d7fa640 1 -- 172.21.15.103:0/2850907525 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7f0f9805d3b0 con 0x7f0fa80d2a10 2024-08-18T23:57:38.927 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0f9406be30 msgr2=0x7f0f9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0f9406be30 0x7f0f9406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4000f60 tx=0x7f0fa4009040 comp rx=0 tx=0).stop 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d2a10 msgr2=0x7f0fa815a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d2a10 0x7f0fa815a4a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e9e0 tx=0x7f0f9800eea0 comp rx=0 tx=0).stop 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 shutdown_connections 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f0f9406be30 0x7f0f9406e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fa815bf90 0x7f0fa815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fa80d2a10 0x7f0fa815a4a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 --2- 172.21.15.103:0/2850907525 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fa80d03f0 0x7f0fa815b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:38.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.927+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 >> 172.21.15.103:0/2850907525 conn(0x7f0fa80d1e10 msgr2=0x7f0fa80c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:38.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.928+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 shutdown_connections 2024-08-18T23:57:38.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:38.928+0000 7f0faf1ea640 1 -- 172.21.15.103:0/2850907525 wait complete. 2024-08-18T23:57:38.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T23:57:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.048+0000 7f89d8b9d640 1 Processor -- start 2024-08-18T23:57:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.048+0000 7f89d8b9d640 1 -- start start 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.048+0000 7f89d8b9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d415f5c0 0x7f89d415fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.048+0000 7f89d8b9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89d40b2940 0x7f89d40cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.048+0000 7f89d8b9d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d40d2c60 con 0x7f89d40b3440 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.048+0000 7f89d8b9d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f89d4160a40 con 0x7f89d40b2940 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.048+0000 7f89d8b9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f89d4160780 con 0x7f89d415f5c0 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.049+0000 7f89d3fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89d40b2940 0x7f89d40cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.049+0000 7f89d3fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f89d40b2940 0x7f89d40cf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39264/0 (socket says 172.21.15.103:39264) 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.049+0000 7f89d3fff640 1 -- 172.21.15.103:0/469518048 learned_addr learned my addr 172.21.15.103:0/469518048 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.049+0000 7f89d37fe640 1 --2- 172.21.15.103:0/469518048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d415f5c0 0x7f89d415fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.049+0000 7f89d3fff640 1 -- 172.21.15.103:0/469518048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d415f5c0 msgr2=0x7f89d415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.049+0000 7f89d3fff640 1 --2- 172.21.15.103:0/469518048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d415f5c0 0x7f89d415fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.049+0000 7f89d3fff640 1 -- 172.21.15.103:0/469518048 >> v1:172.21.15.190:6789/0 conn(0x7f89d40b3440 legacy=0x7f89d4160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.049+0000 7f89d3fff640 1 -- 172.21.15.103:0/469518048 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d40d2980 con 0x7f89d40b2940 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d3fff640 1 --2- 172.21.15.103:0/469518048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b2940 0x7f89d40cf900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009870 tx=0x7f89cc02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d06423c97dbf85 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d27fc640 1 -- 172.21.15.103:0/469518048 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc037070 con 0x7f89d40b2940 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d27fc640 1 -- 172.21.15.103:0/469518048 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc032440 con 0x7f89d40b2940 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d27fc640 1 -- 172.21.15.103:0/469518048 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc032810 con 0x7f89d40b2940 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d8b9d640 1 -- 172.21.15.103:0/469518048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b2940 msgr2=0x7f89d40cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/469518048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b2940 0x7f89d40cf900 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009870 tx=0x7f89cc02a130 comp rx=0 tx=0).stop 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d8b9d640 1 -- 172.21.15.103:0/469518048 shutdown_connections 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/469518048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b2940 0x7f89d40cf900 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/469518048 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d415f5c0 0x7f89d415fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d8b9d640 1 -- 172.21.15.103:0/469518048 >> 172.21.15.103:0/469518048 conn(0x7f89d40d1d30 msgr2=0x7f89d40d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d8b9d640 1 -- 172.21.15.103:0/469518048 shutdown_connections 2024-08-18T23:57:39.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.050+0000 7f89d8b9d640 1 -- 172.21.15.103:0/469518048 wait complete. 2024-08-18T23:57:39.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.051+0000 7f89d8b9d640 1 Processor -- start 2024-08-18T23:57:39.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.052+0000 7f89d8b9d640 1 -- start start 2024-08-18T23:57:39.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.052+0000 7f89d8b9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d40b2940 0x7f89d40c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:39.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.052+0000 7f89d8b9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b3440 0x7f89d415da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:39.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.052+0000 7f89d8b9d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89d415f5c0 0x7f89d40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:39.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.052+0000 7f89d8b9d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40cf5f0 con 0x7f89d40b3440 2024-08-18T23:57:39.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.052+0000 7f89d8b9d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40cf0d0 con 0x7f89d415f5c0 2024-08-18T23:57:39.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.052+0000 7f89d8b9d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f89d40cfe40 con 0x7f89d40b2940 2024-08-18T23:57:39.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b3440 0x7f89d415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:39.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b3440 0x7f89d415da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39268/0 (socket says 172.21.15.103:39268) 2024-08-18T23:57:39.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 -- 172.21.15.103:0/2533639348 learned_addr learned my addr 172.21.15.103:0/2533639348 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:39.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d3fff640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89d415f5c0 0x7f89d40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:39.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d37fe640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d40b2940 0x7f89d40c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:39.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 -- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d40b2940 msgr2=0x7f89d40c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:39.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d40b2940 0x7f89d40c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 -- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89d415f5c0 msgr2=0x7f89d40ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89d415f5c0 0x7f89d40ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 -- 172.21.15.103:0/2533639348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d415e7a0 con 0x7f89d40b3440 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d3fff640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89d415f5c0 0x7f89d40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d2ffd640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b3440 0x7f89d415da20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c340 tx=0x7f89c800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89bbfff640 1 -- 172.21.15.103:0/2533639348 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c80052d0 con 0x7f89d40b3440 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89bbfff640 1 -- 172.21.15.103:0/2533639348 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c8005490 con 0x7f89d40b3440 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89bbfff640 1 -- 172.21.15.103:0/2533639348 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c8007260 con 0x7f89d40b3440 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d415ea40 con 0x7f89d40b3440 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.053+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d415df60 con 0x7f89d40b3440 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.054+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d40cf900 con 0x7f89d40b3440 2024-08-18T23:57:39.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.055+0000 7f89bbfff640 1 -- 172.21.15.103:0/2533639348 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f89c8007400 con 0x7f89d40b3440 2024-08-18T23:57:39.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.055+0000 7f89bbfff640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f89c006be30 0x7f89c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:39.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.055+0000 7f89bbfff640 1 -- 172.21.15.103:0/2533639348 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6412+0+0 (secure 0 0 0) 0x7f89c808a4d0 con 0x7f89d40b3440 2024-08-18T23:57:39.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.055+0000 7f89d37fe640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f89c006be30 0x7f89c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:39.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.056+0000 7f89d37fe640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f89c006be30 0x7f89c006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009fd0 tx=0x7f89c4009800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:39.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.059+0000 7f89bbfff640 1 -- 172.21.15.103:0/2533639348 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f89c8058570 con 0x7f89d40b3440 2024-08-18T23:57:39.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.229+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f89d40b7cb0 con 0x7f89d40b3440 2024-08-18T23:57:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.926+0000 7f89bbfff640 1 -- 172.21.15.103:0/2533639348 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f89c805c870 con 0x7f89d40b3440 2024-08-18T23:57:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-08-18T23:57:39.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.932+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f89c006be30 msgr2=0x7f89c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:39.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.932+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f89c006be30 0x7f89c006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f89c4009fd0 tx=0x7f89c4009800 comp rx=0 tx=0).stop 2024-08-18T23:57:39.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.932+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b3440 msgr2=0x7f89d415da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:39.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.932+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b3440 0x7f89d415da20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c340 tx=0x7f89c800c800 comp rx=0 tx=0).stop 2024-08-18T23:57:39.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.933+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 shutdown_connections 2024-08-18T23:57:39.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.933+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f89c006be30 0x7f89c006e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.933+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f89d415f5c0 0x7f89d40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.933+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f89d40b3440 0x7f89d415da20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.933+0000 7f89d8b9d640 1 --2- 172.21.15.103:0/2533639348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f89d40b2940 0x7f89d40c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:39.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.933+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 >> 172.21.15.103:0/2533639348 conn(0x7f89d40d1d30 msgr2=0x7f89d40d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:39.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.933+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 shutdown_connections 2024-08-18T23:57:39.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:39.933+0000 7f89d8b9d640 1 -- 172.21.15.103:0/2533639348 wait complete. 2024-08-18T23:57:39.950 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-18T23:57:40.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.061+0000 7f4b72cb7640 1 Processor -- start 2024-08-18T23:57:40.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.061+0000 7f4b72cb7640 1 -- start start 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b72cb7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c0d2a10 0x7f4b6c06f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b72cb7640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6c0cf0b0 con 0x7f4b6c0d03f0 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b72cb7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6c0cf390 con 0x7f4b6c15bf90 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b72cb7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c0ccc50 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b71254640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f4b6c0d03f0 0x7f4b6c0cd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39762/0 (socket says 172.21.15.103:39762) 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b71254640 1 -- 172.21.15.103:0/2271967873 learned_addr learned my addr 172.21.15.103:0/2271967873 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6bfff640 1 --2- 172.21.15.103:0/2271967873 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c0d2a10 0x7f4b6c06f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6b7fe640 1 -- 172.21.15.103:0/2271967873 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223087348 0 0) 0x7f4b6c0cf0b0 con 0x7f4b6c0d03f0 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6b7fe640 1 -- 172.21.15.103:0/2271967873 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b5c003520 con 0x7f4b6c0d03f0 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6b7fe640 1 -- 172.21.15.103:0/2271967873 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 196496194 0 0) 0x7f4b6c0cf390 con 0x7f4b6c15bf90 2024-08-18T23:57:40.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6b7fe640 1 -- 172.21.15.103:0/2271967873 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b6c0cf0b0 con 0x7f4b6c15bf90 2024-08-18T23:57:40.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6bfff640 1 -- 172.21.15.103:0/2271967873 >> v1:172.21.15.190:6789/0 conn(0x7f4b6c15bf90 legacy=0x7f4b6c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:40.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6bfff640 1 -- 172.21.15.103:0/2271967873 >> v1:172.21.15.103:6789/0 conn(0x7f4b6c0d03f0 legacy=0x7f4b6c0cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:40.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6b7fe640 1 -- 172.21.15.103:0/2271967873 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1439844423 0 0) 0x7f4b5c003520 con 0x7f4b6c0d03f0 2024-08-18T23:57:40.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.062+0000 7f4b6bfff640 1 -- 172.21.15.103:0/2271967873 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c15c370 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.063+0000 7f4b6bfff640 1 --2- 172.21.15.103:0/2271967873 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c0d2a10 0x7f4b6c06f800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b580097d0 tx=0x7f4b5802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=414dc4eeac424206 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:40.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.063+0000 7f4b6b7fe640 1 -- 172.21.15.103:0/2271967873 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58037070 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.063+0000 7f4b6b7fe640 1 -- 172.21.15.103:0/2271967873 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5802ac30 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.063+0000 7f4b6b7fe640 1 -- 172.21.15.103:0/2271967873 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b640019f0 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.064+0000 7f4b72cb7640 1 -- 172.21.15.103:0/2271967873 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c0d2a10 msgr2=0x7f4b6c06f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.064+0000 7f4b72cb7640 1 --2- 172.21.15.103:0/2271967873 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c0d2a10 0x7f4b6c06f800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b580097d0 tx=0x7f4b5802a1a0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.064+0000 7f4b72cb7640 1 -- 172.21.15.103:0/2271967873 shutdown_connections 2024-08-18T23:57:40.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.064+0000 7f4b72cb7640 1 --2- 172.21.15.103:0/2271967873 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c0d2a10 0x7f4b6c06f800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.064+0000 7f4b72cb7640 1 -- 172.21.15.103:0/2271967873 >> 172.21.15.103:0/2271967873 conn(0x7f4b6c0d1e10 msgr2=0x7f4b6c0d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.064+0000 7f4b72cb7640 1 -- 172.21.15.103:0/2271967873 shutdown_connections 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.064+0000 7f4b72cb7640 1 -- 172.21.15.103:0/2271967873 wait complete. 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.065+0000 7f4b72cb7640 1 Processor -- start 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.065+0000 7f4b72cb7640 1 -- start start 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b72cb7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b6c0d03f0 0x7f4b6c0b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b72cb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b6c0d2a10 0x7f4b6c15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b72cb7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c15bf90 0x7f4b6c15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b72cb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d0a20 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b72cb7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d08a0 con 0x7f4b6c0d03f0 2024-08-18T23:57:40.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b72cb7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6c0d0ba0 con 0x7f4b6c15bf90 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b6c0d2a10 0x7f4b6c15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b6bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b6c0d2a10 0x7f4b6c15d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39280/0 (socket says 172.21.15.103:39280) 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b6bfff640 1 -- 172.21.15.103:0/919366461 learned_addr learned my addr 172.21.15.103:0/919366461 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b70a53640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b6c0d03f0 0x7f4b6c0b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b71254640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c15bf90 0x7f4b6c15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b6bfff640 1 -- 172.21.15.103:0/919366461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c15bf90 msgr2=0x7f4b6c15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b6bfff640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c15bf90 0x7f4b6c15ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b6bfff640 1 -- 172.21.15.103:0/919366461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b6c0d03f0 msgr2=0x7f4b6c0b5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b6bfff640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b6c0d03f0 0x7f4b6c0b5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.066+0000 7f4b6bfff640 1 -- 172.21.15.103:0/919366461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c0b5e20 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.067+0000 7f4b6bfff640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b6c0d2a10 0x7f4b6c15d6e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4b580097d0 tx=0x7f4b580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.067+0000 7f4b697fa640 1 -- 172.21.15.103:0/919366461 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58037050 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.067+0000 7f4b697fa640 1 -- 172.21.15.103:0/919366461 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58038040 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.067+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c15dff0 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.067+0000 7f4b697fa640 1 -- 172.21.15.103:0/919366461 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58006e10 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.067+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c15dc20 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.068+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6c06f800 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.068+0000 7f4b697fa640 1 -- 172.21.15.103:0/919366461 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b58045020 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.069+0000 7f4b697fa640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4b5006be60 0x7f4b5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.069+0000 7f4b70a53640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4b5006be60 0x7f4b5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.069+0000 7f4b697fa640 1 -- 172.21.15.103:0/919366461 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7f4b580aae70 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.069+0000 7f4b70a53640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4b5006be60 0x7f4b5006e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b600011e0 tx=0x7f4b60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:40.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.073+0000 7f4b697fa640 1 -- 172.21.15.103:0/919366461 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f4b5804c020 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.239+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4b6c0cfc70 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.937+0000 7f4b697fa640 1 -- 172.21.15.103:0/919366461 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f4b58079820 con 0x7f4b6c0d2a10 2024-08-18T23:57:40.939 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' removed 2024-08-18T23:57:40.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4b5006be60 msgr2=0x7f4b5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:40.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4b5006be60 0x7f4b5006e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b600011e0 tx=0x7f4b60009040 comp rx=0 tx=0).stop 2024-08-18T23:57:40.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b6c0d2a10 msgr2=0x7f4b6c15d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:40.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b6c0d2a10 0x7f4b6c15d6e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4b580097d0 tx=0x7f4b580046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 shutdown_connections 2024-08-18T23:57:40.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f4b5006be60 0x7f4b5006e320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4b6c15bf90 0x7f4b6c15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b6c0d2a10 0x7f4b6c15d6e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 --2- 172.21.15.103:0/919366461 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b6c0d03f0 0x7f4b6c0b5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:40.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.941+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 >> 172.21.15.103:0/919366461 conn(0x7f4b6c0d1e10 msgr2=0x7f4b6c0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:40.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.942+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 shutdown_connections 2024-08-18T23:57:40.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:40.942+0000 7f4b72cb7640 1 -- 172.21.15.103:0/919366461 wait complete. 2024-08-18T23:57:40.958 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-18T23:57:40.959 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-18T23:57:40.959 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T23:57:40.959 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:41.030 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-18T23:57:41.030 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-18T23:57:41.031 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T23:57:41.031 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:41.031 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-18T23:57:41.031 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-18T23:57:41.032 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T23:57:41.032 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:41.032 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-18T23:57:41.032 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-18T23:57:41.033 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T23:57:41.033 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:57:41.034 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T23:57:41.035 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-18T23:57:41.041 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T23:57:41.042 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-18T23:57:41.044 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T23:57:41.045 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-18T23:57:41.046 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T23:57:41.046 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-18T23:57:41.062 INFO:tasks.ceph.mds.a:Started 2024-08-18T23:57:41.063 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:41.066 INFO:tasks.ceph.mds.c:Started 2024-08-18T23:57:41.067 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:41.094 INFO:tasks.ceph.mds.b:Started 2024-08-18T23:57:41.094 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:41.101 INFO:tasks.ceph.mds.d:Started 2024-08-18T23:57:41.101 DEBUG:teuthology.parallel:result is None 2024-08-18T23:57:41.101 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-18T23:57:41.141 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-08-18T23:57:41.142 INFO:tasks.ceph.mds.c.smithi103.stdout:starting mds.c at 2024-08-18T23:57:41.173 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-08-18T23:57:41.180 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-08-18T23:57:41.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.205+0000 7fcdea08f640 1 Processor -- start 2024-08-18T23:57:41.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.205+0000 7fcdea08f640 1 -- start start 2024-08-18T23:57:41.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcdea08f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde4158950 0x7fcde40b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcdea08f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcde40b5750 0x7fcde406f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcdea08f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde40b44b0 con 0x7fcde415bde0 2024-08-18T23:57:41.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcdea08f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fcde406f320 con 0x7fcde40b5750 2024-08-18T23:57:41.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcdea08f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcde4158d30 con 0x7fcde4158950 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcde2ffd640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fcde415bde0 0x7fcde40b5040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39776/0 (socket says 172.21.15.103:39776) 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcde2ffd640 1 -- 172.21.15.103:0/132550720 learned_addr learned my addr 172.21.15.103:0/132550720 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcde3fff640 1 --2- 172.21.15.103:0/132550720 >> v2:172.21.15.190:3300/0 conn(0x7fcde40b5750 0x7fcde406f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde37fe640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde4158950 0x7fcde40b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.206+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535475881 0 0) 0x7fcde40b44b0 con 0x7fcde415bde0 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdcc005730 con 0x7fcde415bde0 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1327153729 0 0) 0x7fcdcc005730 con 0x7fcde415bde0 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde4158950 msgr2=0x7fcde40b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde4158950 0x7fcde40b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 >> v2:172.21.15.190:3300/0 conn(0x7fcde40b5750 msgr2=0x7fcde406f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 --2- 172.21.15.103:0/132550720 >> v2:172.21.15.190:3300/0 conn(0x7fcde40b5750 0x7fcde406f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde40b4790 con 0x7fcde415bde0 2024-08-18T23:57:41.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fcdd8001670 con 0x7fcde415bde0 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 >> v1:172.21.15.103:6789/0 conn(0x7fcde415bde0 legacy=0x7fcde40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde4158950 0x7fcdcc005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdcc006140 0x7fcdcc006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcdcc0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcde406f320 con 0x7fcdcc006f50 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4158d30 con 0x7fcdcc006140 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc00dbd0 con 0x7fcde4158950 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde3fff640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcdcc0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde37fe640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde4158950 0x7fcdcc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde2ffd640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdcc006140 0x7fcdcc006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde3fff640 1 -- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde4158950 msgr2=0x7fcdcc005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde3fff640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde4158950 0x7fcdcc005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde3fff640 1 -- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdcc006140 msgr2=0x7fcdcc006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde3fff640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcdcc006140 0x7fcdcc006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.207+0000 7fcde3fff640 1 -- 172.21.15.103:0/132550720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc005730 con 0x7fcdcc006f50 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.208+0000 7fcde3fff640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcdcc0073d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009f90 tx=0x7fcdcc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b502310171b8b5cb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.208+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc009c10 con 0x7fcdcc006f50 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.208+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcddc036070 con 0x7fcdcc006f50 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.208+0000 7fcde27fc640 1 -- 172.21.15.103:0/132550720 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc031670 con 0x7fcdcc006f50 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.209+0000 7fcdea08f640 1 -- 172.21.15.103:0/132550720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 msgr2=0x7fcdcc0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.209+0000 7fcdea08f640 1 --2- 172.21.15.103:0/132550720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcdcc0073d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009f90 tx=0x7fcdcc007a40 comp rx=0 tx=0).stop 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.209+0000 7fcde3fff640 1 -- 172.21.15.103:0/132550720 reap_dead start 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.209+0000 7fcdea08f640 1 -- 172.21.15.103:0/132550720 shutdown_connections 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.209+0000 7fcdea08f640 1 -- 172.21.15.103:0/132550720 >> 172.21.15.103:0/132550720 conn(0x7fcde40d0e30 msgr2=0x7fcde40d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.209+0000 7fcdea08f640 1 -- 172.21.15.103:0/132550720 shutdown_connections 2024-08-18T23:57:41.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.209+0000 7fcdea08f640 1 -- 172.21.15.103:0/132550720 wait complete. 2024-08-18T23:57:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.210+0000 7fcdea08f640 1 Processor -- start 2024-08-18T23:57:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.210+0000 7fcdea08f640 1 -- start start 2024-08-18T23:57:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdea08f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcde4155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdea08f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde415a3f0 0x7fcde41536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdea08f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde415a870 0x7fcde4153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdea08f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcde40b4d50 con 0x7fcdcc006f50 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdea08f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcde415c220 con 0x7fcde415a3f0 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdea08f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcde40b3da0 con 0x7fcde415a870 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcde4155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcde4155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39334/0 (socket says 172.21.15.103:39334) 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 -- 172.21.15.103:0/3730562021 learned_addr learned my addr 172.21.15.103:0/3730562021 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde2ffd640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde415a3f0 0x7fcde41536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde3fff640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde415a870 0x7fcde4153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 -- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde415a870 msgr2=0x7fcde4153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde415a870 0x7fcde4153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 -- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde415a3f0 msgr2=0x7fcde41536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde415a3f0 0x7fcde41536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 -- 172.21.15.103:0/3730562021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde414fc70 con 0x7fcdcc006f50 2024-08-18T23:57:41.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde2ffd640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde415a3f0 0x7fcde41536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde3fff640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde415a870 0x7fcde4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcde37fe640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcde4155300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40119a0 tx=0x7fcdd4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdcbfff640 1 -- 172.21.15.103:0/3730562021 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400faf0 con 0x7fcdcc006f50 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdcbfff640 1 -- 172.21.15.103:0/3730562021 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd400fc90 con 0x7fcdcc006f50 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde4151ff0 con 0x7fcdcc006f50 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.211+0000 7fcdcbfff640 1 -- 172.21.15.103:0/3730562021 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4014440 con 0x7fcdcc006f50 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.212+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde41525b0 con 0x7fcdcc006f50 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.212+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde40b4130 con 0x7fcdcc006f50 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.213+0000 7fcdcbfff640 1 -- 172.21.15.103:0/3730562021 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdd4012040 con 0x7fcdcc006f50 2024-08-18T23:57:41.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.213+0000 7fcdcbfff640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcdd006be30 0x7fcdd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.214+0000 7fcde2ffd640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcdd006be30 0x7fcdd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.214+0000 7fcdcbfff640 1 -- 172.21.15.103:0/3730562021 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7fcdd408b3a0 con 0x7fcdcc006f50 2024-08-18T23:57:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.214+0000 7fcde2ffd640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcdd006be30 0x7fcdd006e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcde409ed60 tx=0x7fcdd8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:41.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.218+0000 7fcdcbfff640 1 -- 172.21.15.103:0/3730562021 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fcdd4019030 con 0x7fcdcc006f50 2024-08-18T23:57:41.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.401+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcde4156d80 con 0x7fcdcc006f50 2024-08-18T23:57:41.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.947+0000 7fcdcbfff640 1 -- 172.21.15.103:0/3730562021 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7fcdd4059900 con 0x7fcdcc006f50 2024-08-18T23:57:41.949 INFO:teuthology.orchestra.run.smithi103.stderr: removed all blocklist entries 2024-08-18T23:57:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcdd006be30 msgr2=0x7fcdd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcdd006be30 0x7fcdd006e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcde409ed60 tx=0x7fcdd8009040 comp rx=0 tx=0).stop 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 msgr2=0x7fcde4155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcde4155300 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40119a0 tx=0x7fcdd4011e60 comp rx=0 tx=0).stop 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 shutdown_connections 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fcdd006be30 0x7fcdd006e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcde415a870 0x7fcde4153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcde415a3f0 0x7fcde41536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 --2- 172.21.15.103:0/3730562021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcdcc006f50 0x7fcde4155300 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 >> 172.21.15.103:0/3730562021 conn(0x7fcde40d0e30 msgr2=0x7fcde4157860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 shutdown_connections 2024-08-18T23:57:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:41.951+0000 7fcdea08f640 1 -- 172.21.15.103:0/3730562021 wait complete. 2024-08-18T23:57:41.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-18T23:57:42.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.106+0000 7f9a8e08d640 1 Processor -- start 2024-08-18T23:57:42.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.106+0000 7f9a8e08d640 1 -- start start 2024-08-18T23:57:42.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.107+0000 7f9a8e08d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9a880cecc0 0x7f9a880cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.107+0000 7f9a8e08d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a880b3190 con 0x7f9a880724a0 2024-08-18T23:57:42.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.107+0000 7f9a8e08d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a880b3470 con 0x7f9a880b2cb0 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.107+0000 7f9a8e08d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9a880b46c0 con 0x7f9a880cecc0 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.107+0000 7f9a87fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9a880724a0 0x7f9a88150e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39788/0 (socket says 172.21.15.103:39788) 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.107+0000 7f9a87fff640 1 -- 172.21.15.103:0/2290147590 learned_addr learned my addr 172.21.15.103:0/2290147590 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a877fe640 1 --2- 172.21.15.103:0/2290147590 >> v2:172.21.15.190:3300/0 conn(0x7f9a880cecc0 0x7f9a880cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180646019 0 0) 0x7f9a880b3190 con 0x7f9a880724a0 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a70003520 con 0x7f9a880724a0 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 16584773 0 0) 0x7f9a70003520 con 0x7f9a880724a0 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 >> v2:172.21.15.190:3300/0 conn(0x7f9a880cecc0 msgr2=0x7f9a880cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 --2- 172.21.15.103:0/2290147590 >> v2:172.21.15.190:3300/0 conn(0x7f9a880cecc0 0x7f9a880cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 >> v1:172.21.15.190:6789/0 conn(0x7f9a880b2cb0 legacy=0x7f9a88071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a880b3750 con 0x7f9a880724a0 2024-08-18T23:57:42.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f9a80001670 con 0x7f9a880724a0 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 >> v1:172.21.15.103:6789/0 conn(0x7f9a880724a0 legacy=0x7f9a88150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a700039b0 0x7f9a70003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a70004800 0x7f9a70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7000c030 con 0x7f9a700051c0 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7000c1e0 con 0x7f9a700039b0 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7000c3e0 con 0x7f9a70004800 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a87fff640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a877fe640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a700039b0 0x7f9a70003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a86ffd640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a70004800 0x7f9a70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a87fff640 1 -- 172.21.15.103:0/2290147590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a70004800 msgr2=0x7f9a70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a87fff640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a70004800 0x7f9a70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a87fff640 1 -- 172.21.15.103:0/2290147590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a700039b0 msgr2=0x7f9a70003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:42.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a87fff640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a700039b0 0x7f9a70003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.108+0000 7f9a87fff640 1 -- 172.21.15.103:0/2290147590 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a70003520 con 0x7f9a700051c0 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.109+0000 7f9a87fff640 1 -- 172.21.15.103:0/2290147590 reap_dead start 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.109+0000 7f9a87fff640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a7000b9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000c290 tx=0x7f9a70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8ddd9e6f6d8c9a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.109+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80007d30 con 0x7f9a700051c0 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.109+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a800058d0 con 0x7f9a700051c0 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.109+0000 7f9a867fc640 1 -- 172.21.15.103:0/2290147590 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80005ce0 con 0x7f9a700051c0 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.110+0000 7f9a8e08d640 1 -- 172.21.15.103:0/2290147590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 msgr2=0x7f9a7000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.110+0000 7f9a8e08d640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a7000b9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000c290 tx=0x7f9a70005830 comp rx=0 tx=0).stop 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.110+0000 7f9a8e08d640 1 -- 172.21.15.103:0/2290147590 shutdown_connections 2024-08-18T23:57:42.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.110+0000 7f9a8e08d640 1 --2- 172.21.15.103:0/2290147590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a7000b9c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.110+0000 7f9a8e08d640 1 -- 172.21.15.103:0/2290147590 >> 172.21.15.103:0/2290147590 conn(0x7f9a880cfc40 msgr2=0x7f9a880d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.110+0000 7f9a8e08d640 1 -- 172.21.15.103:0/2290147590 shutdown_connections 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.110+0000 7f9a8e08d640 1 -- 172.21.15.103:0/2290147590 wait complete. 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.111+0000 7f9a8e08d640 1 Processor -- start 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.111+0000 7f9a8e08d640 1 -- start start 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a8e08d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a88149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a8e08d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a88153fd0 0x7f9a88154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a8e08d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a880aec60 0x7f9a880af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a8e08d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9a880cf220 con 0x7f9a700051c0 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a8e08d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9a880cf0a0 con 0x7f9a880aec60 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a8e08d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9a880cf3a0 con 0x7f9a88153fd0 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a88149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a88149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39358/0 (socket says 172.21.15.103:39358) 2024-08-18T23:57:42.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 -- 172.21.15.103:0/3278012895 learned_addr learned my addr 172.21.15.103:0/3278012895 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a86ffd640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a88153fd0 0x7f9a88154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a87fff640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a880aec60 0x7f9a880af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 -- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a88153fd0 msgr2=0x7f9a88154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a88153fd0 0x7f9a88154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 -- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a880aec60 msgr2=0x7f9a880af0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a880aec60 0x7f9a880af0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 -- 172.21.15.103:0/3278012895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a880af620 con 0x7f9a700051c0 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a87fff640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a880aec60 0x7f9a880af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.112+0000 7f9a877fe640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a88149af0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9a78011e30 tx=0x7f9a7800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.113+0000 7f9a6ffff640 1 -- 172.21.15.103:0/3278012895 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78015630 con 0x7f9a700051c0 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.113+0000 7f9a6ffff640 1 -- 172.21.15.103:0/3278012895 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a780157d0 con 0x7f9a700051c0 2024-08-18T23:57:42.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.113+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8809be00 con 0x7f9a700051c0 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.113+0000 7f9a6ffff640 1 -- 172.21.15.103:0/3278012895 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78015bc0 con 0x7f9a700051c0 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.113+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8809c3c0 con 0x7f9a700051c0 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.114+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a88154990 con 0x7f9a700051c0 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.114+0000 7f9a6ffff640 1 -- 172.21.15.103:0/3278012895 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a7801d400 con 0x7f9a700051c0 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.115+0000 7f9a6ffff640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a7406be30 0x7f9a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.115+0000 7f9a86ffd640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a7406be30 0x7f9a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.115+0000 7f9a6ffff640 1 -- 172.21.15.103:0/3278012895 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f9a7808be20 con 0x7f9a700051c0 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.115+0000 7f9a86ffd640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a7406be30 0x7f9a7406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c000c00 tx=0x7f9a7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.119+0000 7f9a6ffff640 1 -- 172.21.15.103:0/3278012895 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9a78019030 con 0x7f9a700051c0 2024-08-18T23:57:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.349+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f9a880750a0 con 0x7f9a700051c0 2024-08-18T23:57:42.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.349+0000 7f9a6ffff640 1 -- 172.21.15.103:0/3278012895 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7f9a78010040 con 0x7f9a700051c0 2024-08-18T23:57:42.351 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:42.351 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:57:42.351 INFO:teuthology.orchestra.run.smithi103.stdout: "auth_dump": [ 2024-08-18T23:57:42.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.351 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.a", 2024-08-18T23:57:42.351 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAMisJmbxR6IhAAWzYaMaVb3mACjrCHwisFnA==", 2024-08-18T23:57:42.351 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.b", 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAMisJmtQ81LhAA+phuLrahZ68PDi/RlIUrwA==", 2024-08-18T23:57:42.352 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.353 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-08-18T23:57:42.353 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-08-18T23:57:42.353 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-08-18T23:57:42.353 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.353 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.353 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.c", 2024-08-18T23:57:42.354 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAMisJmvtOIKRAAkUJgPcoJLHEkQ9GLPtPyFQ==", 2024-08-18T23:57:42.354 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.354 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-08-18T23:57:42.354 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-08-18T23:57:42.354 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-08-18T23:57:42.355 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.355 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.355 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mds.d", 2024-08-18T23:57:42.356 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAMisJm2bZVNRAAuCGrIiOMhMCWKn90/joplQ==", 2024-08-18T23:57:42.356 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.356 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-08-18T23:57:42.356 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.0", 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAQisJmJwIlEhAAqnwaxX9h8Hem4LXIXfH/Ug==", 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-08-18T23:57:42.357 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.1", 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQATisJmjUhsEBAAHvQTYaQZwJJcpZX8FPYvWg==", 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.358 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.359 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.2", 2024-08-18T23:57:42.359 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAWisJm5tvjDhAAI+E3A5xbHKx6uslpuvwh+A==", 2024-08-18T23:57:42.359 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.359 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-08-18T23:57:42.359 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-08-18T23:57:42.359 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.3", 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAZisJm03+sDBAA9loaBbDipYGGC1FD6H8QhA==", 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.360 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.4", 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAfisJmus0CDxAAO/7I/hA5ShqV91vJsAuzDA==", 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.5", 2024-08-18T23:57:42.361 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAiisJm7IgLDhAA0KYeD6bay0CkNZDE3B/hkA==", 2024-08-18T23:57:42.362 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.362 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-08-18T23:57:42.362 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-08-18T23:57:42.362 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.362 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.6", 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAlisJmuMxQDBAAUHgybWTbKUHeW58ApBPqIw==", 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "osd.7", 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAoisJm8+wBDhAABaWUI5VlNpDCgVdXRAaALQ==", 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.363 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow profile osd", 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile osd", 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.0", 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAMisJm8shqORAAhfpG5RVY14+bkkc4GjljTQ==", 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.1", 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQANisJm0MKWBhAAXM0NgNzD0WSJ7v2Ykt6aBg==", 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.2", 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQANisJmJXxnAxAAEKU4VxzNDSnDs+WRxDuDiQ==", 2024-08-18T23:57:42.365 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.3", 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQANisJmlZceDBAAHsLZkEzrYCJVQRVBTCh2bw==", 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow", 2024-08-18T23:57:42.366 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow r", 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow rw", 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow rwx" 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.admin", 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAMisJmIPU0BhAADCkd0pSpwBi7dmZIirSofw==", 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr": "allow *", 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow *", 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-mds", 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAuisJmG8pGAhAAHDa5+O9ldDKyMd6/XwDaTw==", 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-mds" 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-mgr", 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAuisJmm9FGAhAAADffgM91iWTtLl+zZMEJpQ==", 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-18T23:57:42.368 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-osd", 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAuisJm39hGAhAAd/e72X7Dyn9Xrynnltn39w==", 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-osd" 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rbd", 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAuisJmP99GAhAAstHu8UKc0SnAi8RQ2x7FuQ==", 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAuisJm0+VGAhAAKxMRMoXZIR72iZkG0HeZeA==", 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "client.bootstrap-rgw", 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAuisJmwexGAhAAVvAK+z3raIVCu3AvgAdRjw==", 2024-08-18T23:57:42.370 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.x", 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAMisJmO+g9HxAAqwDIMFCJG/wcQQT+YJHlmg==", 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:42.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "entity": "mgr.y", 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "key": "AQAMisJmi0zvGhAAP6SHUwBw0WOeSABNoSKtLQ==", 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "caps": { 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "mds": "allow *", 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "mon": "allow profile mgr", 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: "osd": "allow *" 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-18T23:57:42.372 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a7406be30 msgr2=0x7f9a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a7406be30 0x7f9a7406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c000c00 tx=0x7f9a7c009040 comp rx=0 tx=0).stop 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 msgr2=0x7f9a88149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a88149af0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9a78011e30 tx=0x7f9a7800f580 comp rx=0 tx=0).stop 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 shutdown_connections 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a7406be30 0x7f9a7406e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a880aec60 0x7f9a880af0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9a88153fd0 0x7f9a88154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 --2- 172.21.15.103:0/3278012895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a700051c0 0x7f9a88149af0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 >> 172.21.15.103:0/3278012895 conn(0x7f9a880cfc40 msgr2=0x7f9a881536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:42.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 shutdown_connections 2024-08-18T23:57:42.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.351+0000 7f9a8e08d640 1 -- 172.21.15.103:0/3278012895 wait complete. 2024-08-18T23:57:42.375 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-18T23:57:42.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.473+0000 7f0858830640 1 Processor -- start 2024-08-18T23:57:42.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.473+0000 7f0858830640 1 -- start start 2024-08-18T23:57:42.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0858830640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f085415e310 0x7f08540d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0858830640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f08540b33b0 0x7f08540d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0858830640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08540d5020 con 0x7f08540b0d20 2024-08-18T23:57:42.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0858830640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f08540b31b0 con 0x7f085415e310 2024-08-18T23:57:42.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0858830640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f08540d4d40 con 0x7f08540b33b0 2024-08-18T23:57:42.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f085259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f085415e310 0x7f08540d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0852d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f08540b0d20 0x7f08540b11b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:39804/0 (socket says 172.21.15.103:39804) 2024-08-18T23:57:42.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f085259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f085415e310 0x7f08540d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39360/0 (socket says 172.21.15.103:39360) 2024-08-18T23:57:42.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0852d9d640 1 -- 172.21.15.103:0/1403692051 learned_addr learned my addr 172.21.15.103:0/1403692051 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:42.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0849d9b640 1 --2- 172.21.15.103:0/1403692051 >> v2:172.21.15.190:3300/0 conn(0x7f08540b33b0 0x7f08540d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f085259c640 1 -- 172.21.15.103:0/1403692051 >> v2:172.21.15.190:3300/0 conn(0x7f08540b33b0 msgr2=0x7f08540d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:42.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f085259c640 1 --2- 172.21.15.103:0/1403692051 >> v2:172.21.15.190:3300/0 conn(0x7f08540b33b0 0x7f08540d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f085259c640 1 -- 172.21.15.103:0/1403692051 >> v1:172.21.15.103:6789/0 conn(0x7f08540b0d20 legacy=0x7f08540b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f085259c640 1 -- 172.21.15.103:0/1403692051 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08540d27a0 con 0x7f085415e310 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0851d9b640 1 -- 172.21.15.103:0/1403692051 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438783330 0 0) 0x7f08540d5020 con 0x7f08540b0d20 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.474+0000 7f0849d9b640 1 --2- 172.21.15.103:0/1403692051 >> v2:172.21.15.190:3300/0 conn(0x7f08540b33b0 0x7f08540d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.475+0000 7f085259c640 1 --2- 172.21.15.103:0/1403692051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540d09f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f08540c7950 tx=0x7f084402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab66518ce77d0f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.475+0000 7f0851d9b640 1 -- 172.21.15.103:0/1403692051 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844037070 con 0x7f085415e310 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.475+0000 7f0851d9b640 1 -- 172.21.15.103:0/1403692051 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0844032440 con 0x7f085415e310 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.475+0000 7f0851d9b640 1 -- 172.21.15.103:0/1403692051 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084402ae60 con 0x7f085415e310 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.476+0000 7f0858830640 1 -- 172.21.15.103:0/1403692051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 msgr2=0x7f08540d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.476+0000 7f0858830640 1 --2- 172.21.15.103:0/1403692051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540d09f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f08540c7950 tx=0x7f084402a110 comp rx=0 tx=0).stop 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.476+0000 7f0858830640 1 -- 172.21.15.103:0/1403692051 shutdown_connections 2024-08-18T23:57:42.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.476+0000 7f0858830640 1 --2- 172.21.15.103:0/1403692051 >> v2:172.21.15.190:3300/0 conn(0x7f08540b33b0 0x7f08540d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.476+0000 7f0858830640 1 --2- 172.21.15.103:0/1403692051 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540d09f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.476+0000 7f0858830640 1 -- 172.21.15.103:0/1403692051 >> 172.21.15.103:0/1403692051 conn(0x7f08540d4120 msgr2=0x7f08540d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:42.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.476+0000 7f0858830640 1 -- 172.21.15.103:0/1403692051 shutdown_connections 2024-08-18T23:57:42.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.476+0000 7f0858830640 1 -- 172.21.15.103:0/1403692051 wait complete. 2024-08-18T23:57:42.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.477+0000 7f0858830640 1 Processor -- start 2024-08-18T23:57:42.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.477+0000 7f0858830640 1 -- start start 2024-08-18T23:57:42.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0858830640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08540b0d20 0x7f08540cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0858830640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08540b33b0 0x7f08541f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0858830640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0858830640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f08540b2e60 con 0x7f085415e310 2024-08-18T23:57:42.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0858830640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f085415e6f0 con 0x7f08540b33b0 2024-08-18T23:57:42.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0858830640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f08540d2fa0 con 0x7f08540b0d20 2024-08-18T23:57:42.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0852d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0852d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39374/0 (socket says 172.21.15.103:39374) 2024-08-18T23:57:42.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0852d9d640 1 -- 172.21.15.103:0/315258057 learned_addr learned my addr 172.21.15.103:0/315258057 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:42.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0849d9b640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08540b33b0 0x7f08541f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f085259c640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08540b0d20 0x7f08540cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0852d9d640 1 -- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08540b0d20 msgr2=0x7f08540cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0852d9d640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08540b0d20 0x7f08540cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0852d9d640 1 -- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08540b33b0 msgr2=0x7f08541f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0852d9d640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08540b33b0 0x7f08541f7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0852d9d640 1 -- 172.21.15.103:0/315258057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08541f7b90 con 0x7f085415e310 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.478+0000 7f0849d9b640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08540b33b0 0x7f08541f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.479+0000 7f0852d9d640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540cce40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c700 tx=0x7f084c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.479+0000 7f084b7fe640 1 -- 172.21.15.103:0/315258057 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c018070 con 0x7f085415e310 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.479+0000 7f084b7fe640 1 -- 172.21.15.103:0/315258057 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084c00ce10 con 0x7f085415e310 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.479+0000 7f084b7fe640 1 -- 172.21.15.103:0/315258057 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c00a860 con 0x7f085415e310 2024-08-18T23:57:42.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.479+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08541f7e70 con 0x7f085415e310 2024-08-18T23:57:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.479+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08540cd380 con 0x7f085415e310 2024-08-18T23:57:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.480+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08540d09f0 con 0x7f085415e310 2024-08-18T23:57:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.480+0000 7f084b7fe640 1 -- 172.21.15.103:0/315258057 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f084c01b070 con 0x7f085415e310 2024-08-18T23:57:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.481+0000 7f084b7fe640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f083406be30 0x7f083406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.481+0000 7f084b7fe640 1 -- 172.21.15.103:0/315258057 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f084c08a240 con 0x7f085415e310 2024-08-18T23:57:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.481+0000 7f085259c640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f083406be30 0x7f083406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.481+0000 7f085259c640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f083406be30 0x7f083406e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0844034000 tx=0x7f084402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.485+0000 7f084b7fe640 1 -- 172.21.15.103:0/315258057 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f084c058db0 con 0x7f085415e310 2024-08-18T23:57:42.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.715+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f08540b4020 con 0x7f085415e310 2024-08-18T23:57:42.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.718+0000 7f084b7fe640 1 -- 172.21.15.103:0/315258057 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f084c0586b0 con 0x7f085415e310 2024-08-18T23:57:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f083406be30 msgr2=0x7f083406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f083406be30 0x7f083406e2f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0844034000 tx=0x7f084402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 msgr2=0x7f08540cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540cce40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f084c00c700 tx=0x7f084c00cbc0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 shutdown_connections 2024-08-18T23:57:42.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f083406be30 0x7f083406e2f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f085415e310 0x7f08540cce40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f08540b33b0 0x7f08541f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 --2- 172.21.15.103:0/315258057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08540b0d20 0x7f08540cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.720+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 >> 172.21.15.103:0/315258057 conn(0x7f08540d4120 msgr2=0x7f085406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:42.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.721+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 shutdown_connections 2024-08-18T23:57:42.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.721+0000 7f0858830640 1 -- 172.21.15.103:0/315258057 wait complete. 2024-08-18T23:57:42.733 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-18T23:57:42.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.832+0000 7f667badf640 1 Processor -- start 2024-08-18T23:57:42.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.832+0000 7f667badf640 1 -- start start 2024-08-18T23:57:42.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667badf640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f667415ae70 0x7f667415f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667badf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 0x7f66740c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667badf640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66740c6170 0x7f667406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667badf640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f66740c65e0 con 0x7f66740c6170 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667badf640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f667415b250 con 0x7f667415ae70 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667badf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f66740721d0 con 0x7f667415ea60 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667a07c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66740c6170 0x7f667406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667a07c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66740c6170 0x7f667406b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39376/0 (socket says 172.21.15.103:39376) 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667a07c640 1 -- 172.21.15.103:0/1806227152 learned_addr learned my addr 172.21.15.103:0/1806227152 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667987b640 1 --2- 172.21.15.103:0/1806227152 >> v2:172.21.15.190:3300/0 conn(0x7f667415ae70 0x7f667415f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667a07c640 1 -- 172.21.15.103:0/1806227152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 msgr2=0x7f66740c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:42.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667907a640 1 --2- 172.21.15.103:0/1806227152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 0x7f66740c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667a07c640 1 --2- 172.21.15.103:0/1806227152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 0x7f66740c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667a07c640 1 -- 172.21.15.103:0/1806227152 >> v2:172.21.15.190:3300/0 conn(0x7f667415ae70 msgr2=0x7f667415f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:42.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667a07c640 1 --2- 172.21.15.103:0/1806227152 >> v2:172.21.15.190:3300/0 conn(0x7f667415ae70 0x7f667415f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.833+0000 7f667a07c640 1 -- 172.21.15.103:0/1806227152 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6674072450 con 0x7f66740c6170 2024-08-18T23:57:42.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.834+0000 7f667a07c640 1 --2- 172.21.15.103:0/1806227152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f667406b900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f66740d0bb0 tx=0x7f666c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c90f57acf863bb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.834+0000 7f6678879640 1 -- 172.21.15.103:0/1806227152 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c036070 con 0x7f66740c6170 2024-08-18T23:57:42.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.834+0000 7f6678879640 1 -- 172.21.15.103:0/1806227152 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f666c031600 con 0x7f66740c6170 2024-08-18T23:57:42.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.834+0000 7f6678879640 1 -- 172.21.15.103:0/1806227152 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666c0319d0 con 0x7f66740c6170 2024-08-18T23:57:42.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 -- 172.21.15.103:0/1806227152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 msgr2=0x7f667406b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 --2- 172.21.15.103:0/1806227152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f667406b900 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f66740d0bb0 tx=0x7f666c02a610 comp rx=0 tx=0).stop 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 -- 172.21.15.103:0/1806227152 shutdown_connections 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 --2- 172.21.15.103:0/1806227152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f667406b900 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 --2- 172.21.15.103:0/1806227152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 0x7f66740c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 --2- 172.21.15.103:0/1806227152 >> v2:172.21.15.190:3300/0 conn(0x7f667415ae70 0x7f667415f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 -- 172.21.15.103:0/1806227152 >> 172.21.15.103:0/1806227152 conn(0x7f66740cc6e0 msgr2=0x7f66740ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 -- 172.21.15.103:0/1806227152 shutdown_connections 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.835+0000 7f667badf640 1 -- 172.21.15.103:0/1806227152 wait complete. 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.836+0000 7f667badf640 1 Processor -- start 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.836+0000 7f667badf640 1 -- start start 2024-08-18T23:57:42.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667badf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f6674145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667badf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667415ae70 0x7f66740c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667badf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 0x7f66740c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667badf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6674072cf0 con 0x7f66740c6170 2024-08-18T23:57:42.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667badf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6674072a10 con 0x7f667415ae70 2024-08-18T23:57:42.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667badf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6674072fd0 con 0x7f667415ea60 2024-08-18T23:57:42.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f6674145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f6674145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39382/0 (socket says 172.21.15.103:39382) 2024-08-18T23:57:42.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 -- 172.21.15.103:0/1215266893 learned_addr learned my addr 172.21.15.103:0/1215266893 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:42.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 -- 172.21.15.103:0/1215266893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 msgr2=0x7f66740c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 0x7f66740c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 -- 172.21.15.103:0/1215266893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667415ae70 msgr2=0x7f66740c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:42.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667415ae70 0x7f66740c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:42.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 -- 172.21.15.103:0/1215266893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66740acd70 con 0x7f66740c6170 2024-08-18T23:57:42.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667987b640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f6674145df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f667000c7f0 tx=0x7f667000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f666a7fc640 1 -- 172.21.15.103:0/1215266893 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6670015070 con 0x7f66740c6170 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f666a7fc640 1 -- 172.21.15.103:0/1215266893 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6670004220 con 0x7f66740c6170 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66740ad010 con 0x7f66740c6170 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f666a7fc640 1 -- 172.21.15.103:0/1215266893 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6670007620 con 0x7f66740c6170 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.837+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66740ad5d0 con 0x7f66740c6170 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.838+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66740734f0 con 0x7f66740c6170 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.839+0000 7f666a7fc640 1 -- 172.21.15.103:0/1215266893 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66700079d0 con 0x7f66740c6170 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.839+0000 7f666a7fc640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f665806be30 0x7f665806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:42.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.839+0000 7f666a7fc640 1 -- 172.21.15.103:0/1215266893 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f667008ad60 con 0x7f66740c6170 2024-08-18T23:57:42.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.839+0000 7f667907a640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f665806be30 0x7f665806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:42.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.840+0000 7f667907a640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f665806be30 0x7f665806e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66741548a0 tx=0x7f6664008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:42.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:42.843+0000 7f666a7fc640 1 -- 172.21.15.103:0/1215266893 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6670059840 con 0x7f66740c6170 2024-08-18T23:57:43.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.077+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f66740af220 con 0x7f66740c6170 2024-08-18T23:57:43.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.079+0000 7f666a7fc640 1 -- 172.21.15.103:0/1215266893 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f6670059140 con 0x7f66740c6170 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f665806be30 msgr2=0x7f665806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f665806be30 0x7f665806e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f66741548a0 tx=0x7f6664008040 comp rx=0 tx=0).stop 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 msgr2=0x7f6674145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f6674145df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f667000c7f0 tx=0x7f667000ccb0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 shutdown_connections 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f665806be30 0x7f665806e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667415ea60 0x7f66740c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667415ae70 0x7f66740c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 --2- 172.21.15.103:0/1215266893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66740c6170 0x7f6674145df0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 >> 172.21.15.103:0/1215266893 conn(0x7f66740cc6e0 msgr2=0x7f6674158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:43.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 shutdown_connections 2024-08-18T23:57:43.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.081+0000 7f667badf640 1 -- 172.21.15.103:0/1215266893 wait complete. 2024-08-18T23:57:43.094 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-18T23:57:43.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.192+0000 7fe308017640 1 Processor -- start 2024-08-18T23:57:43.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.193+0000 7fe308017640 1 -- start start 2024-08-18T23:57:43.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.193+0000 7fe308017640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe30015ae70 0x7fe30015f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.193+0000 7fe308017640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 0x7fe3000ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe308017640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3000721d0 con 0x7fe30015ea60 2024-08-18T23:57:43.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe308017640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe30015b250 con 0x7fe30015ae70 2024-08-18T23:57:43.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe308017640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe300072450 con 0x7fe3000c6340 2024-08-18T23:57:43.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe305db3640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe30015ae70 0x7fe30015f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe305db3640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe30015ae70 0x7fe30015f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36744/0 (socket says 172.21.15.103:36744) 2024-08-18T23:57:43.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe3055b2640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe30015ea60 0x7fe3000c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42144/0 (socket says 172.21.15.103:42144) 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe305db3640 1 -- 172.21.15.103:0/2277173620 learned_addr learned my addr 172.21.15.103:0/2277173620 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe305db3640 1 -- 172.21.15.103:0/2277173620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 msgr2=0x7fe3000ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe305db3640 1 --2- 172.21.15.103:0/2277173620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 0x7fe3000ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe305db3640 1 -- 172.21.15.103:0/2277173620 >> v1:172.21.15.103:6789/0 conn(0x7fe30015ea60 legacy=0x7fe3000c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe305db3640 1 -- 172.21.15.103:0/2277173620 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe300072730 con 0x7fe30015ae70 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.194+0000 7fe304db1640 1 -- 172.21.15.103:0/2277173620 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908321434 0 0) 0x7fe2f0001110 con 0x7fe30015ea60 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.195+0000 7fe305db3640 1 --2- 172.21.15.103:0/2277173620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ae70 0x7fe30015f2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00bb10 tx=0x7fe2fc02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed417c5a1793c584 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.195+0000 7fe304db1640 1 -- 172.21.15.103:0/2277173620 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc032790 con 0x7fe30015ae70 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.195+0000 7fe304db1640 1 -- 172.21.15.103:0/2277173620 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc038070 con 0x7fe30015ae70 2024-08-18T23:57:43.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.195+0000 7fe304db1640 1 -- 172.21.15.103:0/2277173620 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc032b50 con 0x7fe30015ae70 2024-08-18T23:57:43.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.196+0000 7fe308017640 1 -- 172.21.15.103:0/2277173620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ae70 msgr2=0x7fe30015f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.196+0000 7fe308017640 1 --2- 172.21.15.103:0/2277173620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ae70 0x7fe30015f2a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00bb10 tx=0x7fe2fc02c890 comp rx=0 tx=0).stop 2024-08-18T23:57:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.196+0000 7fe308017640 1 -- 172.21.15.103:0/2277173620 shutdown_connections 2024-08-18T23:57:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.196+0000 7fe308017640 1 --2- 172.21.15.103:0/2277173620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 0x7fe3000ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.196+0000 7fe308017640 1 --2- 172.21.15.103:0/2277173620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ae70 0x7fe30015f2a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.196+0000 7fe308017640 1 -- 172.21.15.103:0/2277173620 >> 172.21.15.103:0/2277173620 conn(0x7fe3000cc6e0 msgr2=0x7fe3000ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.196+0000 7fe308017640 1 -- 172.21.15.103:0/2277173620 shutdown_connections 2024-08-18T23:57:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.196+0000 7fe308017640 1 -- 172.21.15.103:0/2277173620 wait complete. 2024-08-18T23:57:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.197+0000 7fe308017640 1 Processor -- start 2024-08-18T23:57:43.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.197+0000 7fe308017640 1 -- start start 2024-08-18T23:57:43.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe308017640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 0x7fe3000ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe308017640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe30015ae70 0x7fe3001492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe308017640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ea60 0x7fe3000af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe308017640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe300072fd0 con 0x7fe30015ea60 2024-08-18T23:57:43.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe308017640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe300072cf0 con 0x7fe30015ae70 2024-08-18T23:57:43.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe308017640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe3000734f0 con 0x7fe3000c6340 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ea60 0x7fe3000af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ea60 0x7fe3000af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36760/0 (socket says 172.21.15.103:36760) 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 -- 172.21.15.103:0/1945401481 learned_addr learned my addr 172.21.15.103:0/1945401481 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3055b2640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe30015ae70 0x7fe3001492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe305db3640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 0x7fe3000ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 -- 172.21.15.103:0/1945401481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 msgr2=0x7fe3000ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 0x7fe3000ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 -- 172.21.15.103:0/1945401481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe30015ae70 msgr2=0x7fe3001492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe30015ae70 0x7fe3001492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 -- 172.21.15.103:0/1945401481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3000b1340 con 0x7fe30015ea60 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe3065b4640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ea60 0x7fe3000af720 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800b970 tx=0x7fe2f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.198+0000 7fe2f67fc640 1 -- 172.21.15.103:0/1945401481 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8019070 con 0x7fe30015ea60 2024-08-18T23:57:43.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.199+0000 7fe2f67fc640 1 -- 172.21.15.103:0/1945401481 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f800cb00 con 0x7fe30015ea60 2024-08-18T23:57:43.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.199+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3000b1620 con 0x7fe30015ea60 2024-08-18T23:57:43.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.199+0000 7fe2f67fc640 1 -- 172.21.15.103:0/1945401481 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8014440 con 0x7fe30015ea60 2024-08-18T23:57:43.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.199+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3000b1be0 con 0x7fe30015ea60 2024-08-18T23:57:43.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.200+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30015f2a0 con 0x7fe30015ea60 2024-08-18T23:57:43.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.200+0000 7fe2f67fc640 1 -- 172.21.15.103:0/1945401481 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe2f801c070 con 0x7fe30015ea60 2024-08-18T23:57:43.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.201+0000 7fe2f67fc640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe2e406be30 0x7fe2e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.201+0000 7fe305db3640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe2e406be30 0x7fe2e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.201+0000 7fe2f67fc640 1 -- 172.21.15.103:0/1945401481 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fe2f808a9e0 con 0x7fe30015ea60 2024-08-18T23:57:43.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.201+0000 7fe305db3640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe2e406be30 0x7fe2e406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc037000 tx=0x7fe2fc03e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.205+0000 7fe2f67fc640 1 -- 172.21.15.103:0/1945401481 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe2f80594f0 con 0x7fe30015ea60 2024-08-18T23:57:43.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.438+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fe3000af500 con 0x7fe30015ea60 2024-08-18T23:57:43.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.439+0000 7fe2f67fc640 1 -- 172.21.15.103:0/1945401481 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fe2f8058df0 con 0x7fe30015ea60 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe2e406be30 msgr2=0x7fe2e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe2e406be30 0x7fe2e406e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc037000 tx=0x7fe2fc03e040 comp rx=0 tx=0).stop 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ea60 msgr2=0x7fe3000af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ea60 0x7fe3000af720 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800b970 tx=0x7fe2f800be30 comp rx=0 tx=0).stop 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 shutdown_connections 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe2e406be30 0x7fe2e406e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30015ea60 0x7fe3000af720 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe30015ae70 0x7fe3001492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 --2- 172.21.15.103:0/1945401481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3000c6340 0x7fe3000ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 >> 172.21.15.103:0/1945401481 conn(0x7fe3000cc6e0 msgr2=0x7fe3000ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 shutdown_connections 2024-08-18T23:57:43.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.441+0000 7fe308017640 1 -- 172.21.15.103:0/1945401481 wait complete. 2024-08-18T23:57:43.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-18T23:57:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.557+0000 7ff4a2ff1640 1 Processor -- start 2024-08-18T23:57:43.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.557+0000 7ff4a2ff1640 1 -- start start 2024-08-18T23:57:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.557+0000 7ff4a2ff1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c15be10 0x7ff49c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.557+0000 7ff4a2ff1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff49c0cd7b0 0x7ff49c0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.557+0000 7ff4a2ff1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49c0b4380 con 0x7ff49c0d1070 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.557+0000 7ff4a2ff1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff49c0b4f90 con 0x7ff49c0cd7b0 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.557+0000 7ff4a2ff1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff49c0b4660 con 0x7ff49c15be10 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff49bfff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff49c0cd7b0 0x7ff49c0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff4a158e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7ff49c0d1070 0x7ff49c06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42160/0 (socket says 172.21.15.103:42160) 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff4a158e640 1 -- 172.21.15.103:0/3639509958 learned_addr learned my addr 172.21.15.103:0/3639509958 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff4a0d8d640 1 --2- 172.21.15.103:0/3639509958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c15be10 0x7ff49c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff49bfff640 1 -- 172.21.15.103:0/3639509958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c15be10 msgr2=0x7ff49c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff49bfff640 1 --2- 172.21.15.103:0/3639509958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c15be10 0x7ff49c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff49bfff640 1 -- 172.21.15.103:0/3639509958 >> v1:172.21.15.103:6789/0 conn(0x7ff49c0d1070 legacy=0x7ff49c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff49bfff640 1 -- 172.21.15.103:0/3639509958 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c0b4940 con 0x7ff49c0cd7b0 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.558+0000 7ff49b7fe640 1 -- 172.21.15.103:0/3639509958 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777842995 0 0) 0x7ff49c0b4380 con 0x7ff49c0d1070 2024-08-18T23:57:43.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.559+0000 7ff49bfff640 1 --2- 172.21.15.103:0/3639509958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c0cd7b0 0x7ff49c0b0340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097a0 tx=0x7ff48802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e887e172bfada44 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.559+0000 7ff49b7fe640 1 -- 172.21.15.103:0/3639509958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488037070 con 0x7ff49c0cd7b0 2024-08-18T23:57:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.559+0000 7ff49b7fe640 1 -- 172.21.15.103:0/3639509958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48802ae50 con 0x7ff49c0cd7b0 2024-08-18T23:57:43.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.559+0000 7ff49b7fe640 1 -- 172.21.15.103:0/3639509958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488032660 con 0x7ff49c0cd7b0 2024-08-18T23:57:43.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.559+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/3639509958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c0cd7b0 msgr2=0x7ff49c0b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.559+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/3639509958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c0cd7b0 0x7ff49c0b0340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097a0 tx=0x7ff48802a100 comp rx=0 tx=0).stop 2024-08-18T23:57:43.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.560+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/3639509958 shutdown_connections 2024-08-18T23:57:43.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.560+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/3639509958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c0cd7b0 0x7ff49c0b0340 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.560+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/3639509958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c15be10 0x7ff49c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.560+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/3639509958 >> 172.21.15.103:0/3639509958 conn(0x7ff49c0b2c80 msgr2=0x7ff49c0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:43.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.560+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/3639509958 shutdown_connections 2024-08-18T23:57:43.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.560+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/3639509958 wait complete. 2024-08-18T23:57:43.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.561+0000 7ff4a2ff1640 1 Processor -- start 2024-08-18T23:57:43.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.561+0000 7ff4a2ff1640 1 -- start start 2024-08-18T23:57:43.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a2ff1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c0cd7b0 0x7ff49c0afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a2ff1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff49c0d1070 0x7ff49c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a2ff1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c15be10 0x7ff49c1e7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a2ff1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c0d1520 con 0x7ff49c15be10 2024-08-18T23:57:43.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a2ff1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c15c1f0 con 0x7ff49c0d1070 2024-08-18T23:57:43.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a2ff1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff49c0d16a0 con 0x7ff49c0cd7b0 2024-08-18T23:57:43.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c15be10 0x7ff49c1e7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c15be10 0x7ff49c1e7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36786/0 (socket says 172.21.15.103:36786) 2024-08-18T23:57:43.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 -- 172.21.15.103:0/2141686344 learned_addr learned my addr 172.21.15.103:0/2141686344 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:43.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a0d8d640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c0cd7b0 0x7ff49c0afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff49bfff640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff49c0d1070 0x7ff49c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 -- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c0cd7b0 msgr2=0x7ff49c0afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c0cd7b0 0x7ff49c0afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 -- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff49c0d1070 msgr2=0x7ff49c14b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff49c0d1070 0x7ff49c14b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 -- 172.21.15.103:0/2141686344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c15a040 con 0x7ff49c15be10 2024-08-18T23:57:43.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff49bfff640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff49c0d1070 0x7ff49c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:43.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a158e640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c15be10 0x7ff49c1e7480 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff49400c7a0 tx=0x7ff49400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4997fa640 1 -- 172.21.15.103:0/2141686344 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494018070 con 0x7ff49c15be10 2024-08-18T23:57:43.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4997fa640 1 -- 172.21.15.103:0/2141686344 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49400a640 con 0x7ff49c15be10 2024-08-18T23:57:43.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49c09df60 con 0x7ff49c15be10 2024-08-18T23:57:43.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.562+0000 7ff4997fa640 1 -- 172.21.15.103:0/2141686344 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49400aab0 con 0x7ff49c15be10 2024-08-18T23:57:43.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.563+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49c09af80 con 0x7ff49c15be10 2024-08-18T23:57:43.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.564+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff49c0b3da0 con 0x7ff49c15be10 2024-08-18T23:57:43.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.564+0000 7ff4997fa640 1 -- 172.21.15.103:0/2141686344 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff49401b070 con 0x7ff49c15be10 2024-08-18T23:57:43.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.565+0000 7ff4997fa640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff48006be30 0x7ff48006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.565+0000 7ff4a0d8d640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff48006be30 0x7ff48006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.565+0000 7ff4997fa640 1 -- 172.21.15.103:0/2141686344 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7ff49408a1f0 con 0x7ff49c15be10 2024-08-18T23:57:43.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.565+0000 7ff4a0d8d640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff48006be30 0x7ff48006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff490009aa0 tx=0x7ff490009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.569+0000 7ff4997fa640 1 -- 172.21.15.103:0/2141686344 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7ff494058710 con 0x7ff49c15be10 2024-08-18T23:57:43.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.832+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff49c0ced70 con 0x7ff49c15be10 2024-08-18T23:57:43.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.834+0000 7ff4997fa640 1 -- 172.21.15.103:0/2141686344 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7ff49405ca10 con 0x7ff49c15be10 2024-08-18T23:57:43.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff48006be30 msgr2=0x7ff48006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff48006be30 0x7ff48006e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff490009aa0 tx=0x7ff490009190 comp rx=0 tx=0).stop 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c15be10 msgr2=0x7ff49c1e7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c15be10 0x7ff49c1e7480 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff49400c7a0 tx=0x7ff49400cc60 comp rx=0 tx=0).stop 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 shutdown_connections 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff48006be30 0x7ff48006e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff49c15be10 0x7ff49c1e7480 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff49c0d1070 0x7ff49c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 --2- 172.21.15.103:0/2141686344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff49c0cd7b0 0x7ff49c0afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 >> 172.21.15.103:0/2141686344 conn(0x7ff49c0b2c80 msgr2=0x7ff49c0ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 shutdown_connections 2024-08-18T23:57:43.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.836+0000 7ff4a2ff1640 1 -- 172.21.15.103:0/2141686344 wait complete. 2024-08-18T23:57:43.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-18T23:57:43.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.949+0000 7fbf968d2640 1 Processor -- start 2024-08-18T23:57:43.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf968d2640 1 -- start start 2024-08-18T23:57:43.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf968d2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf9015f5c0 0x7fbf900ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf968d2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbf900c6d00 0x7fbf900cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf968d2640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf900cdd60 con 0x7fbf900ceb90 2024-08-18T23:57:43.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf968d2640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbf900d29e0 con 0x7fbf9015f5c0 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf968d2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbf900d2cc0 con 0x7fbf900c6d00 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf8ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf9015f5c0 0x7fbf900ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf8f7fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbf900ceb90 0x7fbf900cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42162/0 (socket says 172.21.15.103:42162) 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf8ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbf9015f5c0 0x7fbf900ce650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36792/0 (socket says 172.21.15.103:36792) 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.950+0000 7fbf8f7fe640 1 -- 172.21.15.103:0/2286604857 learned_addr learned my addr 172.21.15.103:0/2286604857 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.951+0000 7fbf94e6f640 1 --2- 172.21.15.103:0/2286604857 >> v2:172.21.15.190:3300/0 conn(0x7fbf900c6d00 0x7fbf900cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.951+0000 7fbf8ffff640 1 -- 172.21.15.103:0/2286604857 >> v2:172.21.15.190:3300/0 conn(0x7fbf900c6d00 msgr2=0x7fbf900cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.951+0000 7fbf8ffff640 1 --2- 172.21.15.103:0/2286604857 >> v2:172.21.15.190:3300/0 conn(0x7fbf900c6d00 0x7fbf900cefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.951+0000 7fbf8ffff640 1 -- 172.21.15.103:0/2286604857 >> v1:172.21.15.103:6789/0 conn(0x7fbf900ceb90 legacy=0x7fbf900cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.951+0000 7fbf8ffff640 1 -- 172.21.15.103:0/2286604857 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf900cd4c0 con 0x7fbf9015f5c0 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.951+0000 7fbf8effd640 1 -- 172.21.15.103:0/2286604857 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3112274930 0 0) 0x7fbf900cdd60 con 0x7fbf900ceb90 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.951+0000 7fbf94e6f640 1 --2- 172.21.15.103:0/2286604857 >> v2:172.21.15.190:3300/0 conn(0x7fbf900c6d00 0x7fbf900cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:43.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.952+0000 7fbf8ffff640 1 --2- 172.21.15.103:0/2286604857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf9015f5c0 0x7fbf900ce650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbf90072f30 tx=0x7fbf8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a63665e3e24565 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf8effd640 1 -- 172.21.15.103:0/2286604857 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80037070 con 0x7fbf9015f5c0 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf8effd640 1 -- 172.21.15.103:0/2286604857 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf80032440 con 0x7fbf9015f5c0 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf8effd640 1 -- 172.21.15.103:0/2286604857 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80032810 con 0x7fbf9015f5c0 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf968d2640 1 -- 172.21.15.103:0/2286604857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf9015f5c0 msgr2=0x7fbf900ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2286604857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf9015f5c0 0x7fbf900ce650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbf90072f30 tx=0x7fbf8002a1a0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf968d2640 1 -- 172.21.15.103:0/2286604857 shutdown_connections 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2286604857 >> v2:172.21.15.190:3300/0 conn(0x7fbf900c6d00 0x7fbf900cefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2286604857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf9015f5c0 0x7fbf900ce650 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf968d2640 1 -- 172.21.15.103:0/2286604857 >> 172.21.15.103:0/2286604857 conn(0x7fbf900d1ec0 msgr2=0x7fbf900d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf968d2640 1 -- 172.21.15.103:0/2286604857 shutdown_connections 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.954+0000 7fbf968d2640 1 -- 172.21.15.103:0/2286604857 wait complete. 2024-08-18T23:57:43.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.956+0000 7fbf968d2640 1 Processor -- start 2024-08-18T23:57:43.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.956+0000 7fbf968d2640 1 -- start start 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.956+0000 7fbf968d2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf900c6d00 0x7fbf900b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.956+0000 7fbf968d2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900ceb90 0x7fbf901f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.956+0000 7fbf968d2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf9015f5c0 0x7fbf90157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.956+0000 7fbf968d2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9015f9a0 con 0x7fbf900ceb90 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.956+0000 7fbf968d2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbf900cda80 con 0x7fbf900c6d00 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.956+0000 7fbf968d2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9015fb20 con 0x7fbf9015f5c0 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900ceb90 0x7fbf901f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900ceb90 0x7fbf901f1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36804/0 (socket says 172.21.15.103:36804) 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 -- 172.21.15.103:0/2946633287 learned_addr learned my addr 172.21.15.103:0/2946633287 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf94e6f640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf9015f5c0 0x7fbf90157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8ffff640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf900c6d00 0x7fbf900b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 -- 172.21.15.103:0/2946633287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf9015f5c0 msgr2=0x7fbf90157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf9015f5c0 0x7fbf90157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 -- 172.21.15.103:0/2946633287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf900c6d00 msgr2=0x7fbf900b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf900c6d00 0x7fbf900b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 -- 172.21.15.103:0/2946633287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf900b7550 con 0x7fbf900ceb90 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8f7fe640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900ceb90 0x7fbf901f1180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c4d0 tx=0x7fbf7800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8cff9640 1 -- 172.21.15.103:0/2946633287 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf78018070 con 0x7fbf900ceb90 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8cff9640 1 -- 172.21.15.103:0/2946633287 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf78007500 con 0x7fbf900ceb90 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf900b7830 con 0x7fbf900ceb90 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf8cff9640 1 -- 172.21.15.103:0/2946633287 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf78004a20 con 0x7fbf900ceb90 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.957+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf900b7120 con 0x7fbf900ceb90 2024-08-18T23:57:43.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.958+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf900ce650 con 0x7fbf900ceb90 2024-08-18T23:57:43.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.959+0000 7fbf8cff9640 1 -- 172.21.15.103:0/2946633287 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf7801b070 con 0x7fbf900ceb90 2024-08-18T23:57:43.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.959+0000 7fbf8cff9640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbf7006be30 0x7fbf7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:43.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.959+0000 7fbf8cff9640 1 -- 172.21.15.103:0/2946633287 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fbf78089ee0 con 0x7fbf900ceb90 2024-08-18T23:57:43.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.959+0000 7fbf8ffff640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbf7006be30 0x7fbf7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:43.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.960+0000 7fbf8ffff640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbf7006be30 0x7fbf7006e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf80034000 tx=0x7fbf8002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:43.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:43.967+0000 7fbf8cff9640 1 -- 172.21.15.103:0/2946633287 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbf78058490 con 0x7fbf900ceb90 2024-08-18T23:57:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.206+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fbf900b4360 con 0x7fbf900ceb90 2024-08-18T23:57:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.208+0000 7fbf8cff9640 1 -- 172.21.15.103:0/2946633287 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7fbf7805c790 con 0x7fbf900ceb90 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbf7006be30 msgr2=0x7fbf7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbf7006be30 0x7fbf7006e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbf80034000 tx=0x7fbf8002e000 comp rx=0 tx=0).stop 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900ceb90 msgr2=0x7fbf901f1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900ceb90 0x7fbf901f1180 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c4d0 tx=0x7fbf7800c990 comp rx=0 tx=0).stop 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 shutdown_connections 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbf7006be30 0x7fbf7006e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbf9015f5c0 0x7fbf90157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf900ceb90 0x7fbf901f1180 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 --2- 172.21.15.103:0/2946633287 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbf900c6d00 0x7fbf900b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 >> 172.21.15.103:0/2946633287 conn(0x7fbf900d1ec0 msgr2=0x7fbf90070470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 shutdown_connections 2024-08-18T23:57:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.210+0000 7fbf968d2640 1 -- 172.21.15.103:0/2946633287 wait complete. 2024-08-18T23:57:44.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-18T23:57:44.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.322+0000 7f278b44e640 1 Processor -- start 2024-08-18T23:57:44.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.322+0000 7f278b44e640 1 -- start start 2024-08-18T23:57:44.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.322+0000 7f278b44e640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f278415e3b0 0x7f27840d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.322+0000 7f278b44e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27840d21b0 0x7f27840d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.322+0000 7f278b44e640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27840d4e10 con 0x7f27840b3000 2024-08-18T23:57:44.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.322+0000 7f278b44e640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f27840d4bc0 con 0x7f278415e3b0 2024-08-18T23:57:44.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.322+0000 7f278b44e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f27840cf960 con 0x7f27840d21b0 2024-08-18T23:57:44.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.322+0000 7f27891ea640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f278415e3b0 0x7f27840d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.323+0000 7f27899eb640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f27840b3000 0x7f27840d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42176/0 (socket says 172.21.15.103:42176) 2024-08-18T23:57:44.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.323+0000 7f27899eb640 1 -- 172.21.15.103:0/1344193986 learned_addr learned my addr 172.21.15.103:0/1344193986 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:44.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.323+0000 7f27889e9640 1 --2- 172.21.15.103:0/1344193986 >> v2:172.21.15.190:3300/0 conn(0x7f27840d21b0 0x7f27840d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.323+0000 7f27891ea640 1 -- 172.21.15.103:0/1344193986 >> v2:172.21.15.190:3300/0 conn(0x7f27840d21b0 msgr2=0x7f27840d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:44.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.323+0000 7f27891ea640 1 --2- 172.21.15.103:0/1344193986 >> v2:172.21.15.190:3300/0 conn(0x7f27840d21b0 0x7f27840d2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.323+0000 7f27891ea640 1 -- 172.21.15.103:0/1344193986 >> v1:172.21.15.103:6789/0 conn(0x7f27840b3000 legacy=0x7f27840d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.323+0000 7f2783fff640 1 -- 172.21.15.103:0/1344193986 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682947799 0 0) 0x7f27840d4e10 con 0x7f27840b3000 2024-08-18T23:57:44.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.323+0000 7f27891ea640 1 -- 172.21.15.103:0/1344193986 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27840cfbb0 con 0x7f278415e3b0 2024-08-18T23:57:44.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f27891ea640 1 --2- 172.21.15.103:0/1344193986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840d2700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f278408e870 tx=0x7f277c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47d178e4f39d315 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f2783fff640 1 -- 172.21.15.103:0/1344193986 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c037070 con 0x7f278415e3b0 2024-08-18T23:57:44.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f2783fff640 1 -- 172.21.15.103:0/1344193986 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c032440 con 0x7f278415e3b0 2024-08-18T23:57:44.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f2783fff640 1 -- 172.21.15.103:0/1344193986 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c032810 con 0x7f278415e3b0 2024-08-18T23:57:44.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f278b44e640 1 -- 172.21.15.103:0/1344193986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 msgr2=0x7f27840d2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f278b44e640 1 --2- 172.21.15.103:0/1344193986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840d2700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f278408e870 tx=0x7f277c02a1a0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f278b44e640 1 -- 172.21.15.103:0/1344193986 shutdown_connections 2024-08-18T23:57:44.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f278b44e640 1 --2- 172.21.15.103:0/1344193986 >> v2:172.21.15.190:3300/0 conn(0x7f27840d21b0 0x7f27840d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f278b44e640 1 --2- 172.21.15.103:0/1344193986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840d2700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.324+0000 7f278b44e640 1 -- 172.21.15.103:0/1344193986 >> 172.21.15.103:0/1344193986 conn(0x7f27840d40a0 msgr2=0x7f27840d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:44.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.325+0000 7f278b44e640 1 -- 172.21.15.103:0/1344193986 shutdown_connections 2024-08-18T23:57:44.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.325+0000 7f278b44e640 1 -- 172.21.15.103:0/1344193986 wait complete. 2024-08-18T23:57:44.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.326+0000 7f278b44e640 1 Processor -- start 2024-08-18T23:57:44.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.326+0000 7f278b44e640 1 -- start start 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f278b44e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27840b3000 0x7f2784159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f278b44e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27840d21b0 0x7f27840b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f278b44e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f278b44e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f278415e790 con 0x7f278415e3b0 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f278b44e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f27840d0200 con 0x7f27840d21b0 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f278b44e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f278415e910 con 0x7f27840b3000 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36832/0 (socket says 172.21.15.103:36832) 2024-08-18T23:57:44.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 -- 172.21.15.103:0/2900228315 learned_addr learned my addr 172.21.15.103:0/2900228315 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27889e9640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27840d21b0 0x7f27840b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27891ea640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27840b3000 0x7f2784159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 -- 172.21.15.103:0/2900228315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27840b3000 msgr2=0x7f2784159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27840b3000 0x7f2784159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 -- 172.21.15.103:0/2900228315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27840d21b0 msgr2=0x7f27840b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27840d21b0 0x7f27840b97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 -- 172.21.15.103:0/2900228315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27840cbdd0 con 0x7f278415e3b0 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.327+0000 7f27899eb640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840cd1c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7d0 tx=0x7f277400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.328+0000 7f2781ffb640 1 -- 172.21.15.103:0/2900228315 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774018070 con 0x7f278415e3b0 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.328+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27840cc0b0 con 0x7f278415e3b0 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.328+0000 7f2781ffb640 1 -- 172.21.15.103:0/2900228315 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277400a640 con 0x7f278415e3b0 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.328+0000 7f2781ffb640 1 -- 172.21.15.103:0/2900228315 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277400aa70 con 0x7f278415e3b0 2024-08-18T23:57:44.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.328+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2784159ad0 con 0x7f278415e3b0 2024-08-18T23:57:44.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.329+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27840d2700 con 0x7f278415e3b0 2024-08-18T23:57:44.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.329+0000 7f2781ffb640 1 -- 172.21.15.103:0/2900228315 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f277400ac10 con 0x7f278415e3b0 2024-08-18T23:57:44.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.330+0000 7f2781ffb640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f277006be30 0x7f277006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.330+0000 7f2781ffb640 1 -- 172.21.15.103:0/2900228315 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f277408a250 con 0x7f278415e3b0 2024-08-18T23:57:44.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.330+0000 7f27891ea640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f277006be30 0x7f277006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.330+0000 7f27891ea640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f277006be30 0x7f277006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f277c034000 tx=0x7f277c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.338+0000 7f2781ffb640 1 -- 172.21.15.103:0/2900228315 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2774058780 con 0x7f278415e3b0 2024-08-18T23:57:44.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.567+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f2784068df0 con 0x7f278415e3b0 2024-08-18T23:57:44.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.569+0000 7f2781ffb640 1 -- 172.21.15.103:0/2900228315 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f277405ca80 con 0x7f278415e3b0 2024-08-18T23:57:44.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f277006be30 msgr2=0x7f277006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f277006be30 0x7f277006e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f277c034000 tx=0x7f277c02e000 comp rx=0 tx=0).stop 2024-08-18T23:57:44.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 msgr2=0x7f27840cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840cd1c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f277400c7d0 tx=0x7f277400cc90 comp rx=0 tx=0).stop 2024-08-18T23:57:44.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 shutdown_connections 2024-08-18T23:57:44.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f277006be30 0x7f277006e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f278415e3b0 0x7f27840cd1c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27840d21b0 0x7f27840b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 --2- 172.21.15.103:0/2900228315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27840b3000 0x7f2784159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 >> 172.21.15.103:0/2900228315 conn(0x7f27840d40a0 msgr2=0x7f27840ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:44.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 shutdown_connections 2024-08-18T23:57:44.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.571+0000 7f278b44e640 1 -- 172.21.15.103:0/2900228315 wait complete. 2024-08-18T23:57:44.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-18T23:57:44.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.681+0000 7fb0cf3e1640 1 Processor -- start 2024-08-18T23:57:44.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.682+0000 7fb0cf3e1640 1 -- start start 2024-08-18T23:57:44.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cf3e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c80d4bc0 0x7fb0c80d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cf3e1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c80d0860 con 0x7fb0c8160090 2024-08-18T23:57:44.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cf3e1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c80b32c0 con 0x7fb0c815f8a0 2024-08-18T23:57:44.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cf3e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c80cfc00 con 0x7fb0c80d4bc0 2024-08-18T23:57:44.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cd97e640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb0c8160090 0x7fb0c8160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42184/0 (socket says 172.21.15.103:42184) 2024-08-18T23:57:44.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cd97e640 1 -- 172.21.15.103:0/2835617463 learned_addr learned my addr 172.21.15.103:0/2835617463 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:44.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263167635 0 0) 0x7fb0c80d0860 con 0x7fb0c8160090 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cc97c640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c80d4bc0 0x7fb0c80d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0b4003520 con 0x7fb0c8160090 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3940729128 0 0) 0x7fb0b4003520 con 0x7fb0c8160090 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c80d4bc0 msgr2=0x7fb0c80d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c80d4bc0 0x7fb0c80d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 >> v1:172.21.15.190:6789/0 conn(0x7fb0c815f8a0 legacy=0x7fb0c80d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c80d0090 con 0x7fb0c8160090 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fb0c00019f0 con 0x7fb0c8160090 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 >> v1:172.21.15.103:6789/0 conn(0x7fb0c8160090 legacy=0x7fb0c8160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c80d4bc0 0x7fb0b40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4003f60 0x7fb0b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0b4004d40 0x7fb0b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c80cfc00 con 0x7fb0b4004d40 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b400baa0 con 0x7fb0b4003f60 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb0b400bca0 con 0x7fb0c80d4bc0 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cd97e640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0b4004d40 0x7fb0b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.683+0000 7fb0cd17d640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c80d4bc0 0x7fb0b40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.684+0000 7fb0cc97c640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4003f60 0x7fb0b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.684+0000 7fb0cd97e640 1 -- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c80d4bc0 msgr2=0x7fb0b40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.684+0000 7fb0cd97e640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c80d4bc0 0x7fb0b40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.684+0000 7fb0cd97e640 1 -- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4003f60 msgr2=0x7fb0b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.684+0000 7fb0cd97e640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4003f60 0x7fb0b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.684+0000 7fb0cd97e640 1 -- 172.21.15.103:0/2835617463 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0b4003520 con 0x7fb0b4004d40 2024-08-18T23:57:44.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.684+0000 7fb0cd97e640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0b4004d40 0x7fb0b40051c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000a850 tx=0x7fb0b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a1f7f69ab67d25 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000a4a0 con 0x7fb0b4004d40 2024-08-18T23:57:44.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c002f070 con 0x7fb0b4004d40 2024-08-18T23:57:44.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0bffff640 1 -- 172.21.15.103:0/2835617463 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c002bd20 con 0x7fb0b4004d40 2024-08-18T23:57:44.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2835617463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0b4004d40 msgr2=0x7fb0b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0cf3e1640 1 --2- 172.21.15.103:0/2835617463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0b4004d40 0x7fb0b40051c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000a850 tx=0x7fb0b4005830 comp rx=0 tx=0).stop 2024-08-18T23:57:44.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0cd97e640 1 -- 172.21.15.103:0/2835617463 reap_dead start 2024-08-18T23:57:44.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2835617463 shutdown_connections 2024-08-18T23:57:44.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2835617463 >> 172.21.15.103:0/2835617463 conn(0x7fb0c80d40a0 msgr2=0x7fb0c80d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:44.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2835617463 shutdown_connections 2024-08-18T23:57:44.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.685+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2835617463 wait complete. 2024-08-18T23:57:44.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.686+0000 7fb0cf3e1640 1 Processor -- start 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.686+0000 7fb0cf3e1640 1 -- start start 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cf3e1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4004d40 0x7fb0c80b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cf3e1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0c8157120 0x7fb0c815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cf3e1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c815af90 0x7fb0c815b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cf3e1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c80b2fb0 con 0x7fb0c8157120 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cf3e1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c80cf890 con 0x7fb0b4004d40 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cf3e1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c815fc80 con 0x7fb0c815af90 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cc97c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0c8157120 0x7fb0c815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cc97c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0c8157120 0x7fb0c815e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36856/0 (socket says 172.21.15.103:36856) 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cc97c640 1 -- 172.21.15.103:0/2124172760 learned_addr learned my addr 172.21.15.103:0/2124172760 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cd17d640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4004d40 0x7fb0c80b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.687+0000 7fb0cd97e640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c815af90 0x7fb0c815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0cc97c640 1 -- 172.21.15.103:0/2124172760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c815af90 msgr2=0x7fb0c815b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0cc97c640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c815af90 0x7fb0c815b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0cc97c640 1 -- 172.21.15.103:0/2124172760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4004d40 msgr2=0x7fb0c80b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0cc97c640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4004d40 0x7fb0c80b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0cc97c640 1 -- 172.21.15.103:0/2124172760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c80b74b0 con 0x7fb0c8157120 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0cc97c640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0c8157120 0x7fb0c815e150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4011970 tx=0x7fb0c4011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0bdffb640 1 -- 172.21.15.103:0/2124172760 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c400faf0 con 0x7fb0c8157120 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0bdffb640 1 -- 172.21.15.103:0/2124172760 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c400fc90 con 0x7fb0c8157120 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c80b7790 con 0x7fb0c8157120 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0bdffb640 1 -- 172.21.15.103:0/2124172760 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4014440 con 0x7fb0c8157120 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.688+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c80b7d50 con 0x7fb0c8157120 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.689+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c81616c0 con 0x7fb0c8157120 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.690+0000 7fb0bdffb640 1 -- 172.21.15.103:0/2124172760 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0c4012040 con 0x7fb0c8157120 2024-08-18T23:57:44.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.690+0000 7fb0bdffb640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb0ac06be30 0x7fb0ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.690+0000 7fb0cd17d640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb0ac06be30 0x7fb0ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.690+0000 7fb0bdffb640 1 -- 172.21.15.103:0/2124172760 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fb0c408b220 con 0x7fb0c8157120 2024-08-18T23:57:44.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.691+0000 7fb0cd17d640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb0ac06be30 0x7fb0ac06e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80017e0 tx=0x7fb0b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.695+0000 7fb0bdffb640 1 -- 172.21.15.103:0/2124172760 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb0c4019030 con 0x7fb0c8157120 2024-08-18T23:57:44.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.859+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb0c8161ec0 con 0x7fb0c8157120 2024-08-18T23:57:44.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.859+0000 7fb0bdffb640 1 -- 172.21.15.103:0/2124172760 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7fb0c4059740 con 0x7fb0c8157120 2024-08-18T23:57:44.861 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:44.861 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-08-18T23:57:44.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-18T23:57:44.861 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-08-18T23:57:44.861 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-08-18T23:57:44.861 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:44.861 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb0ac06be30 msgr2=0x7fb0ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb0ac06be30 0x7fb0ac06e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80017e0 tx=0x7fb0b8009040 comp rx=0 tx=0).stop 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0c8157120 msgr2=0x7fb0c815e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0c8157120 0x7fb0c815e150 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4011970 tx=0x7fb0c4011e30 comp rx=0 tx=0).stop 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 shutdown_connections 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb0ac06be30 0x7fb0ac06e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c815af90 0x7fb0c815b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0c8157120 0x7fb0c815e150 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 --2- 172.21.15.103:0/2124172760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0b4004d40 0x7fb0c80b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 >> 172.21.15.103:0/2124172760 conn(0x7fb0c80d40a0 msgr2=0x7fb0c80b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:44.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 shutdown_connections 2024-08-18T23:57:44.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.861+0000 7fb0cf3e1640 1 -- 172.21.15.103:0/2124172760 wait complete. 2024-08-18T23:57:44.873 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-18T23:57:44.873 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-18T23:57:44.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.976+0000 7f6eac74d640 1 Processor -- start 2024-08-18T23:57:44.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.976+0000 7f6eac74d640 1 -- start start 2024-08-18T23:57:44.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.977+0000 7f6eac74d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ea415bf90 0x7f6ea406f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.977+0000 7f6eac74d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea40d2a10 0x7f6ea40cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.977+0000 7f6eac74d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea40cf0b0 con 0x7f6ea40d03f0 2024-08-18T23:57:44.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.977+0000 7f6eac74d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6ea40ccc50 con 0x7f6ea415bf90 2024-08-18T23:57:44.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.977+0000 7f6eac74d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea40cf390 con 0x7f6ea40d2a10 2024-08-18T23:57:44.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6eaa4e9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ea415bf90 0x7f6ea406f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6ea9ce8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea40d2a10 0x7f6ea40cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6eaa4e9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ea415bf90 0x7f6ea406f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:59122/0 (socket says 172.21.15.103:59122) 2024-08-18T23:57:44.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6eaa4e9640 1 -- 172.21.15.103:0/464460223 learned_addr learned my addr 172.21.15.103:0/464460223 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:44.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6ea9ce8640 1 -- 172.21.15.103:0/464460223 >> v2:172.21.15.190:3300/0 conn(0x7f6ea415bf90 msgr2=0x7f6ea406f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:44.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6ea9ce8640 1 --2- 172.21.15.103:0/464460223 >> v2:172.21.15.190:3300/0 conn(0x7f6ea415bf90 0x7f6ea406f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6ea9ce8640 1 -- 172.21.15.103:0/464460223 >> v1:172.21.15.190:6789/0 conn(0x7f6ea40d03f0 legacy=0x7f6ea40cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6ea9ce8640 1 -- 172.21.15.103:0/464460223 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea415c370 con 0x7f6ea40d2a10 2024-08-18T23:57:44.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.978+0000 7f6eaa4e9640 1 --2- 172.21.15.103:0/464460223 >> v2:172.21.15.190:3300/0 conn(0x7f6ea415bf90 0x7f6ea406f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.979+0000 7f6ea9ce8640 1 --2- 172.21.15.103:0/464460223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea40d2a10 0x7f6ea40cf9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6e940097a0 tx=0x7f6e9402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff6a9fbb64ae259 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.979+0000 7f6ea94e7640 1 -- 172.21.15.103:0/464460223 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94037070 con 0x7f6ea40d2a10 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.979+0000 7f6ea94e7640 1 -- 172.21.15.103:0/464460223 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e94032440 con 0x7f6ea40d2a10 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.979+0000 7f6ea94e7640 1 -- 172.21.15.103:0/464460223 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e94032810 con 0x7f6ea40d2a10 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.979+0000 7f6eac74d640 1 -- 172.21.15.103:0/464460223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea40d2a10 msgr2=0x7f6ea40cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.979+0000 7f6eac74d640 1 --2- 172.21.15.103:0/464460223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea40d2a10 0x7f6ea40cf9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6e940097a0 tx=0x7f6e9402a180 comp rx=0 tx=0).stop 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.980+0000 7f6eac74d640 1 -- 172.21.15.103:0/464460223 shutdown_connections 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.980+0000 7f6eac74d640 1 --2- 172.21.15.103:0/464460223 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea40d2a10 0x7f6ea40cf9e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.980+0000 7f6eac74d640 1 --2- 172.21.15.103:0/464460223 >> v2:172.21.15.190:3300/0 conn(0x7f6ea415bf90 0x7f6ea406f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.980+0000 7f6eac74d640 1 -- 172.21.15.103:0/464460223 >> 172.21.15.103:0/464460223 conn(0x7f6ea40d1e10 msgr2=0x7f6ea40d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.980+0000 7f6eac74d640 1 -- 172.21.15.103:0/464460223 shutdown_connections 2024-08-18T23:57:44.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.980+0000 7f6eac74d640 1 -- 172.21.15.103:0/464460223 wait complete. 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.981+0000 7f6eac74d640 1 Processor -- start 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.981+0000 7f6eac74d640 1 -- start start 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.981+0000 7f6eac74d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea40d03f0 0x7f6ea41f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.981+0000 7f6eac74d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ea40d2a10 0x7f6ea40b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.981+0000 7f6eac74d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea415bf90 0x7f6ea415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.981+0000 7f6eac74d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea40d0880 con 0x7f6ea40d03f0 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.981+0000 7f6eac74d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea40cf670 con 0x7f6ea40d2a10 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.981+0000 7f6eac74d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea40d0a00 con 0x7f6ea415bf90 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea40d03f0 0x7f6ea41f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea40d03f0 0x7f6ea41f4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36866/0 (socket says 172.21.15.103:36866) 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 -- 172.21.15.103:0/3959617142 learned_addr learned my addr 172.21.15.103:0/3959617142 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:44.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6ea9ce8640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ea40d2a10 0x7f6ea40b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaacea640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea415bf90 0x7f6ea415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 -- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea415bf90 msgr2=0x7f6ea415ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea415bf90 0x7f6ea415ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 -- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ea40d2a10 msgr2=0x7f6ea40b7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ea40d2a10 0x7f6ea40b7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 -- 172.21.15.103:0/3959617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea41f5670 con 0x7f6ea40d03f0 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaacea640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea415bf90 0x7f6ea415ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eaa4e9640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea40d03f0 0x7f6ea41f4c20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000e9b0 tx=0x7f6ea000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6e9affd640 1 -- 172.21.15.103:0/3959617142 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0017070 con 0x7f6ea40d03f0 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6e9affd640 1 -- 172.21.15.103:0/3959617142 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea000c9a0 con 0x7f6ea40d03f0 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea41f5950 con 0x7f6ea40d03f0 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6e9affd640 1 -- 172.21.15.103:0/3959617142 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea000cd50 con 0x7f6ea40d03f0 2024-08-18T23:57:44.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.982+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea40b6e00 con 0x7f6ea40d03f0 2024-08-18T23:57:44.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.983+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea41f5b20 con 0x7f6ea40d03f0 2024-08-18T23:57:44.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.984+0000 7f6e9affd640 1 -- 172.21.15.103:0/3959617142 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ea001a070 con 0x7f6ea40d03f0 2024-08-18T23:57:44.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.984+0000 7f6e9affd640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f6e8806be30 0x7f6e8806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:44.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.984+0000 7f6e9affd640 1 -- 172.21.15.103:0/3959617142 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f6ea008af10 con 0x7f6ea40d03f0 2024-08-18T23:57:44.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.984+0000 7f6ea9ce8640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f6e8806be30 0x7f6e8806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:44.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.985+0000 7f6ea9ce8640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f6e8806be30 0x7f6e8806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e94034000 tx=0x7f6e9402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:44.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:44.988+0000 7f6e9affd640 1 -- 172.21.15.103:0/3959617142 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f6ea00593b0 con 0x7f6ea40d03f0 2024-08-18T23:57:45.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.154+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6ea40cf9e0 con 0x7f6ea40d03f0 2024-08-18T23:57:45.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.961+0000 7f6e9affd640 1 -- 172.21.15.103:0/3959617142 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7f6ea005d6b0 con 0x7f6ea40d03f0 2024-08-18T23:57:45.963 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-08-18T23:57:45.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f6e8806be30 msgr2=0x7f6e8806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:45.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f6e8806be30 0x7f6e8806e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6e94034000 tx=0x7f6e9402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea40d03f0 msgr2=0x7f6ea41f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea40d03f0 0x7f6ea41f4c20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000e9b0 tx=0x7f6ea000ee70 comp rx=0 tx=0).stop 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 shutdown_connections 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f6e8806be30 0x7f6e8806e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ea415bf90 0x7f6ea415ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ea40d2a10 0x7f6ea40b7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 --2- 172.21.15.103:0/3959617142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ea40d03f0 0x7f6ea41f4c20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 >> 172.21.15.103:0/3959617142 conn(0x7f6ea40d1e10 msgr2=0x7f6ea40b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 shutdown_connections 2024-08-18T23:57:45.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:45.964+0000 7f6eac74d640 1 -- 172.21.15.103:0/3959617142 wait complete. 2024-08-18T23:57:45.982 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-18T23:57:46.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.091+0000 7f875959c640 1 Processor -- start 2024-08-18T23:57:46.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.091+0000 7f875959c640 1 -- start start 2024-08-18T23:57:46.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f875959c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f875415e3b0 0x7f87540d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:46.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f875959c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 0x7f87540d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:46.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f875959c640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87540d4e10 con 0x7f87540d21b0 2024-08-18T23:57:46.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f875959c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f87540d4bc0 con 0x7f875415e3b0 2024-08-18T23:57:46.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f875959c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f87540cf960 con 0x7f87540b4a10 2024-08-18T23:57:46.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f8752ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f875415e3b0 0x7f87540d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:46.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f874a7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f87540d21b0 0x7f87540d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42188/0 (socket says 172.21.15.103:42188) 2024-08-18T23:57:46.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f8752ffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f875415e3b0 0x7f87540d2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36876/0 (socket says 172.21.15.103:36876) 2024-08-18T23:57:46.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f874a7fc640 1 -- 172.21.15.103:0/1968395413 learned_addr learned my addr 172.21.15.103:0/1968395413 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:46.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f87537fe640 1 --2- 172.21.15.103:0/1968395413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 0x7f87540d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:46.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f8752ffd640 1 -- 172.21.15.103:0/1968395413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 msgr2=0x7f87540d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:46.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f8752ffd640 1 --2- 172.21.15.103:0/1968395413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 0x7f87540d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.092+0000 7f8752ffd640 1 -- 172.21.15.103:0/1968395413 >> v1:172.21.15.103:6789/0 conn(0x7f87540d21b0 legacy=0x7f87540d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:46.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.093+0000 7f8752ffd640 1 -- 172.21.15.103:0/1968395413 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87540cfbb0 con 0x7f875415e3b0 2024-08-18T23:57:46.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.093+0000 7f8752ffd640 1 --2- 172.21.15.103:0/1968395413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f875415e3b0 0x7f87540d2700 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f87440097a0 tx=0x7f874402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e602333f9e05ef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:46.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.093+0000 7f87527fc640 1 -- 172.21.15.103:0/1968395413 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744037070 con 0x7f875415e3b0 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.093+0000 7f87527fc640 1 -- 172.21.15.103:0/1968395413 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f874402ad10 con 0x7f875415e3b0 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.093+0000 7f87527fc640 1 -- 172.21.15.103:0/1968395413 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744032660 con 0x7f875415e3b0 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.094+0000 7f875959c640 1 -- 172.21.15.103:0/1968395413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f875415e3b0 msgr2=0x7f87540d2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.094+0000 7f875959c640 1 --2- 172.21.15.103:0/1968395413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f875415e3b0 0x7f87540d2700 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f87440097a0 tx=0x7f874402a080 comp rx=0 tx=0).stop 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.094+0000 7f875959c640 1 -- 172.21.15.103:0/1968395413 shutdown_connections 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.094+0000 7f875959c640 1 --2- 172.21.15.103:0/1968395413 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 0x7f87540d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.094+0000 7f875959c640 1 --2- 172.21.15.103:0/1968395413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f875415e3b0 0x7f87540d2700 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.094+0000 7f875959c640 1 -- 172.21.15.103:0/1968395413 >> 172.21.15.103:0/1968395413 conn(0x7f87540d40a0 msgr2=0x7f87540d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.094+0000 7f875959c640 1 -- 172.21.15.103:0/1968395413 shutdown_connections 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.094+0000 7f875959c640 1 -- 172.21.15.103:0/1968395413 wait complete. 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.095+0000 7f875959c640 1 Processor -- start 2024-08-18T23:57:46.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.095+0000 7f875959c640 1 -- start start 2024-08-18T23:57:46.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f875959c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 0x7f875409f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:46.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f875959c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540d21b0 0x7f87540cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f875959c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f875415e3b0 0x7f87540cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f875959c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f875415e790 con 0x7f87540d21b0 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f875959c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87540d0200 con 0x7f875415e3b0 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f875959c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f875415e910 con 0x7f87540b4a10 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f874a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540d21b0 0x7f87540cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f874a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540d21b0 0x7f87540cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36888/0 (socket says 172.21.15.103:36888) 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f874a7fc640 1 -- 172.21.15.103:0/3631474900 learned_addr learned my addr 172.21.15.103:0/3631474900 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f8752ffd640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 0x7f875409f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f87537fe640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f875415e3b0 0x7f87540cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f874a7fc640 1 -- 172.21.15.103:0/3631474900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 msgr2=0x7f875409f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f874a7fc640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 0x7f875409f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f874a7fc640 1 -- 172.21.15.103:0/3631474900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f875415e3b0 msgr2=0x7f87540cc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:46.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f874a7fc640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f875415e3b0 0x7f87540cc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.096+0000 7f874a7fc640 1 -- 172.21.15.103:0/3631474900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8754154a20 con 0x7f87540d21b0 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.097+0000 7f874a7fc640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540d21b0 0x7f87540cdd40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f873c00c780 tx=0x7f873c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.097+0000 7f874bfff640 1 -- 172.21.15.103:0/3631474900 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c017070 con 0x7f87540d21b0 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.097+0000 7f874bfff640 1 -- 172.21.15.103:0/3631474900 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c005a90 con 0x7f87540d21b0 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.097+0000 7f874bfff640 1 -- 172.21.15.103:0/3631474900 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c007070 con 0x7f87540d21b0 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.097+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87540cb820 con 0x7f87540d21b0 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.097+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87540cbde0 con 0x7f87540d21b0 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.098+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87540b3000 con 0x7f87540d21b0 2024-08-18T23:57:46.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.098+0000 7f874bfff640 1 -- 172.21.15.103:0/3631474900 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f873c01a070 con 0x7f87540d21b0 2024-08-18T23:57:46.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.099+0000 7f874bfff640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f873406be30 0x7f873406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:46.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.099+0000 7f8752ffd640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f873406be30 0x7f873406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:46.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.099+0000 7f874bfff640 1 -- 172.21.15.103:0/3631474900 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7f873c08a290 con 0x7f87540d21b0 2024-08-18T23:57:46.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.099+0000 7f8752ffd640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f873406be30 0x7f873406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8744034000 tx=0x7f874402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:46.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.103+0000 7f874bfff640 1 -- 172.21.15.103:0/3631474900 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f873c058640 con 0x7f87540d21b0 2024-08-18T23:57:46.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.269+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f87540d1800 con 0x7f87540d21b0 2024-08-18T23:57:46.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.963+0000 7f874bfff640 1 -- 172.21.15.103:0/3631474900 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7f873c05c940 con 0x7f87540d21b0 2024-08-18T23:57:46.965 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-08-18T23:57:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.967+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f873406be30 msgr2=0x7f873406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.967+0000 7f875959c640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f873406be30 0x7f873406e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8744034000 tx=0x7f874402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.967+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540d21b0 msgr2=0x7f87540cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:46.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.967+0000 7f875959c640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540d21b0 0x7f87540cdd40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f873c00c780 tx=0x7f873c00cc40 comp rx=0 tx=0).stop 2024-08-18T23:57:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.968+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 shutdown_connections 2024-08-18T23:57:46.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.968+0000 7f875959c640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f873406be30 0x7f873406e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.968+0000 7f875959c640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f875415e3b0 0x7f87540cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.968+0000 7f875959c640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87540d21b0 0x7f87540cdd40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.968+0000 7f875959c640 1 --2- 172.21.15.103:0/3631474900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87540b4a10 0x7f875409f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.968+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 >> 172.21.15.103:0/3631474900 conn(0x7f87540d40a0 msgr2=0x7f875406d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:46.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.969+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 shutdown_connections 2024-08-18T23:57:46.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:46.970+0000 7f875959c640 1 -- 172.21.15.103:0/3631474900 wait complete. 2024-08-18T23:57:46.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-18T23:57:47.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.101+0000 7f829defe640 1 Processor -- start 2024-08-18T23:57:47.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.101+0000 7f829defe640 1 -- start start 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.102+0000 7f829defe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f82980cf4d0 0x7f829806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.102+0000 7f829defe640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829806b900 con 0x7f82980cf8b0 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.102+0000 7f829defe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829806bbe0 con 0x7f829815faf0 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.102+0000 7f829defe640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f829806bec0 con 0x7f82980cf4d0 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.102+0000 7f8297fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f82980cf8b0 0x7f82980cfce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42198/0 (socket says 172.21.15.103:42198) 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.102+0000 7f8297fff640 1 -- 172.21.15.103:0/1528585348 learned_addr learned my addr 172.21.15.103:0/1528585348 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.102+0000 7f82977fe640 1 --2- 172.21.15.103:0/1528585348 >> v2:172.21.15.190:3300/0 conn(0x7f82980cf4d0 0x7f829806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.102+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866773152 0 0) 0x7f829806b900 con 0x7f82980cf8b0 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8284003520 con 0x7f82980cf8b0 2024-08-18T23:57:47.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3766132245 0 0) 0x7f8284003520 con 0x7f82980cf8b0 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 >> v2:172.21.15.190:3300/0 conn(0x7f82980cf4d0 msgr2=0x7f829806cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 --2- 172.21.15.103:0/1528585348 >> v2:172.21.15.190:3300/0 conn(0x7f82980cf4d0 0x7f829806cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 >> v1:172.21.15.190:6789/0 conn(0x7f829815faf0 legacy=0x7f829815ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829806c1a0 con 0x7f82980cf8b0 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f82900019f0 con 0x7f82980cf8b0 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 >> v1:172.21.15.103:6789/0 conn(0x7f82980cf8b0 legacy=0x7f82980cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82840039b0 0x7f8284003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8284004800 0x7f8284004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840051c0 0x7f828400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f829806bec0 con 0x7f82840039b0 2024-08-18T23:57:47.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f828400c060 con 0x7f82840051c0 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f828400c260 con 0x7f8284004800 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f82977fe640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82840039b0 0x7f8284003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8297fff640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840051c0 0x7f828400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f828ffff640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8284004800 0x7f8284004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f82977fe640 1 -- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8284004800 msgr2=0x7f8284004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f82977fe640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8284004800 0x7f8284004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f82977fe640 1 -- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840051c0 msgr2=0x7f828400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f82977fe640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840051c0 0x7f828400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f82977fe640 1 -- 172.21.15.103:0/1528585348 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8284003520 con 0x7f82840039b0 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8297fff640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840051c0 0x7f828400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.103+0000 7f8297fff640 1 -- 172.21.15.103:0/1528585348 reap_dead start 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.104+0000 7f82977fe640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82840039b0 0x7f8284003dd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8288009ac0 tx=0x7f8284005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed99bedadb1f0229 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:47.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.104+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288036070 con 0x7f82840039b0 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.104+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8288031400 con 0x7f82840039b0 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.104+0000 7f8296ffd640 1 -- 172.21.15.103:0/1528585348 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288009690 con 0x7f82840039b0 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.105+0000 7f829defe640 1 -- 172.21.15.103:0/1528585348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82840039b0 msgr2=0x7f8284003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.105+0000 7f829defe640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82840039b0 0x7f8284003dd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8288009ac0 tx=0x7f8284005830 comp rx=0 tx=0).stop 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.105+0000 7f829defe640 1 -- 172.21.15.103:0/1528585348 shutdown_connections 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.105+0000 7f829defe640 1 --2- 172.21.15.103:0/1528585348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82840039b0 0x7f8284003dd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.105+0000 7f829defe640 1 -- 172.21.15.103:0/1528585348 >> 172.21.15.103:0/1528585348 conn(0x7f82980d05c0 msgr2=0x7f82980d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.105+0000 7f829defe640 1 -- 172.21.15.103:0/1528585348 shutdown_connections 2024-08-18T23:57:47.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.105+0000 7f829defe640 1 -- 172.21.15.103:0/1528585348 wait complete. 2024-08-18T23:57:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.106+0000 7f829defe640 1 Processor -- start 2024-08-18T23:57:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.106+0000 7f829defe640 1 -- start start 2024-08-18T23:57:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f829defe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840039b0 0x7f8298152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f829defe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82980c54c0 0x7f82980c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:47.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f829defe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82980aaf00 0x7f82980ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f829defe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f829815ff10 con 0x7f82980c54c0 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f829defe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f829806c760 con 0x7f82840039b0 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f829defe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8298160090 con 0x7f82980aaf00 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82980c54c0 0x7f82980c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82980c54c0 0x7f82980c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36904/0 (socket says 172.21.15.103:36904) 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 -- 172.21.15.103:0/239081557 learned_addr learned my addr 172.21.15.103:0/239081557 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f8297fff640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82980aaf00 0x7f82980ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f82977fe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840039b0 0x7f8298152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 -- 172.21.15.103:0/239081557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82980aaf00 msgr2=0x7f82980ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82980aaf00 0x7f82980ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 -- 172.21.15.103:0/239081557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840039b0 msgr2=0x7f8298152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840039b0 0x7f8298152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 -- 172.21.15.103:0/239081557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82980abbf0 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f828ffff640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82980c54c0 0x7f82980c5940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f828000e4d0 tx=0x7f828000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f8294ff9640 1 -- 172.21.15.103:0/239081557 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82800053a0 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f8294ff9640 1 -- 172.21.15.103:0/239081557 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8280018070 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82981f3260 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f8294ff9640 1 -- 172.21.15.103:0/239081557 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8280003810 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.107+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82981f3820 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.108+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f829806cc80 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.109+0000 7f8294ff9640 1 -- 172.21.15.103:0/239081557 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f82800039b0 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.109+0000 7f8294ff9640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f827806be30 0x7f827806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.110+0000 7f8294ff9640 1 -- 172.21.15.103:0/239081557 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7f828008ab50 con 0x7f82980c54c0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.110+0000 7f82977fe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f827806be30 0x7f827806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:47.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.110+0000 7f82977fe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f827806be30 0x7f827806e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8288033000 tx=0x7f8288008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:47.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.114+0000 7f8294ff9640 1 -- 172.21.15.103:0/239081557 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8280058d80 con 0x7f82980c54c0 2024-08-18T23:57:47.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.317+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f829815d0d0 con 0x7f82980c54c0 2024-08-18T23:57:47.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.988+0000 7f8294ff9640 1 -- 172.21.15.103:0/239081557 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f828005d080 con 0x7f82980c54c0 2024-08-18T23:57:47.990 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 5 and data pool 6 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f827806be30 msgr2=0x7f827806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f827806be30 0x7f827806e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8288033000 tx=0x7f8288008030 comp rx=0 tx=0).stop 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82980c54c0 msgr2=0x7f82980c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82980c54c0 0x7f82980c5940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f828000e4d0 tx=0x7f828000e990 comp rx=0 tx=0).stop 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 shutdown_connections 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f827806be30 0x7f827806e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f82980aaf00 0x7f82980ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82980c54c0 0x7f82980c5940 secure :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f828000e4d0 tx=0x7f828000e990 comp rx=0 tx=0).stop 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 --2- 172.21.15.103:0/239081557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82840039b0 0x7f8298152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.992+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 >> 172.21.15.103:0/239081557 conn(0x7f82980d05c0 msgr2=0x7f829806f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.993+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 shutdown_connections 2024-08-18T23:57:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:47.993+0000 7f829defe640 1 -- 172.21.15.103:0/239081557 wait complete. 2024-08-18T23:57:48.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.121+0000 7f670e20a640 1 Processor -- start 2024-08-18T23:57:48.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.122+0000 7f670e20a640 1 -- start start 2024-08-18T23:57:48.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.122+0000 7f670e20a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f670815f8a0 0x7f67080d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.122+0000 7f670e20a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f67080d4bc0 0x7f67080d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.122+0000 7f670e20a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67080d0860 con 0x7f67080d1530 2024-08-18T23:57:48.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.122+0000 7f670e20a640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f67080cfc00 con 0x7f670815f8a0 2024-08-18T23:57:48.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.122+0000 7f670e20a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f67080b32c0 con 0x7f67080d4bc0 2024-08-18T23:57:48.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.122+0000 7f67077fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f670815f8a0 0x7f67080d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f67077fe640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f670815f8a0 0x7f67080d0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36906/0 (socket says 172.21.15.103:36906) 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f67077fe640 1 -- 172.21.15.103:0/3715963516 learned_addr learned my addr 172.21.15.103:0/3715963516 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f6707fff640 1 --1- 172.21.15.103:0/3715963516 >> v1:172.21.15.103:6789/0 conn(0x7f67080d1530 0x7f67080d1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42202/0 (socket says 172.21.15.103:42202) 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f66fffff640 1 --2- 172.21.15.103:0/3715963516 >> v2:172.21.15.190:3300/0 conn(0x7f67080d4bc0 0x7f67080d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f67077fe640 1 -- 172.21.15.103:0/3715963516 >> v2:172.21.15.190:3300/0 conn(0x7f67080d4bc0 msgr2=0x7f67080d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f67077fe640 1 --2- 172.21.15.103:0/3715963516 >> v2:172.21.15.190:3300/0 conn(0x7f67080d4bc0 0x7f67080d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f67077fe640 1 -- 172.21.15.103:0/3715963516 >> v1:172.21.15.103:6789/0 conn(0x7f67080d1530 legacy=0x7f67080d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f67077fe640 1 -- 172.21.15.103:0/3715963516 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67080d0090 con 0x7f670815f8a0 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f6706ffd640 1 -- 172.21.15.103:0/3715963516 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433245504 0 0) 0x7f67080d0860 con 0x7f67080d1530 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.123+0000 7f66fffff640 1 --2- 172.21.15.103:0/3715963516 >> v2:172.21.15.190:3300/0 conn(0x7f67080d4bc0 0x7f67080d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:48.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f67077fe640 1 --2- 172.21.15.103:0/3715963516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670815f8a0 0x7f67080d0ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6708073f90 tx=0x7f66f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e485bd727e9e173 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f6706ffd640 1 -- 172.21.15.103:0/3715963516 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8037070 con 0x7f670815f8a0 2024-08-18T23:57:48.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f6706ffd640 1 -- 172.21.15.103:0/3715963516 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f8032440 con 0x7f670815f8a0 2024-08-18T23:57:48.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f6706ffd640 1 -- 172.21.15.103:0/3715963516 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8032810 con 0x7f670815f8a0 2024-08-18T23:57:48.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f670e20a640 1 -- 172.21.15.103:0/3715963516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670815f8a0 msgr2=0x7f67080d0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f670e20a640 1 --2- 172.21.15.103:0/3715963516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670815f8a0 0x7f67080d0ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6708073f90 tx=0x7f66f802a270 comp rx=0 tx=0).stop 2024-08-18T23:57:48.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f670e20a640 1 -- 172.21.15.103:0/3715963516 shutdown_connections 2024-08-18T23:57:48.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f670e20a640 1 --2- 172.21.15.103:0/3715963516 >> v2:172.21.15.190:3300/0 conn(0x7f67080d4bc0 0x7f67080d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f670e20a640 1 --2- 172.21.15.103:0/3715963516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670815f8a0 0x7f67080d0ab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f670e20a640 1 -- 172.21.15.103:0/3715963516 >> 172.21.15.103:0/3715963516 conn(0x7f67080d40a0 msgr2=0x7f67080d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f670e20a640 1 -- 172.21.15.103:0/3715963516 shutdown_connections 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.124+0000 7f670e20a640 1 -- 172.21.15.103:0/3715963516 wait complete. 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.125+0000 7f670e20a640 1 Processor -- start 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f670e20a640 1 -- start start 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f670e20a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67080d1530 0x7f67080c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f670e20a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67080d4bc0 0x7f670815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f670e20a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f670815f8a0 0x7f67080ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f670e20a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f67080b2fb0 con 0x7f67080d1530 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f670e20a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f67080cf890 con 0x7f67080d4bc0 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f670e20a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f67081610a0 con 0x7f670815f8a0 2024-08-18T23:57:48.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f67077fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67080d1530 0x7f67080c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f67077fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67080d1530 0x7f67080c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36920/0 (socket says 172.21.15.103:36920) 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.126+0000 7f67077fe640 1 -- 172.21.15.103:0/2566210279 learned_addr learned my addr 172.21.15.103:0/2566210279 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f6707fff640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f670815f8a0 0x7f67080ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f66fffff640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67080d4bc0 0x7f670815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f67077fe640 1 -- 172.21.15.103:0/2566210279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f670815f8a0 msgr2=0x7f67080ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f67077fe640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f670815f8a0 0x7f67080ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f67077fe640 1 -- 172.21.15.103:0/2566210279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67080d4bc0 msgr2=0x7f670815a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f67077fe640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67080d4bc0 0x7f670815a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f67077fe640 1 -- 172.21.15.103:0/2566210279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670815a690 con 0x7f67080d1530 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f67077fe640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67080d1530 0x7f67080c8a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f66f802a2b0 tx=0x7f66f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f6704ff9640 1 -- 172.21.15.103:0/2566210279 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8041020 con 0x7f67080d1530 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f6704ff9640 1 -- 172.21.15.103:0/2566210279 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f80306c0 con 0x7f67080d1530 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f6704ff9640 1 -- 172.21.15.103:0/2566210279 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8037040 con 0x7f67080d1530 2024-08-18T23:57:48.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67080b7070 con 0x7f67080d1530 2024-08-18T23:57:48.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.127+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67080b7630 con 0x7f67080d1530 2024-08-18T23:57:48.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.128+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670815fc80 con 0x7f67080d1530 2024-08-18T23:57:48.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.128+0000 7f6704ff9640 1 -- 172.21.15.103:0/2566210279 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66f8044020 con 0x7f67080d1530 2024-08-18T23:57:48.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.129+0000 7f6704ff9640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66e806be30 0x7f66e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.129+0000 7f6704ff9640 1 -- 172.21.15.103:0/2566210279 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f66f80ab830 con 0x7f67080d1530 2024-08-18T23:57:48.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.129+0000 7f66fffff640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66e806be30 0x7f66e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.129+0000 7f66fffff640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66e806be30 0x7f66e806e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f670806e090 tx=0x7f66f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.133+0000 7f6704ff9640 1 -- 172.21.15.103:0/2566210279 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f66f804b030 con 0x7f67080d1530 2024-08-18T23:57:48.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.301+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67080d3100 con 0x7f67080d1530 2024-08-18T23:57:48.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.302+0000 7f6704ff9640 1 -- 172.21.15.103:0/2566210279 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16991 (secure 0 0 0) 0x7f66f807a050 con 0x7f67080d1530 2024-08-18T23:57:48.304 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:48.304 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":37,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:57:47.319245+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:57:45.173057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T23:57:46.287913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66e806be30 msgr2=0x7f66e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66e806be30 0x7f66e806e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f670806e090 tx=0x7f66f0008040 comp rx=0 tx=0).stop 2024-08-18T23:57:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67080d1530 msgr2=0x7f67080c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67080d1530 0x7f67080c8a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f66f802a2b0 tx=0x7f66f80046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 shutdown_connections 2024-08-18T23:57:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66e806be30 0x7f66e806e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f670815f8a0 0x7f67080ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67080d4bc0 0x7f670815a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 --2- 172.21.15.103:0/2566210279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67080d1530 0x7f67080c8a80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 >> 172.21.15.103:0/2566210279 conn(0x7f67080d40a0 msgr2=0x7f67080b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 shutdown_connections 2024-08-18T23:57:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.304+0000 7f670e20a640 1 -- 172.21.15.103:0/2566210279 wait complete. 2024-08-18T23:57:48.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:48.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.415+0000 7fa89a561640 1 Processor -- start 2024-08-18T23:57:48.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.415+0000 7fa89a561640 1 -- start start 2024-08-18T23:57:48.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.415+0000 7fa89a561640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa89415f8a0 0x7fa8940d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa89a561640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8940d4bc0 0x7fa8940d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa89a561640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8940d0860 con 0x7fa8940d1530 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa89a561640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa8940cfc00 con 0x7fa89415f8a0 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa89a561640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa8940b32c0 con 0x7fa8940d4bc0 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa898afe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa8940d1530 0x7fa8940d1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42212/0 (socket says 172.21.15.103:42212) 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa898afe640 1 -- 172.21.15.103:0/4179658727 learned_addr learned my addr 172.21.15.103:0/4179658727 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa8937fe640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8940d4bc0 0x7fa8940d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4285058517 0 0) 0x7fa8940d0860 con 0x7fa8940d1530 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa87c003520 con 0x7fa8940d1530 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa893fff640 1 --2- 172.21.15.103:0/4179658727 >> v2:172.21.15.190:3300/0 conn(0x7fa89415f8a0 0x7fa8940d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2778299874 0 0) 0x7fa87c003520 con 0x7fa8940d1530 2024-08-18T23:57:48.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8940d4bc0 msgr2=0x7fa8940d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8940d4bc0 0x7fa8940d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 >> v2:172.21.15.190:3300/0 conn(0x7fa89415f8a0 msgr2=0x7fa8940d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 --2- 172.21.15.103:0/4179658727 >> v2:172.21.15.190:3300/0 conn(0x7fa89415f8a0 0x7fa8940d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8940d0090 con 0x7fa8940d1530 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fa88c0019f0 con 0x7fa8940d1530 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 >> v1:172.21.15.103:6789/0 conn(0x7fa8940d1530 legacy=0x7fa8940d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa87c0039b0 0x7fa87c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa87c004800 0x7fa87c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8940d4bc0 0x7fa87c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8940cfc00 con 0x7fa87c0039b0 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa8940b32c0 con 0x7fa87c004800 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa87c00b9c0 con 0x7fa8940d4bc0 2024-08-18T23:57:48.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa893fff640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa87c0039b0 0x7fa87c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa8937fe640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa87c004800 0x7fa87c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.416+0000 7fa898afe640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8940d4bc0 0x7fa87c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.417+0000 7fa893fff640 1 -- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8940d4bc0 msgr2=0x7fa87c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.417+0000 7fa893fff640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa8940d4bc0 0x7fa87c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.417+0000 7fa893fff640 1 -- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa87c004800 msgr2=0x7fa87c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.417+0000 7fa893fff640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa87c004800 0x7fa87c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.417+0000 7fa893fff640 1 -- 172.21.15.103:0/4179658727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c003520 con 0x7fa87c0039b0 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.417+0000 7fa893fff640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa87c0039b0 0x7fa87c003dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa884009ac0 tx=0x7fa87c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79607627728e730 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.417+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884036070 con 0x7fa87c0039b0 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.417+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa884031400 con 0x7fa87c0039b0 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.418+0000 7fa892ffd640 1 -- 172.21.15.103:0/4179658727 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa884009690 con 0x7fa87c0039b0 2024-08-18T23:57:48.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.418+0000 7fa89a561640 1 -- 172.21.15.103:0/4179658727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa87c0039b0 msgr2=0x7fa87c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.418+0000 7fa89a561640 1 --2- 172.21.15.103:0/4179658727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa87c0039b0 0x7fa87c003dd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa884009ac0 tx=0x7fa87c005830 comp rx=0 tx=0).stop 2024-08-18T23:57:48.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.418+0000 7fa898afe640 1 -- 172.21.15.103:0/4179658727 reap_dead start 2024-08-18T23:57:48.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.418+0000 7fa89a561640 1 -- 172.21.15.103:0/4179658727 shutdown_connections 2024-08-18T23:57:48.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.418+0000 7fa89a561640 1 -- 172.21.15.103:0/4179658727 >> 172.21.15.103:0/4179658727 conn(0x7fa8940d40a0 msgr2=0x7fa8940d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:48.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.418+0000 7fa89a561640 1 -- 172.21.15.103:0/4179658727 shutdown_connections 2024-08-18T23:57:48.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.418+0000 7fa89a561640 1 -- 172.21.15.103:0/4179658727 wait complete. 2024-08-18T23:57:48.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.419+0000 7fa89a561640 1 Processor -- start 2024-08-18T23:57:48.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.419+0000 7fa89a561640 1 -- start start 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa89a561640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87c0039b0 0x7fa8941f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa89a561640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940b6ed0 0x7fa89415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa89a561640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa89415c900 0x7fa8940b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa89a561640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8940b2fb0 con 0x7fa89415c900 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa89a561640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa8940cf890 con 0x7fa8940b6ed0 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa89a561640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa8941610a0 con 0x7fa87c0039b0 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa898afe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa89415c900 0x7fa8940b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa898afe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa89415c900 0x7fa8940b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36942/0 (socket says 172.21.15.103:36942) 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa898afe640 1 -- 172.21.15.103:0/1746551586 learned_addr learned my addr 172.21.15.103:0/1746551586 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa893fff640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87c0039b0 0x7fa8941f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.420+0000 7fa8937fe640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940b6ed0 0x7fa89415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa898afe640 1 -- 172.21.15.103:0/1746551586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87c0039b0 msgr2=0x7fa8941f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa898afe640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87c0039b0 0x7fa8941f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa898afe640 1 -- 172.21.15.103:0/1746551586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940b6ed0 msgr2=0x7fa89415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa898afe640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940b6ed0 0x7fa89415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa898afe640 1 -- 172.21.15.103:0/1746551586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8940b73b0 con 0x7fa89415c900 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa898afe640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa89415c900 0x7fa8940b3ac0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa8940ce780 tx=0x7fa88c007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa890ff9640 1 -- 172.21.15.103:0/1746551586 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00ac40 con 0x7fa89415c900 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa890ff9640 1 -- 172.21.15.103:0/1746551586 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c018070 con 0x7fa89415c900 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa890ff9640 1 -- 172.21.15.103:0/1746551586 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0133f0 con 0x7fa89415c900 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8940b7690 con 0x7fa89415c900 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.421+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8940b7c50 con 0x7fa89415c900 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.422+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa89415fc80 con 0x7fa89415c900 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.422+0000 7fa890ff9640 1 -- 172.21.15.103:0/1746551586 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa88c013590 con 0x7fa89415c900 2024-08-18T23:57:48.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.423+0000 7fa890ff9640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa88006be60 0x7fa88006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.423+0000 7fa890ff9640 1 -- 172.21.15.103:0/1746551586 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fa88c08b580 con 0x7fa89415c900 2024-08-18T23:57:48.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.423+0000 7fa893fff640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa88006be60 0x7fa88006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.423+0000 7fa893fff640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa88006be60 0x7fa88006e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa884033000 tx=0x7fa884008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.427+0000 7fa890ff9640 1 -- 172.21.15.103:0/1746551586 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa88c059d90 con 0x7fa89415c900 2024-08-18T23:57:48.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.591+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8940b5e50 con 0x7fa89415c900 2024-08-18T23:57:48.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.593+0000 7fa890ff9640 1 -- 172.21.15.103:0/1746551586 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16991 (secure 0 0 0) 0x7fa88c059690 con 0x7fa89415c900 2024-08-18T23:57:48.594 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:48.594 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":37,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:57:47.319245+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:57:45.173057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T23:57:46.287913+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa88006be60 msgr2=0x7fa88006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa88006be60 0x7fa88006e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa884033000 tx=0x7fa884008030 comp rx=0 tx=0).stop 2024-08-18T23:57:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa89415c900 msgr2=0x7fa8940b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa89415c900 0x7fa8940b3ac0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa8940ce780 tx=0x7fa88c007b10 comp rx=0 tx=0).stop 2024-08-18T23:57:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 shutdown_connections 2024-08-18T23:57:48.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa88006be60 0x7fa88006e320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa89415c900 0x7fa8940b3ac0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa8940b6ed0 0x7fa89415d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 --2- 172.21.15.103:0/1746551586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87c0039b0 0x7fa8941f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 >> 172.21.15.103:0/1746551586 conn(0x7fa8940d40a0 msgr2=0x7fa89406d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 shutdown_connections 2024-08-18T23:57:48.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.595+0000 7fa89a561640 1 -- 172.21.15.103:0/1746551586 wait complete. 2024-08-18T23:57:48.607 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-18T23:57:48.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.707+0000 7fa10ef91640 1 Processor -- start 2024-08-18T23:57:48.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.707+0000 7fa10ef91640 1 -- start start 2024-08-18T23:57:48.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.707+0000 7fa10ef91640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1080b2e80 0x7fa1080cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10ef91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 0x7fa1080ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10ef91640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1080b33f0 con 0x7fa108161770 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10ef91640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa10806d420 con 0x7fa1080b2e80 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10ef91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa10806dcc0 con 0x7fa1080cc710 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10cd2d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa108161770 0x7fa1080ce740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42216/0 (socket says 172.21.15.103:42216) 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10cd2d640 1 -- 172.21.15.103:0/2254599230 learned_addr learned my addr 172.21.15.103:0/2254599230 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa107fff640 1 --2- 172.21.15.103:0/2254599230 >> v2:172.21.15.190:3300/0 conn(0x7fa1080b2e80 0x7fa1080cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10d52e640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 0x7fa1080ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732133276 0 0) 0x7fa1080b33f0 con 0x7fa108161770 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0f8003520 con 0x7fa108161770 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 710851998 0 0) 0x7fa0f8003520 con 0x7fa108161770 2024-08-18T23:57:48.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 msgr2=0x7fa1080ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 0x7fa1080ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 >> v2:172.21.15.190:3300/0 conn(0x7fa1080b2e80 msgr2=0x7fa1080cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 --2- 172.21.15.103:0/2254599230 >> v2:172.21.15.190:3300/0 conn(0x7fa1080b2e80 0x7fa1080cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10806d670 con 0x7fa108161770 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fa0fc001670 con 0x7fa108161770 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 >> v1:172.21.15.103:6789/0 conn(0x7fa108161770 legacy=0x7fa1080ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 0x7fa0f80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003f30 0x7fa0f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8004d40 0x7fa0f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa10806d420 con 0x7fa0f8003f30 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa10806dcc0 con 0x7fa0f8004d40 2024-08-18T23:57:48.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa0f800ba10 con 0x7fa1080cc710 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa107fff640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003f30 0x7fa0f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10d52e640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8004d40 0x7fa0f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.708+0000 7fa10cd2d640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 0x7fa0f80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa107fff640 1 -- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 msgr2=0x7fa0f80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa107fff640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 0x7fa0f80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa107fff640 1 -- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8004d40 msgr2=0x7fa0f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa107fff640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8004d40 0x7fa0f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa107fff640 1 -- 172.21.15.103:0/2254599230 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f8003520 con 0x7fa0f8003f30 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa10cd2d640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1080cc710 0x7fa0f80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa107fff640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003f30 0x7fa0f8004800 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009af0 tx=0x7fa0f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cda4f558db65d4c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4036070 con 0x7fa0f8003f30 2024-08-18T23:57:48.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0f4031400 con 0x7fa0f8003f30 2024-08-18T23:57:48.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.709+0000 7fa1077fe640 1 -- 172.21.15.103:0/2254599230 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4009690 con 0x7fa0f8003f30 2024-08-18T23:57:48.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.710+0000 7fa10ef91640 1 -- 172.21.15.103:0/2254599230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003f30 msgr2=0x7fa0f8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.710+0000 7fa10ef91640 1 --2- 172.21.15.103:0/2254599230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0f8003f30 0x7fa0f8004800 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4009af0 tx=0x7fa0f8005830 comp rx=0 tx=0).stop 2024-08-18T23:57:48.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.710+0000 7fa10d52e640 1 -- 172.21.15.103:0/2254599230 reap_dead start 2024-08-18T23:57:48.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.710+0000 7fa10ef91640 1 -- 172.21.15.103:0/2254599230 shutdown_connections 2024-08-18T23:57:48.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.710+0000 7fa10ef91640 1 -- 172.21.15.103:0/2254599230 >> 172.21.15.103:0/2254599230 conn(0x7fa1080d1ec0 msgr2=0x7fa1080d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:48.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.710+0000 7fa10ef91640 1 -- 172.21.15.103:0/2254599230 shutdown_connections 2024-08-18T23:57:48.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.710+0000 7fa10ef91640 1 -- 172.21.15.103:0/2254599230 wait complete. 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.711+0000 7fa10ef91640 1 Processor -- start 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.711+0000 7fa10ef91640 1 -- start start 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10ef91640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8003f30 0x7fa1080b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10ef91640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa10815b050 0x7fa1080b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10ef91640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1081546a0 0x7fa1080b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10ef91640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa108161cd0 con 0x7fa1081546a0 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10ef91640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa108161b50 con 0x7fa0f8003f30 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10ef91640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1080d12f0 con 0x7fa10815b050 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10d52e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1081546a0 0x7fa1080b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10d52e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1081546a0 0x7fa1080b5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36956/0 (socket says 172.21.15.103:36956) 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10d52e640 1 -- 172.21.15.103:0/2959800068 learned_addr learned my addr 172.21.15.103:0/2959800068 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa107fff640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa10815b050 0x7fa1080b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.712+0000 7fa10cd2d640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8003f30 0x7fa1080b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10d52e640 1 -- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa10815b050 msgr2=0x7fa1080b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10d52e640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa10815b050 0x7fa1080b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10d52e640 1 -- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8003f30 msgr2=0x7fa1080b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10d52e640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8003f30 0x7fa1080b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10d52e640 1 -- 172.21.15.103:0/2959800068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10815b4e0 con 0x7fa1081546a0 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10cd2d640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8003f30 0x7fa1080b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10d52e640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1081546a0 0x7fa1080b5cc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa1080694d0 tx=0x7fa10000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa1057fa640 1 -- 172.21.15.103:0/2959800068 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10000fce0 con 0x7fa1081546a0 2024-08-18T23:57:48.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa1057fa640 1 -- 172.21.15.103:0/2959800068 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10000fe80 con 0x7fa1081546a0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10815b7c0 con 0x7fa1081546a0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa1057fa640 1 -- 172.21.15.103:0/2959800068 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100015670 con 0x7fa1081546a0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.713+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1080c9fe0 con 0x7fa1081546a0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.714+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1080ce740 con 0x7fa1081546a0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.714+0000 7fa1057fa640 1 -- 172.21.15.103:0/2959800068 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa100015810 con 0x7fa1081546a0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.715+0000 7fa1057fa640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa0ec06be60 0x7fa0ec06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.715+0000 7fa1057fa640 1 -- 172.21.15.103:0/2959800068 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7fa10008bc90 con 0x7fa1081546a0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.715+0000 7fa10cd2d640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa0ec06be60 0x7fa0ec06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.715+0000 7fa10cd2d640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa0ec06be60 0x7fa0ec06e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa108160e80 tx=0x7fa0fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:48.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.719+0000 7fa1057fa640 1 -- 172.21.15.103:0/2959800068 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa100019030 con 0x7fa1081546a0 2024-08-18T23:57:48.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:48.918+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa1080d19e0 con 0x7fa1081546a0 2024-08-18T23:57:49.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.003+0000 7fa1057fa640 1 -- 172.21.15.103:0/2959800068 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7fa100010040 con 0x7fa1081546a0 2024-08-18T23:57:49.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.005+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa0ec06be60 msgr2=0x7fa0ec06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:49.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.005+0000 7fa10ef91640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa0ec06be60 0x7fa0ec06e320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa108160e80 tx=0x7fa0fc009040 comp rx=0 tx=0).stop 2024-08-18T23:57:49.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.005+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1081546a0 msgr2=0x7fa1080b5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:49.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.005+0000 7fa10ef91640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1081546a0 0x7fa1080b5cc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa1080694d0 tx=0x7fa10000f1b0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.006+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 shutdown_connections 2024-08-18T23:57:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.006+0000 7fa10ef91640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa0ec06be60 0x7fa0ec06e320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.006+0000 7fa10ef91640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1081546a0 0x7fa1080b5cc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.006+0000 7fa10ef91640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa10815b050 0x7fa1080b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.006+0000 7fa10ef91640 1 --2- 172.21.15.103:0/2959800068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa0f8003f30 0x7fa1080b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.006+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 >> 172.21.15.103:0/2959800068 conn(0x7fa1080d1ec0 msgr2=0x7fa1080ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.006+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 shutdown_connections 2024-08-18T23:57:49.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.006+0000 7fa10ef91640 1 -- 172.21.15.103:0/2959800068 wait complete. 2024-08-18T23:57:49.020 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-08-18T23:57:49.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-18T23:57:49.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.120+0000 7f366f0a8640 1 Processor -- start 2024-08-18T23:57:49.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.120+0000 7f366f0a8640 1 -- start start 2024-08-18T23:57:49.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.120+0000 7f366f0a8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f366815f5c0 0x7f36680ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:49.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.120+0000 7f366f0a8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f36680ceb90 0x7f36680cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:49.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f366f0a8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36680cdd60 con 0x7f36680cfa90 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f366f0a8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f36680d29e0 con 0x7f36680ceb90 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f366f0a8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f36680d2cc0 con 0x7f366815f5c0 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f365ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f36680ceb90 0x7f36680cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f365ffff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f36680ceb90 0x7f36680cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36964/0 (socket says 172.21.15.103:36964) 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f365ffff640 1 -- 172.21.15.103:0/1578127804 learned_addr learned my addr 172.21.15.103:0/1578127804 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f365ffff640 1 -- 172.21.15.103:0/1578127804 >> v2:172.21.15.190:3300/0 conn(0x7f366815f5c0 msgr2=0x7f36680ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f365ffff640 1 --2- 172.21.15.103:0/1578127804 >> v2:172.21.15.190:3300/0 conn(0x7f366815f5c0 0x7f36680ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f365ffff640 1 -- 172.21.15.103:0/1578127804 >> v1:172.21.15.103:6789/0 conn(0x7f36680cfa90 legacy=0x7f36680cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f365f7fe640 1 -- 172.21.15.103:0/1578127804 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734861817 0 0) 0x7f36680cdd60 con 0x7f36680cfa90 2024-08-18T23:57:49.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.121+0000 7f365ffff640 1 -- 172.21.15.103:0/1578127804 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36680cd4c0 con 0x7f36680ceb90 2024-08-18T23:57:49.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f365ffff640 1 --2- 172.21.15.103:0/1578127804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36680ceb90 0x7f36680cefd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f36680d0fa0 tx=0x7f365802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd775c2558bea38 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:49.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f365f7fe640 1 -- 172.21.15.103:0/1578127804 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658037070 con 0x7f36680ceb90 2024-08-18T23:57:49.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f365f7fe640 1 -- 172.21.15.103:0/1578127804 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365802ae50 con 0x7f36680ceb90 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f365f7fe640 1 -- 172.21.15.103:0/1578127804 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3658032860 con 0x7f36680ceb90 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f366f0a8640 1 -- 172.21.15.103:0/1578127804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36680ceb90 msgr2=0x7f36680cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f366f0a8640 1 --2- 172.21.15.103:0/1578127804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36680ceb90 0x7f36680cefd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f36680d0fa0 tx=0x7f365802a300 comp rx=0 tx=0).stop 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f366f0a8640 1 -- 172.21.15.103:0/1578127804 shutdown_connections 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f366f0a8640 1 --2- 172.21.15.103:0/1578127804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36680ceb90 0x7f36680cefd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f366f0a8640 1 --2- 172.21.15.103:0/1578127804 >> v2:172.21.15.190:3300/0 conn(0x7f366815f5c0 0x7f36680ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f366f0a8640 1 -- 172.21.15.103:0/1578127804 >> 172.21.15.103:0/1578127804 conn(0x7f36680d1ec0 msgr2=0x7f36680d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f366f0a8640 1 -- 172.21.15.103:0/1578127804 shutdown_connections 2024-08-18T23:57:49.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.122+0000 7f366f0a8640 1 -- 172.21.15.103:0/1578127804 wait complete. 2024-08-18T23:57:49.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.124+0000 7f366f0a8640 1 Processor -- start 2024-08-18T23:57:49.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.124+0000 7f366f0a8640 1 -- start start 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.124+0000 7f366f0a8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36680ceb90 0x7f36681f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.124+0000 7f366f0a8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36680cfa90 0x7f366809f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.124+0000 7f366f0a8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f366815f5c0 0x7f366809c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.124+0000 7f366f0a8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f366815f9a0 con 0x7f366815f5c0 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.124+0000 7f366f0a8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f36680cda80 con 0x7f36680ceb90 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.124+0000 7f366f0a8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f366815fb20 con 0x7f36680cfa90 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f366815f5c0 0x7f366809c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f366815f5c0 0x7f366809c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36978/0 (socket says 172.21.15.103:36978) 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 -- 172.21.15.103:0/585679599 learned_addr learned my addr 172.21.15.103:0/585679599 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366ce44640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36680ceb90 0x7f36681f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f365ffff640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36680cfa90 0x7f366809f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:49.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 -- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36680cfa90 msgr2=0x7f366809f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36680cfa90 0x7f366809f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 -- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36680ceb90 msgr2=0x7f36681f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36680ceb90 0x7f36681f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 -- 172.21.15.103:0/585679599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36680c90c0 con 0x7f366815f5c0 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366ce44640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36680ceb90 0x7f36681f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366d645640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f366815f5c0 0x7f366809c780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f366000c780 tx=0x7f366000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f365d7fa640 1 -- 172.21.15.103:0/585679599 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660003da0 con 0x7f366815f5c0 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f365d7fa640 1 -- 172.21.15.103:0/585679599 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366000ce30 con 0x7f366815f5c0 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36680c93a0 con 0x7f366815f5c0 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f365d7fa640 1 -- 172.21.15.103:0/585679599 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3660005290 con 0x7f366815f5c0 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.125+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36680c9960 con 0x7f366815f5c0 2024-08-18T23:57:49.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.126+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36680b4580 con 0x7f366815f5c0 2024-08-18T23:57:49.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.127+0000 7f365d7fa640 1 -- 172.21.15.103:0/585679599 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3660005430 con 0x7f366815f5c0 2024-08-18T23:57:49.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.127+0000 7f365d7fa640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f365406be30 0x7f365406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:49.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.127+0000 7f365d7fa640 1 -- 172.21.15.103:0/585679599 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f366008ae60 con 0x7f366815f5c0 2024-08-18T23:57:49.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.127+0000 7f366ce44640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f365406be30 0x7f365406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:49.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.128+0000 7f366ce44640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f365406be30 0x7f365406e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3664009890 tx=0x7f3664008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:49.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.131+0000 7f365d7fa640 1 -- 172.21.15.103:0/585679599 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3660059710 con 0x7f366815f5c0 2024-08-18T23:57:49.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:49.332+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f3668074510 con 0x7f366815f5c0 2024-08-18T23:57:50.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.005+0000 7f365d7fa640 1 -- 172.21.15.103:0/585679599 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f3660059010 con 0x7f366815f5c0 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f365406be30 msgr2=0x7f365406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f365406be30 0x7f365406e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3664009890 tx=0x7f3664008040 comp rx=0 tx=0).stop 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f366815f5c0 msgr2=0x7f366809c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f366815f5c0 0x7f366809c780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f366000c780 tx=0x7f366000cc40 comp rx=0 tx=0).stop 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 shutdown_connections 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f365406be30 0x7f365406e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f366815f5c0 0x7f366809c780 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36680cfa90 0x7f366809f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 --2- 172.21.15.103:0/585679599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36680ceb90 0x7f36681f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.007+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 >> 172.21.15.103:0/585679599 conn(0x7f36680d1ec0 msgr2=0x7f3668070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:50.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.008+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 shutdown_connections 2024-08-18T23:57:50.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.008+0000 7f366f0a8640 1 -- 172.21.15.103:0/585679599 wait complete. 2024-08-18T23:57:50.022 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-08-18T23:57:50.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:50.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.123+0000 7f760aa5c640 1 Processor -- start 2024-08-18T23:57:50.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.123+0000 7f760aa5c640 1 -- start start 2024-08-18T23:57:50.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f760aa5c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76041479e0 0x7f76040cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f760aa5c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7604073630 0x7f760406b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f760aa5c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f760406be40 0x7f7604161c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f760aa5c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f760406e6d0 con 0x7f760406be40 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f760aa5c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f760406c290 con 0x7f7604073630 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f760aa5c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7604147dc0 con 0x7f76041479e0 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7608ff9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f760406be40 0x7f7604161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7608ff9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f760406be40 0x7f7604161c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36994/0 (socket says 172.21.15.103:36994) 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7608ff9640 1 -- 172.21.15.103:0/2204596035 learned_addr learned my addr 172.21.15.103:0/2204596035 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7603fff640 1 --2- 172.21.15.103:0/2204596035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76041479e0 0x7f76040cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7608ff9640 1 -- 172.21.15.103:0/2204596035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76041479e0 msgr2=0x7f76040cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f76037fe640 1 --2- 172.21.15.103:0/2204596035 >> v2:172.21.15.190:3300/0 conn(0x7f7604073630 0x7f760406b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7608ff9640 1 --2- 172.21.15.103:0/2204596035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76041479e0 0x7f76040cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7608ff9640 1 -- 172.21.15.103:0/2204596035 >> v2:172.21.15.190:3300/0 conn(0x7f7604073630 msgr2=0x7f760406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:50.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7608ff9640 1 --2- 172.21.15.103:0/2204596035 >> v2:172.21.15.190:3300/0 conn(0x7f7604073630 0x7f760406b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7608ff9640 1 -- 172.21.15.103:0/2204596035 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76040cbd50 con 0x7f760406be40 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f7603fff640 1 --2- 172.21.15.103:0/2204596035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76041479e0 0x7f76040cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.124+0000 7f76037fe640 1 --2- 172.21.15.103:0/2204596035 >> v2:172.21.15.190:3300/0 conn(0x7f7604073630 0x7f760406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.125+0000 7f7608ff9640 1 --2- 172.21.15.103:0/2204596035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f760406be40 0x7f7604161c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7604072120 tx=0x7f75fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7141442b25ac8 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.125+0000 7f7602ffd640 1 -- 172.21.15.103:0/2204596035 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc036070 con 0x7f760406be40 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.125+0000 7f7602ffd640 1 -- 172.21.15.103:0/2204596035 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc031600 con 0x7f760406be40 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.125+0000 7f7602ffd640 1 -- 172.21.15.103:0/2204596035 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc0319d0 con 0x7f760406be40 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 -- 172.21.15.103:0/2204596035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f760406be40 msgr2=0x7f7604161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 --2- 172.21.15.103:0/2204596035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f760406be40 0x7f7604161c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7604072120 tx=0x7f75fc02a6a0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 -- 172.21.15.103:0/2204596035 shutdown_connections 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 --2- 172.21.15.103:0/2204596035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f760406be40 0x7f7604161c40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 --2- 172.21.15.103:0/2204596035 >> v2:172.21.15.190:3300/0 conn(0x7f7604073630 0x7f760406b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 --2- 172.21.15.103:0/2204596035 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76041479e0 0x7f76040cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 -- 172.21.15.103:0/2204596035 >> 172.21.15.103:0/2204596035 conn(0x7f76040cd7e0 msgr2=0x7f76040cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:50.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 -- 172.21.15.103:0/2204596035 shutdown_connections 2024-08-18T23:57:50.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.126+0000 7f760aa5c640 1 -- 172.21.15.103:0/2204596035 wait complete. 2024-08-18T23:57:50.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.127+0000 7f760aa5c640 1 Processor -- start 2024-08-18T23:57:50.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.127+0000 7f760aa5c640 1 -- start start 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f760aa5c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760406be40 0x7f76040c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f760aa5c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76041479e0 0x7f76040c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f760aa5c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76041e92f0 0x7f76040c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f760aa5c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f76040cf220 con 0x7f76041e92f0 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f760aa5c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f76040cef40 con 0x7f76041479e0 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f760aa5c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f76040cf500 con 0x7f760406be40 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7608ff9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76041e92f0 0x7f76040c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7608ff9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76041e92f0 0x7f76040c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37000/0 (socket says 172.21.15.103:37000) 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7608ff9640 1 -- 172.21.15.103:0/1771367158 learned_addr learned my addr 172.21.15.103:0/1771367158 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7603fff640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760406be40 0x7f76040c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f76037fe640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76041479e0 0x7f76040c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7608ff9640 1 -- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760406be40 msgr2=0x7f76040c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7608ff9640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760406be40 0x7f76040c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7608ff9640 1 -- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76041479e0 msgr2=0x7f76040c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7608ff9640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76041479e0 0x7f76040c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f7608ff9640 1 -- 172.21.15.103:0/1771367158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76040c62a0 con 0x7f76041e92f0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.128+0000 7f76037fe640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76041479e0 0x7f76040c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.129+0000 7f7608ff9640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76041e92f0 0x7f76040c7c40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009f40 tx=0x7f75fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.129+0000 7f7600ff9640 1 -- 172.21.15.103:0/1771367158 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc03f020 con 0x7f76041e92f0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.129+0000 7f7600ff9640 1 -- 172.21.15.103:0/1771367158 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75fc037040 con 0x7f76041e92f0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.129+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76040c6580 con 0x7f76041e92f0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.129+0000 7f7600ff9640 1 -- 172.21.15.103:0/1771367158 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc036070 con 0x7f76041e92f0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.129+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76040c6b40 con 0x7f76041e92f0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.130+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760406b900 con 0x7f76041e92f0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.130+0000 7f7600ff9640 1 -- 172.21.15.103:0/1771367158 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75fc042020 con 0x7f76041e92f0 2024-08-18T23:57:50.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.131+0000 7f7600ff9640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75f006be30 0x7f75f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.131+0000 7f7600ff9640 1 -- 172.21.15.103:0/1771367158 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f75fc0ab810 con 0x7f76041e92f0 2024-08-18T23:57:50.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.131+0000 7f7603fff640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75f006be30 0x7f75f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.131+0000 7f7603fff640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75f006be30 0x7f75f006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7604068c40 tx=0x7f75f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.135+0000 7f7600ff9640 1 -- 172.21.15.103:0/1771367158 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f75fc049020 con 0x7f76041e92f0 2024-08-18T23:57:50.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.335+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76040c5f50 con 0x7f76041e92f0 2024-08-18T23:57:50.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.335+0000 7f7600ff9640 1 -- 172.21.15.103:0/1771367158 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7f75fc07a0c0 con 0x7f76041e92f0 2024-08-18T23:57:50.337 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:50.337 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:57:47.319563+0000","modified":"2024-08-18T23:57:49.334110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/171106802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":171106802},{"type":"v1","addr":"172.21.15.103:6835","nonce":171106802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-08-18T23:57:50.337 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-08-18T23:57:50.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75f006be30 msgr2=0x7f75f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75f006be30 0x7f75f006e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7604068c40 tx=0x7f75f4008040 comp rx=0 tx=0).stop 2024-08-18T23:57:50.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76041e92f0 msgr2=0x7f76040c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76041e92f0 0x7f76040c7c40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009f40 tx=0x7f75fc004a40 comp rx=0 tx=0).stop 2024-08-18T23:57:50.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 shutdown_connections 2024-08-18T23:57:50.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f75f006be30 0x7f75f006e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76041e92f0 0x7f76040c7c40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76041479e0 0x7f76040c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 --2- 172.21.15.103:0/1771367158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f760406be40 0x7f76040c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 >> 172.21.15.103:0/1771367158 conn(0x7f76040cd7e0 msgr2=0x7f7604072700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:50.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 shutdown_connections 2024-08-18T23:57:50.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.337+0000 7f760aa5c640 1 -- 172.21.15.103:0/1771367158 wait complete. 2024-08-18T23:57:50.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:57:50.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.447+0000 7f5574e0a640 1 Processor -- start 2024-08-18T23:57:50.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.447+0000 7f5574e0a640 1 -- start start 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f5574e0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557015bdd0 0x7f55700afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f5574e0a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f55700700c0 0x7f557006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f5574e0a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f557015c5e0 con 0x7f557006ce50 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f5574e0a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f557015d3a0 con 0x7f55700700c0 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f5574e0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f557006d2a0 con 0x7f557015bdd0 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556ed9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f557006ce50 0x7f557015f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42232/0 (socket says 172.21.15.103:42232) 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556ed9d640 1 -- 172.21.15.103:0/3371613511 learned_addr learned my addr 172.21.15.103:0/3371613511 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820638359 0 0) 0x7f557015c5e0 con 0x7f557006ce50 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556dd9b640 1 --2- 172.21.15.103:0/3371613511 >> v2:172.21.15.190:3300/0 conn(0x7f55700700c0 0x7f557006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556e59c640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557015bdd0 0x7f55700afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5558003520 con 0x7f557006ce50 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4213935078 0 0) 0x7f5558003520 con 0x7f557006ce50 2024-08-18T23:57:50.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557015bdd0 msgr2=0x7f55700afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557015bdd0 0x7f55700afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 >> v2:172.21.15.190:3300/0 conn(0x7f55700700c0 msgr2=0x7f557006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 --2- 172.21.15.103:0/3371613511 >> v2:172.21.15.190:3300/0 conn(0x7f55700700c0 0x7f557006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f557015c8c0 con 0x7f557006ce50 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f55680019f0 con 0x7f557006ce50 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 >> v1:172.21.15.103:6789/0 conn(0x7f557006ce50 legacy=0x7f557015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557015bdd0 0x7f55580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5558003f30 0x7f5558004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5558004d40 0x7f55580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f557015d3a0 con 0x7f5558003f30 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f557006d2a0 con 0x7f5558004d40 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f555800b9c0 con 0x7f557015bdd0 2024-08-18T23:57:50.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.448+0000 7f556dd9b640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5558003f30 0x7f5558004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.449+0000 7f556e59c640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557015bdd0 0x7f55580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.449+0000 7f556ed9d640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5558004d40 0x7f55580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.449+0000 7f556dd9b640 1 -- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557015bdd0 msgr2=0x7f55580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.449+0000 7f556dd9b640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f557015bdd0 0x7f55580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.449+0000 7f556dd9b640 1 -- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5558004d40 msgr2=0x7f55580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.449+0000 7f556dd9b640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5558004d40 0x7f55580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.449+0000 7f556dd9b640 1 -- 172.21.15.103:0/3371613511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5558003520 con 0x7f5558003f30 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.449+0000 7f556dd9b640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5558003f30 0x7f5558004800 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5564009ac0 tx=0x7f5558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42dad15d4c8be4f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564036070 con 0x7f5558003f30 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5564031400 con 0x7f5558003f30 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f556d59a640 1 -- 172.21.15.103:0/3371613511 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564009690 con 0x7f5558003f30 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f5574e0a640 1 -- 172.21.15.103:0/3371613511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5558003f30 msgr2=0x7f5558004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f5574e0a640 1 --2- 172.21.15.103:0/3371613511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5558003f30 0x7f5558004800 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5564009ac0 tx=0x7f5558005830 comp rx=0 tx=0).stop 2024-08-18T23:57:50.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f556ed9d640 1 -- 172.21.15.103:0/3371613511 reap_dead start 2024-08-18T23:57:50.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f5574e0a640 1 -- 172.21.15.103:0/3371613511 shutdown_connections 2024-08-18T23:57:50.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f5574e0a640 1 -- 172.21.15.103:0/3371613511 >> 172.21.15.103:0/3371613511 conn(0x7f5570071f00 msgr2=0x7f5570072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:50.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f5574e0a640 1 -- 172.21.15.103:0/3371613511 shutdown_connections 2024-08-18T23:57:50.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.450+0000 7f5574e0a640 1 -- 172.21.15.103:0/3371613511 wait complete. 2024-08-18T23:57:50.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f5574e0a640 1 Processor -- start 2024-08-18T23:57:50.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f5574e0a640 1 -- start start 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f5574e0a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5558003f30 0x7f55700b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f5574e0a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5570154140 0x7f557014c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f5574e0a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55700ae370 0x7f55700ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f5574e0a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5570070500 con 0x7f5570154140 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f5574e0a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f557015ce80 con 0x7f55700ae370 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f5574e0a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5570070680 con 0x7f5558003f30 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f556dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5570154140 0x7f557014c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f556dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5570154140 0x7f557014c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37022/0 (socket says 172.21.15.103:37022) 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.452+0000 7f556dd9b640 1 -- 172.21.15.103:0/4261946867 learned_addr learned my addr 172.21.15.103:0/4261946867 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f556e59c640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5558003f30 0x7f55700b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f556ed9d640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55700ae370 0x7f55700ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f556dd9b640 1 -- 172.21.15.103:0/4261946867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5558003f30 msgr2=0x7f55700b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f556dd9b640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5558003f30 0x7f55700b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f556dd9b640 1 -- 172.21.15.103:0/4261946867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55700ae370 msgr2=0x7f55700ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f556dd9b640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55700ae370 0x7f55700ae7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f556dd9b640 1 -- 172.21.15.103:0/4261946867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55700adbe0 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f556dd9b640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5570154140 0x7f557014c020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5564034040 tx=0x7f5564004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f555effd640 1 -- 172.21.15.103:0/4261946867 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564040020 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f555effd640 1 -- 172.21.15.103:0/4261946867 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5564003c60 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55700b1730 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f555effd640 1 -- 172.21.15.103:0/4261946867 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5564036040 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.453+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557006dee0 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.454+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f557015c1b0 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.454+0000 7f555effd640 1 -- 172.21.15.103:0/4261946867 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5564043020 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.455+0000 7f555effd640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f555006be60 0x7f555006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.455+0000 7f555effd640 1 -- 172.21.15.103:0/4261946867 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f55640aaf90 con 0x7f5570154140 2024-08-18T23:57:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.455+0000 7f556e59c640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f555006be60 0x7f555006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.455+0000 7f556e59c640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f555006be60 0x7f555006e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5560009ae0 tx=0x7f5560009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.459+0000 7f555effd640 1 -- 172.21.15.103:0/4261946867 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f556404a070 con 0x7f5570154140 2024-08-18T23:57:50.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.627+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55700cc7f0 con 0x7f5570154140 2024-08-18T23:57:50.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.628+0000 7f555effd640 1 -- 172.21.15.103:0/4261946867 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16978 (secure 0 0 0) 0x7f55640044e0 con 0x7f5570154140 2024-08-18T23:57:50.630 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:50.630 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":38,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:57:48.998109+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:57:45.173057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T23:57:46.287913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:57:50.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f555006be60 msgr2=0x7f555006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f555006be60 0x7f555006e320 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5560009ae0 tx=0x7f5560009190 comp rx=0 tx=0).stop 2024-08-18T23:57:50.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5570154140 msgr2=0x7f557014c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5570154140 0x7f557014c020 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5564034040 tx=0x7f5564004730 comp rx=0 tx=0).stop 2024-08-18T23:57:50.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 shutdown_connections 2024-08-18T23:57:50.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f555006be60 0x7f555006e320 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55700ae370 0x7f55700ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5570154140 0x7f557014c020 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 --2- 172.21.15.103:0/4261946867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5558003f30 0x7f55700b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 >> 172.21.15.103:0/4261946867 conn(0x7f5570071f00 msgr2=0x7f5570156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 shutdown_connections 2024-08-18T23:57:50.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.630+0000 7f5574e0a640 1 -- 172.21.15.103:0/4261946867 wait complete. 2024-08-18T23:57:50.643 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T23:57:50.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:50.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.740+0000 7f5ee5b05640 1 Processor -- start 2024-08-18T23:57:50.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.740+0000 7f5ee5b05640 1 -- start start 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5ee5b05640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ee009b090 0x7f5ee00b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5ee5b05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee00b4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5ee5b05640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee00d0900 con 0x7f5ee009acb0 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5ee5b05640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee00d1090 con 0x7f5ee009b090 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5ee5b05640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee00b2bd0 con 0x7f5ee01619f0 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5edeffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ee009b090 0x7f5ee00b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5edeffd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ee009b090 0x7f5ee00b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37024/0 (socket says 172.21.15.103:37024) 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5edeffd640 1 -- 172.21.15.103:0/1614577866 learned_addr learned my addr 172.21.15.103:0/1614577866 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5edffff640 1 --2- 172.21.15.103:0/1614577866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee00b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5edeffd640 1 -- 172.21.15.103:0/1614577866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 msgr2=0x7f5ee00b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5edeffd640 1 --2- 172.21.15.103:0/1614577866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee00b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5edeffd640 1 -- 172.21.15.103:0/1614577866 >> v1:172.21.15.190:6789/0 conn(0x7f5ee009acb0 legacy=0x7f5ee01612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.741+0000 7f5edeffd640 1 -- 172.21.15.103:0/1614577866 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee00b2eb0 con 0x7f5ee009b090 2024-08-18T23:57:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.742+0000 7f5edeffd640 1 --2- 172.21.15.103:0/1614577866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009b090 0x7f5ee00b35d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009870 tx=0x7f5ed402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752c94692ed6a36f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.742+0000 7f5ede7fc640 1 -- 172.21.15.103:0/1614577866 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4037070 con 0x7f5ee009b090 2024-08-18T23:57:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.742+0000 7f5ede7fc640 1 -- 172.21.15.103:0/1614577866 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed4032440 con 0x7f5ee009b090 2024-08-18T23:57:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.742+0000 7f5ede7fc640 1 -- 172.21.15.103:0/1614577866 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4032810 con 0x7f5ee009b090 2024-08-18T23:57:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.743+0000 7f5ee5b05640 1 -- 172.21.15.103:0/1614577866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009b090 msgr2=0x7f5ee00b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.743+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/1614577866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009b090 0x7f5ee00b35d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009870 tx=0x7f5ed402a1c0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.743+0000 7f5ee5b05640 1 -- 172.21.15.103:0/1614577866 shutdown_connections 2024-08-18T23:57:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.743+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/1614577866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee00b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.743+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/1614577866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009b090 0x7f5ee00b35d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.743+0000 7f5ee5b05640 1 -- 172.21.15.103:0/1614577866 >> 172.21.15.103:0/1614577866 conn(0x7f5ee00b3b20 msgr2=0x7f5ee00b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.743+0000 7f5ee5b05640 1 -- 172.21.15.103:0/1614577866 shutdown_connections 2024-08-18T23:57:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.743+0000 7f5ee5b05640 1 -- 172.21.15.103:0/1614577866 wait complete. 2024-08-18T23:57:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.744+0000 7f5ee5b05640 1 Processor -- start 2024-08-18T23:57:50.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.744+0000 7f5ee5b05640 1 -- start start 2024-08-18T23:57:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ee5b05640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009acb0 0x7f5ee00cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ee5b05640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ee009b090 0x7f5ee00cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ee5b05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee015f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ee5b05640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee006d0f0 con 0x7f5ee009acb0 2024-08-18T23:57:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ee5b05640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee00b3190 con 0x7f5ee009b090 2024-08-18T23:57:50.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ee5b05640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee006d270 con 0x7f5ee01619f0 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009acb0 0x7f5ee00cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009acb0 0x7f5ee00cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37032/0 (socket says 172.21.15.103:37032) 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 -- 172.21.15.103:0/2344721363 learned_addr learned my addr 172.21.15.103:0/2344721363 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edeffd640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ee009b090 0x7f5ee00cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edffff640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 -- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 msgr2=0x7f5ee015f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee015f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 -- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ee009b090 msgr2=0x7f5ee00cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ee009b090 0x7f5ee00cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 -- 172.21.15.103:0/2344721363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee00b1de0 con 0x7f5ee009acb0 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edffff640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee015f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5edf7fe640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009acb0 0x7f5ee00cc260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c400 tx=0x7f5ed000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ec7fff640 1 -- 172.21.15.103:0/2344721363 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00052d0 con 0x7f5ee009acb0 2024-08-18T23:57:50.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ec7fff640 1 -- 172.21.15.103:0/2344721363 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed0005490 con 0x7f5ee009acb0 2024-08-18T23:57:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee00ceac0 con 0x7f5ee009acb0 2024-08-18T23:57:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.745+0000 7f5ec7fff640 1 -- 172.21.15.103:0/2344721363 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0007260 con 0x7f5ee009acb0 2024-08-18T23:57:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.746+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee00cf080 con 0x7f5ee009acb0 2024-08-18T23:57:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.747+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee00b4640 con 0x7f5ee009acb0 2024-08-18T23:57:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.747+0000 7f5ec7fff640 1 -- 172.21.15.103:0/2344721363 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5ed0007400 con 0x7f5ee009acb0 2024-08-18T23:57:50.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.747+0000 7f5ec7fff640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ecc06be30 0x7f5ecc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:50.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.748+0000 7f5ec7fff640 1 -- 172.21.15.103:0/2344721363 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f5ed008a3f0 con 0x7f5ee009acb0 2024-08-18T23:57:50.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.748+0000 7f5edeffd640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ecc06be30 0x7f5ecc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:50.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.748+0000 7f5edeffd640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ecc06be30 0x7f5ecc06e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4034000 tx=0x7f5ed402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:50.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.752+0000 7f5ec7fff640 1 -- 172.21.15.103:0/2344721363 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5ee00b1de0 con 0x7f5ee009acb0 2024-08-18T23:57:50.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.914+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ee0069070 con 0x7f5ecc06be30 2024-08-18T23:57:50.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.920+0000 7f5ec7fff640 1 -- 172.21.15.103:0/2344721363 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246634 (secure 0 0 0) 0x7f5ee0069070 con 0x7f5ecc06be30 2024-08-18T23:57:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:50.926 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ecc06be30 msgr2=0x7f5ecc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ecc06be30 0x7f5ecc06e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4034000 tx=0x7f5ed402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009acb0 msgr2=0x7f5ee00cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009acb0 0x7f5ee00cc260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000c400 tx=0x7f5ed000c8c0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 shutdown_connections 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5ecc06be30 0x7f5ecc06e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ee01619f0 0x7f5ee015f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ee009b090 0x7f5ee00cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 --2- 172.21.15.103:0/2344721363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ee009acb0 0x7f5ee00cc260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 >> 172.21.15.103:0/2344721363 conn(0x7f5ee00b3b20 msgr2=0x7f5ee006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 shutdown_connections 2024-08-18T23:57:50.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:50.923+0000 7f5ee5b05640 1 -- 172.21.15.103:0/2344721363 wait complete. 2024-08-18T23:57:50.935 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-08-18T23:57:50.176750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220472,"kb_used_data":4308,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754248,"statfs":{"total":773094113280,"available":772868349952,"internally_reserved":0,"allocated":4411392,"data_stored":2544779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.214056"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975424+0000","last_change":"2024-08-18T23:57:46.975424+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975424+0000","last_undegraded":"2024-08-18T23:57:46.975424+0000","last_fullsized":"2024-08-18T23:57:46.975424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974932+0000","last_change":"2024-08-18T23:57:46.974932+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974932+0000","last_undegraded":"2024-08-18T23:57:46.974932+0000","last_fullsized":"2024-08-18T23:57:46.974932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976316+0000","last_change":"2024-08-18T23:57:46.976316+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976316+0000","last_undegraded":"2024-08-18T23:57:46.976316+0000","last_fullsized":"2024-08-18T23:57:46.976316+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969632+0000","last_change":"2024-08-18T23:57:46.969632+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969632+0000","last_undegraded":"2024-08-18T23:57:46.969632+0000","last_fullsized":"2024-08-18T23:57:46.969632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968772+0000","last_change":"2024-08-18T23:57:46.968772+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968772+0000","last_undegraded":"2024-08-18T23:57:46.968772+0000","last_fullsized":"2024-08-18T23:57:46.968772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979418+0000","last_change":"2024-08-18T23:57:46.979418+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979418+0000","last_undegraded":"2024-08-18T23:57:46.979418+0000","last_fullsized":"2024-08-18T23:57:46.979418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978627+0000","last_change":"2024-08-18T23:57:46.978627+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978627+0000","last_undegraded":"2024-08-18T23:57:46.978627+0000","last_fullsized":"2024-08-18T23:57:46.978627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974470+0000","last_change":"2024-08-18T23:57:46.974470+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974470+0000","last_undegraded":"2024-08-18T23:57:46.974470+0000","last_fullsized":"2024-08-18T23:57:46.974470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975835+0000","last_change":"2024-08-18T23:57:46.975835+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975835+0000","last_undegraded":"2024-08-18T23:57:46.975835+0000","last_fullsized":"2024-08-18T23:57:46.975835+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978765+0000","last_change":"2024-08-18T23:57:46.978765+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978765+0000","last_undegraded":"2024-08-18T23:57:46.978765+0000","last_fullsized":"2024-08-18T23:57:46.978765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979680+0000","last_change":"2024-08-18T23:57:46.979680+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979680+0000","last_undegraded":"2024-08-18T23:57:46.979680+0000","last_fullsized":"2024-08-18T23:57:46.979680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973067+0000","last_change":"2024-08-18T23:57:46.973067+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973067+0000","last_undegraded":"2024-08-18T23:57:46.973067+0000","last_fullsized":"2024-08-18T23:57:46.973067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974604+0000","last_change":"2024-08-18T23:57:46.974604+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974604+0000","last_undegraded":"2024-08-18T23:57:46.974604+0000","last_fullsized":"2024-08-18T23:57:46.974604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975826+0000","last_change":"2024-08-18T23:57:46.975826+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975826+0000","last_undegraded":"2024-08-18T23:57:46.975826+0000","last_fullsized":"2024-08-18T23:57:46.975826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.977827+0000","last_change":"2024-08-18T23:57:46.977827+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.977827+0000","last_undegraded":"2024-08-18T23:57:46.977827+0000","last_fullsized":"2024-08-18T23:57:46.977827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973170+0000","last_change":"2024-08-18T23:57:46.973170+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973170+0000","last_undegraded":"2024-08-18T23:57:46.973170+0000","last_fullsized":"2024-08-18T23:57:46.973170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971981+0000","last_change":"2024-08-18T23:57:46.971981+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971981+0000","last_undegraded":"2024-08-18T23:57:46.971981+0000","last_fullsized":"2024-08-18T23:57:46.971981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968145+0000","last_change":"2024-08-18T23:57:46.968145+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968145+0000","last_undegraded":"2024-08-18T23:57:46.968145+0000","last_fullsized":"2024-08-18T23:57:46.968145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969033+0000","last_change":"2024-08-18T23:57:46.969033+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969033+0000","last_undegraded":"2024-08-18T23:57:46.969033+0000","last_fullsized":"2024-08-18T23:57:46.969033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968289+0000","last_change":"2024-08-18T23:57:46.968289+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968289+0000","last_undegraded":"2024-08-18T23:57:46.968289+0000","last_fullsized":"2024-08-18T23:57:46.968289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974058+0000","last_change":"2024-08-18T23:57:46.974058+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974058+0000","last_undegraded":"2024-08-18T23:57:46.974058+0000","last_fullsized":"2024-08-18T23:57:46.974058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975380+0000","last_change":"2024-08-18T23:57:46.975380+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975380+0000","last_undegraded":"2024-08-18T23:57:46.975380+0000","last_fullsized":"2024-08-18T23:57:46.975380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972537+0000","last_change":"2024-08-18T23:57:46.972537+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972537+0000","last_undegraded":"2024-08-18T23:57:46.972537+0000","last_fullsized":"2024-08-18T23:57:46.972537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968636+0000","last_change":"2024-08-18T23:57:46.968636+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968636+0000","last_undegraded":"2024-08-18T23:57:46.968636+0000","last_fullsized":"2024-08-18T23:57:46.968636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968350+0000","last_change":"2024-08-18T23:57:46.968350+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968350+0000","last_undegraded":"2024-08-18T23:57:46.968350+0000","last_fullsized":"2024-08-18T23:57:46.968350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978705+0000","last_change":"2024-08-18T23:57:46.978705+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978705+0000","last_undegraded":"2024-08-18T23:57:46.978705+0000","last_fullsized":"2024-08-18T23:57:46.978705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969021+0000","last_change":"2024-08-18T23:57:46.969021+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969021+0000","last_undegraded":"2024-08-18T23:57:46.969021+0000","last_fullsized":"2024-08-18T23:57:46.969021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974982+0000","last_change":"2024-08-18T23:57:46.974982+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974982+0000","last_undegraded":"2024-08-18T23:57:46.974982+0000","last_fullsized":"2024-08-18T23:57:46.974982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968755+0000","last_change":"2024-08-18T23:57:46.968755+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968755+0000","last_undegraded":"2024-08-18T23:57:46.968755+0000","last_fullsized":"2024-08-18T23:57:46.968755+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.967950+0000","last_change":"2024-08-18T23:57:46.967950+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.967950+0000","last_undegraded":"2024-08-18T23:57:46.967950+0000","last_fullsized":"2024-08-18T23:57:46.967950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971645+0000","last_change":"2024-08-18T23:57:46.971645+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971645+0000","last_undegraded":"2024-08-18T23:57:46.971645+0000","last_fullsized":"2024-08-18T23:57:46.971645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978675+0000","last_change":"2024-08-18T23:57:46.978675+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978675+0000","last_undegraded":"2024-08-18T23:57:46.978675+0000","last_fullsized":"2024-08-18T23:57:46.978675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972949+0000","last_change":"2024-08-18T23:57:46.972949+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972949+0000","last_undegraded":"2024-08-18T23:57:46.972949+0000","last_fullsized":"2024-08-18T23:57:46.972949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981304+0000","last_change":"2024-08-18T23:57:46.978262+0000","last_active":"2024-08-18T23:57:46.981304+0000","last_peered":"2024-08-18T23:57:46.981304+0000","last_clean":"2024-08-18T23:57:46.981304+0000","last_became_active":"2024-08-18T23:57:46.977521+0000","last_became_peered":"2024-08-18T23:57:46.977521+0000","last_unstale":"2024-08-18T23:57:46.981304+0000","last_undegraded":"2024-08-18T23:57:46.981304+0000","last_fullsized":"2024-08-18T23:57:46.981304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975878+0000","last_change":"2024-08-18T23:57:46.975878+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975878+0000","last_undegraded":"2024-08-18T23:57:46.975878+0000","last_fullsized":"2024-08-18T23:57:46.975878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988135+0000","last_change":"2024-08-18T23:57:46.986870+0000","last_active":"2024-08-18T23:57:46.988135+0000","last_peered":"2024-08-18T23:57:46.988135+0000","last_clean":"2024-08-18T23:57:46.988135+0000","last_became_active":"2024-08-18T23:57:46.986630+0000","last_became_peered":"2024-08-18T23:57:46.986630+0000","last_unstale":"2024-08-18T23:57:46.988135+0000","last_undegraded":"2024-08-18T23:57:46.988135+0000","last_fullsized":"2024-08-18T23:57:46.988135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976097+0000","last_change":"2024-08-18T23:57:46.976097+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976097+0000","last_undegraded":"2024-08-18T23:57:46.976097+0000","last_fullsized":"2024-08-18T23:57:46.976097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988243+0000","last_change":"2024-08-18T23:57:46.986467+0000","last_active":"2024-08-18T23:57:46.988243+0000","last_peered":"2024-08-18T23:57:46.988243+0000","last_clean":"2024-08-18T23:57:46.988243+0000","last_became_active":"2024-08-18T23:57:46.986141+0000","last_became_peered":"2024-08-18T23:57:46.986141+0000","last_unstale":"2024-08-18T23:57:46.988243+0000","last_undegraded":"2024-08-18T23:57:46.988243+0000","last_fullsized":"2024-08-18T23:57:46.988243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974099+0000","last_change":"2024-08-18T23:57:46.974099+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974099+0000","last_undegraded":"2024-08-18T23:57:46.974099+0000","last_fullsized":"2024-08-18T23:57:46.974099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985100+0000","last_change":"2024-08-18T23:57:46.977433+0000","last_active":"2024-08-18T23:57:46.985100+0000","last_peered":"2024-08-18T23:57:46.985100+0000","last_clean":"2024-08-18T23:57:46.985100+0000","last_became_active":"2024-08-18T23:57:46.977134+0000","last_became_peered":"2024-08-18T23:57:46.977134+0000","last_unstale":"2024-08-18T23:57:46.985100+0000","last_undegraded":"2024-08-18T23:57:46.985100+0000","last_fullsized":"2024-08-18T23:57:46.985100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:35.309577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973061+0000","last_change":"2024-08-18T23:57:46.973061+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973061+0000","last_undegraded":"2024-08-18T23:57:46.973061+0000","last_fullsized":"2024-08-18T23:57:46.973061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988552+0000","last_change":"2024-08-18T23:57:46.986008+0000","last_active":"2024-08-18T23:57:46.988552+0000","last_peered":"2024-08-18T23:57:46.988552+0000","last_clean":"2024-08-18T23:57:46.988552+0000","last_became_active":"2024-08-18T23:57:46.984486+0000","last_became_peered":"2024-08-18T23:57:46.984486+0000","last_unstale":"2024-08-18T23:57:46.988552+0000","last_undegraded":"2024-08-18T23:57:46.988552+0000","last_fullsized":"2024-08-18T23:57:46.988552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:49:36.222131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973927+0000","last_change":"2024-08-18T23:57:46.973927+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973927+0000","last_undegraded":"2024-08-18T23:57:46.973927+0000","last_fullsized":"2024-08-18T23:57:46.973927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.989184+0000","last_change":"2024-08-18T23:57:46.986931+0000","last_active":"2024-08-18T23:57:46.989184+0000","last_peered":"2024-08-18T23:57:46.989184+0000","last_clean":"2024-08-18T23:57:46.989184+0000","last_became_active":"2024-08-18T23:57:46.986652+0000","last_became_peered":"2024-08-18T23:57:46.986652+0000","last_unstale":"2024-08-18T23:57:46.989184+0000","last_undegraded":"2024-08-18T23:57:46.989184+0000","last_fullsized":"2024-08-18T23:57:46.989184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974753+0000","last_change":"2024-08-18T23:57:46.974753+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974753+0000","last_undegraded":"2024-08-18T23:57:46.974753+0000","last_fullsized":"2024-08-18T23:57:46.974753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988258+0000","last_change":"2024-08-18T23:57:46.986792+0000","last_active":"2024-08-18T23:57:46.988258+0000","last_peered":"2024-08-18T23:57:46.988258+0000","last_clean":"2024-08-18T23:57:46.988258+0000","last_became_active":"2024-08-18T23:57:46.986493+0000","last_became_peered":"2024-08-18T23:57:46.986493+0000","last_unstale":"2024-08-18T23:57:46.988258+0000","last_undegraded":"2024-08-18T23:57:46.988258+0000","last_fullsized":"2024-08-18T23:57:46.988258+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976139+0000","last_change":"2024-08-18T23:57:46.976139+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976139+0000","last_undegraded":"2024-08-18T23:57:46.976139+0000","last_fullsized":"2024-08-18T23:57:46.976139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985654+0000","last_change":"2024-08-18T23:57:46.982717+0000","last_active":"2024-08-18T23:57:46.985654+0000","last_peered":"2024-08-18T23:57:46.985654+0000","last_clean":"2024-08-18T23:57:46.985654+0000","last_became_active":"2024-08-18T23:57:46.982435+0000","last_became_peered":"2024-08-18T23:57:46.982435+0000","last_unstale":"2024-08-18T23:57:46.985654+0000","last_undegraded":"2024-08-18T23:57:46.985654+0000","last_fullsized":"2024-08-18T23:57:46.985654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968931+0000","last_change":"2024-08-18T23:57:46.968931+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968931+0000","last_undegraded":"2024-08-18T23:57:46.968931+0000","last_fullsized":"2024-08-18T23:57:46.968931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.984834+0000","last_change":"2024-08-18T23:57:46.981068+0000","last_active":"2024-08-18T23:57:46.984834+0000","last_peered":"2024-08-18T23:57:46.984834+0000","last_clean":"2024-08-18T23:57:46.984834+0000","last_became_active":"2024-08-18T23:57:46.980803+0000","last_became_peered":"2024-08-18T23:57:46.980803+0000","last_unstale":"2024-08-18T23:57:46.984834+0000","last_undegraded":"2024-08-18T23:57:46.984834+0000","last_fullsized":"2024-08-18T23:57:46.984834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:47.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975770+0000","last_change":"2024-08-18T23:57:46.975770+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975770+0000","last_undegraded":"2024-08-18T23:57:46.975770+0000","last_fullsized":"2024-08-18T23:57:46.975770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987348+0000","last_change":"2024-08-18T23:57:46.982223+0000","last_active":"2024-08-18T23:57:46.987348+0000","last_peered":"2024-08-18T23:57:46.987348+0000","last_clean":"2024-08-18T23:57:46.987348+0000","last_became_active":"2024-08-18T23:57:46.981942+0000","last_became_peered":"2024-08-18T23:57:46.981942+0000","last_unstale":"2024-08-18T23:57:46.987348+0000","last_undegraded":"2024-08-18T23:57:46.987348+0000","last_fullsized":"2024-08-18T23:57:46.987348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972174+0000","last_change":"2024-08-18T23:57:46.972174+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972174+0000","last_undegraded":"2024-08-18T23:57:46.972174+0000","last_fullsized":"2024-08-18T23:57:46.972174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987965+0000","last_change":"2024-08-18T23:57:46.984581+0000","last_active":"2024-08-18T23:57:46.987965+0000","last_peered":"2024-08-18T23:57:46.987965+0000","last_clean":"2024-08-18T23:57:46.987965+0000","last_became_active":"2024-08-18T23:57:46.984283+0000","last_became_peered":"2024-08-18T23:57:46.984283+0000","last_unstale":"2024-08-18T23:57:46.987965+0000","last_undegraded":"2024-08-18T23:57:46.987965+0000","last_fullsized":"2024-08-18T23:57:46.987965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974066+0000","last_change":"2024-08-18T23:57:46.974066+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974066+0000","last_undegraded":"2024-08-18T23:57:46.974066+0000","last_fullsized":"2024-08-18T23:57:46.974066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985069+0000","last_change":"2024-08-18T23:57:46.979935+0000","last_active":"2024-08-18T23:57:46.985069+0000","last_peered":"2024-08-18T23:57:46.985069+0000","last_clean":"2024-08-18T23:57:46.985069+0000","last_became_active":"2024-08-18T23:57:46.979515+0000","last_became_peered":"2024-08-18T23:57:46.979515+0000","last_unstale":"2024-08-18T23:57:46.985069+0000","last_undegraded":"2024-08-18T23:57:46.985069+0000","last_fullsized":"2024-08-18T23:57:46.985069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:54:29.031353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972538+0000","last_change":"2024-08-18T23:57:46.972538+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972538+0000","last_undegraded":"2024-08-18T23:57:46.972538+0000","last_fullsized":"2024-08-18T23:57:46.972538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979304+0000","last_change":"2024-08-18T23:57:46.976894+0000","last_active":"2024-08-18T23:57:46.979304+0000","last_peered":"2024-08-18T23:57:46.979304+0000","last_clean":"2024-08-18T23:57:46.979304+0000","last_became_active":"2024-08-18T23:57:46.976632+0000","last_became_peered":"2024-08-18T23:57:46.976632+0000","last_unstale":"2024-08-18T23:57:46.979304+0000","last_undegraded":"2024-08-18T23:57:46.979304+0000","last_fullsized":"2024-08-18T23:57:46.979304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:21.950504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973663+0000","last_change":"2024-08-18T23:57:46.973663+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973663+0000","last_undegraded":"2024-08-18T23:57:46.973663+0000","last_fullsized":"2024-08-18T23:57:46.973663+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.995773+0000","last_change":"2024-08-18T23:57:46.988097+0000","last_active":"2024-08-18T23:57:46.995773+0000","last_peered":"2024-08-18T23:57:46.995773+0000","last_clean":"2024-08-18T23:57:46.995773+0000","last_became_active":"2024-08-18T23:57:46.987806+0000","last_became_peered":"2024-08-18T23:57:46.987806+0000","last_unstale":"2024-08-18T23:57:46.995773+0000","last_undegraded":"2024-08-18T23:57:46.995773+0000","last_fullsized":"2024-08-18T23:57:46.995773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972239+0000","last_change":"2024-08-18T23:57:46.972239+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972239+0000","last_undegraded":"2024-08-18T23:57:46.972239+0000","last_fullsized":"2024-08-18T23:57:46.972239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.978114+0000","last_change":"2024-08-18T23:57:46.974889+0000","last_active":"2024-08-18T23:57:46.978114+0000","last_peered":"2024-08-18T23:57:46.978114+0000","last_clean":"2024-08-18T23:57:46.978114+0000","last_became_active":"2024-08-18T23:57:46.974493+0000","last_became_peered":"2024-08-18T23:57:46.974493+0000","last_unstale":"2024-08-18T23:57:46.978114+0000","last_undegraded":"2024-08-18T23:57:46.978114+0000","last_fullsized":"2024-08-18T23:57:46.978114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975683+0000","last_change":"2024-08-18T23:57:46.975683+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975683+0000","last_undegraded":"2024-08-18T23:57:46.975683+0000","last_fullsized":"2024-08-18T23:57:46.975683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987984+0000","last_change":"2024-08-18T23:57:46.986352+0000","last_active":"2024-08-18T23:57:46.987984+0000","last_peered":"2024-08-18T23:57:46.987984+0000","last_clean":"2024-08-18T23:57:46.987984+0000","last_became_active":"2024-08-18T23:57:46.986080+0000","last_became_peered":"2024-08-18T23:57:46.986080+0000","last_unstale":"2024-08-18T23:57:46.987984+0000","last_undegraded":"2024-08-18T23:57:46.987984+0000","last_fullsized":"2024-08-18T23:57:46.987984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974081+0000","last_change":"2024-08-18T23:57:46.974081+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974081+0000","last_undegraded":"2024-08-18T23:57:46.974081+0000","last_fullsized":"2024-08-18T23:57:46.974081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988103+0000","last_change":"2024-08-18T23:57:46.986782+0000","last_active":"2024-08-18T23:57:46.988103+0000","last_peered":"2024-08-18T23:57:46.988103+0000","last_clean":"2024-08-18T23:57:46.988103+0000","last_became_active":"2024-08-18T23:57:46.986512+0000","last_became_peered":"2024-08-18T23:57:46.986512+0000","last_unstale":"2024-08-18T23:57:46.988103+0000","last_undegraded":"2024-08-18T23:57:46.988103+0000","last_fullsized":"2024-08-18T23:57:46.988103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:54:49.793571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979212+0000","last_change":"2024-08-18T23:57:46.979212+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979212+0000","last_undegraded":"2024-08-18T23:57:46.979212+0000","last_fullsized":"2024-08-18T23:57:46.979212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985529+0000","last_change":"2024-08-18T23:57:46.980792+0000","last_active":"2024-08-18T23:57:46.985529+0000","last_peered":"2024-08-18T23:57:46.985529+0000","last_clean":"2024-08-18T23:57:46.985529+0000","last_became_active":"2024-08-18T23:57:46.980487+0000","last_became_peered":"2024-08-18T23:57:46.980487+0000","last_unstale":"2024-08-18T23:57:46.985529+0000","last_undegraded":"2024-08-18T23:57:46.985529+0000","last_fullsized":"2024-08-18T23:57:46.985529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:43.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973569+0000","last_change":"2024-08-18T23:57:46.973569+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973569+0000","last_undegraded":"2024-08-18T23:57:46.973569+0000","last_fullsized":"2024-08-18T23:57:46.973569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987283+0000","last_change":"2024-08-18T23:57:46.980654+0000","last_active":"2024-08-18T23:57:46.987283+0000","last_peered":"2024-08-18T23:57:46.987283+0000","last_clean":"2024-08-18T23:57:46.987283+0000","last_became_active":"2024-08-18T23:57:46.980406+0000","last_became_peered":"2024-08-18T23:57:46.980406+0000","last_unstale":"2024-08-18T23:57:46.987283+0000","last_undegraded":"2024-08-18T23:57:46.987283+0000","last_fullsized":"2024-08-18T23:57:46.987283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.626751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968921+0000","last_change":"2024-08-18T23:57:46.968921+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968921+0000","last_undegraded":"2024-08-18T23:57:46.968921+0000","last_fullsized":"2024-08-18T23:57:46.968921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988215+0000","last_change":"2024-08-18T23:57:46.985787+0000","last_active":"2024-08-18T23:57:46.988215+0000","last_peered":"2024-08-18T23:57:46.988215+0000","last_clean":"2024-08-18T23:57:46.988215+0000","last_became_active":"2024-08-18T23:57:46.985559+0000","last_became_peered":"2024-08-18T23:57:46.985559+0000","last_unstale":"2024-08-18T23:57:46.988215+0000","last_undegraded":"2024-08-18T23:57:46.988215+0000","last_fullsized":"2024-08-18T23:57:46.988215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:43.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972363+0000","last_change":"2024-08-18T23:57:46.972363+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972363+0000","last_undegraded":"2024-08-18T23:57:46.972363+0000","last_fullsized":"2024-08-18T23:57:46.972363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979036+0000","last_change":"2024-08-18T23:57:46.975935+0000","last_active":"2024-08-18T23:57:46.979036+0000","last_peered":"2024-08-18T23:57:46.979036+0000","last_clean":"2024-08-18T23:57:46.979036+0000","last_became_active":"2024-08-18T23:57:46.974922+0000","last_became_peered":"2024-08-18T23:57:46.974922+0000","last_unstale":"2024-08-18T23:57:46.979036+0000","last_undegraded":"2024-08-18T23:57:46.979036+0000","last_fullsized":"2024-08-18T23:57:46.979036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:23.499961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972171+0000","last_change":"2024-08-18T23:57:46.972171+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972171+0000","last_undegraded":"2024-08-18T23:57:46.972171+0000","last_fullsized":"2024-08-18T23:57:46.972171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979087+0000","last_change":"2024-08-18T23:57:46.977722+0000","last_active":"2024-08-18T23:57:46.979087+0000","last_peered":"2024-08-18T23:57:46.979087+0000","last_clean":"2024-08-18T23:57:46.979087+0000","last_became_active":"2024-08-18T23:57:46.977358+0000","last_became_peered":"2024-08-18T23:57:46.977358+0000","last_unstale":"2024-08-18T23:57:46.979087+0000","last_undegraded":"2024-08-18T23:57:46.979087+0000","last_fullsized":"2024-08-18T23:57:46.979087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:34.548703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974068+0000","last_change":"2024-08-18T23:57:46.974068+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974068+0000","last_undegraded":"2024-08-18T23:57:46.974068+0000","last_fullsized":"2024-08-18T23:57:46.974068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.986638+0000","last_change":"2024-08-18T23:57:46.985675+0000","last_active":"2024-08-18T23:57:46.986638+0000","last_peered":"2024-08-18T23:57:46.986638+0000","last_clean":"2024-08-18T23:57:46.986638+0000","last_became_active":"2024-08-18T23:57:46.985422+0000","last_became_peered":"2024-08-18T23:57:46.985422+0000","last_unstale":"2024-08-18T23:57:46.986638+0000","last_undegraded":"2024-08-18T23:57:46.986638+0000","last_fullsized":"2024-08-18T23:57:46.986638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:45.942020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974834+0000","last_change":"2024-08-18T23:57:46.974834+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974834+0000","last_undegraded":"2024-08-18T23:57:46.974834+0000","last_fullsized":"2024-08-18T23:57:46.974834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.976133+0000","last_change":"2024-08-18T23:57:46.972731+0000","last_active":"2024-08-18T23:57:46.976133+0000","last_peered":"2024-08-18T23:57:46.976133+0000","last_clean":"2024-08-18T23:57:46.976133+0000","last_became_active":"2024-08-18T23:57:46.972286+0000","last_became_peered":"2024-08-18T23:57:46.972286+0000","last_unstale":"2024-08-18T23:57:46.976133+0000","last_undegraded":"2024-08-18T23:57:46.976133+0000","last_fullsized":"2024-08-18T23:57:46.976133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:49:14.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975018+0000","last_change":"2024-08-18T23:57:46.975018+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975018+0000","last_undegraded":"2024-08-18T23:57:46.975018+0000","last_fullsized":"2024-08-18T23:57:46.975018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988083+0000","last_change":"2024-08-18T23:57:46.984792+0000","last_active":"2024-08-18T23:57:46.988083+0000","last_peered":"2024-08-18T23:57:46.988083+0000","last_clean":"2024-08-18T23:57:46.988083+0000","last_became_active":"2024-08-18T23:57:46.984390+0000","last_became_peered":"2024-08-18T23:57:46.984390+0000","last_unstale":"2024-08-18T23:57:46.988083+0000","last_undegraded":"2024-08-18T23:57:46.988083+0000","last_fullsized":"2024-08-18T23:57:46.988083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975329+0000","last_change":"2024-08-18T23:57:46.975329+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975329+0000","last_undegraded":"2024-08-18T23:57:46.975329+0000","last_fullsized":"2024-08-18T23:57:46.975329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987821+0000","last_change":"2024-08-18T23:57:46.986267+0000","last_active":"2024-08-18T23:57:46.987821+0000","last_peered":"2024-08-18T23:57:46.987821+0000","last_clean":"2024-08-18T23:57:46.987821+0000","last_became_active":"2024-08-18T23:57:46.985949+0000","last_became_peered":"2024-08-18T23:57:46.985949+0000","last_unstale":"2024-08-18T23:57:46.987821+0000","last_undegraded":"2024-08-18T23:57:46.987821+0000","last_fullsized":"2024-08-18T23:57:46.987821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:53.830731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973560+0000","last_change":"2024-08-18T23:57:46.973560+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973560+0000","last_undegraded":"2024-08-18T23:57:46.973560+0000","last_fullsized":"2024-08-18T23:57:46.973560+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981443+0000","last_change":"2024-08-18T23:57:46.980140+0000","last_active":"2024-08-18T23:57:46.981443+0000","last_peered":"2024-08-18T23:57:46.981443+0000","last_clean":"2024-08-18T23:57:46.981443+0000","last_became_active":"2024-08-18T23:57:46.979861+0000","last_became_peered":"2024-08-18T23:57:46.979861+0000","last_unstale":"2024-08-18T23:57:46.981443+0000","last_undegraded":"2024-08-18T23:57:46.981443+0000","last_fullsized":"2024-08-18T23:57:46.981443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971926+0000","last_change":"2024-08-18T23:57:46.971926+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971926+0000","last_undegraded":"2024-08-18T23:57:46.971926+0000","last_fullsized":"2024-08-18T23:57:46.971926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.983867+0000","last_change":"2024-08-18T23:57:46.982236+0000","last_active":"2024-08-18T23:57:46.983867+0000","last_peered":"2024-08-18T23:57:46.983867+0000","last_clean":"2024-08-18T23:57:46.983867+0000","last_became_active":"2024-08-18T23:57:46.981988+0000","last_became_peered":"2024-08-18T23:57:46.981988+0000","last_unstale":"2024-08-18T23:57:46.983867+0000","last_undegraded":"2024-08-18T23:57:46.983867+0000","last_fullsized":"2024-08-18T23:57:46.983867+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973204+0000","last_change":"2024-08-18T23:57:46.973204+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973204+0000","last_undegraded":"2024-08-18T23:57:46.973204+0000","last_fullsized":"2024-08-18T23:57:46.973204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981262+0000","last_change":"2024-08-18T23:57:46.979340+0000","last_active":"2024-08-18T23:57:46.981262+0000","last_peered":"2024-08-18T23:57:46.981262+0000","last_clean":"2024-08-18T23:57:46.981262+0000","last_became_active":"2024-08-18T23:57:46.978986+0000","last_became_peered":"2024-08-18T23:57:46.978986+0000","last_unstale":"2024-08-18T23:57:46.981262+0000","last_undegraded":"2024-08-18T23:57:46.981262+0000","last_fullsized":"2024-08-18T23:57:46.981262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973245+0000","last_change":"2024-08-18T23:57:46.973245+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973245+0000","last_undegraded":"2024-08-18T23:57:46.973245+0000","last_fullsized":"2024-08-18T23:57:46.973245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985217+0000","last_change":"2024-08-18T23:57:46.977443+0000","last_active":"2024-08-18T23:57:46.985217+0000","last_peered":"2024-08-18T23:57:46.985217+0000","last_clean":"2024-08-18T23:57:46.985217+0000","last_became_active":"2024-08-18T23:57:46.977118+0000","last_became_peered":"2024-08-18T23:57:46.977118+0000","last_unstale":"2024-08-18T23:57:46.985217+0000","last_undegraded":"2024-08-18T23:57:46.985217+0000","last_fullsized":"2024-08-18T23:57:46.985217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:13:21.453951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971984+0000","last_change":"2024-08-18T23:57:46.971984+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971984+0000","last_undegraded":"2024-08-18T23:57:46.971984+0000","last_fullsized":"2024-08-18T23:57:46.971984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.984862+0000","last_change":"2024-08-18T23:57:46.980301+0000","last_active":"2024-08-18T23:57:46.984862+0000","last_peered":"2024-08-18T23:57:46.984862+0000","last_clean":"2024-08-18T23:57:46.984862+0000","last_became_active":"2024-08-18T23:57:46.980039+0000","last_became_peered":"2024-08-18T23:57:46.980039+0000","last_unstale":"2024-08-18T23:57:46.984862+0000","last_undegraded":"2024-08-18T23:57:46.984862+0000","last_fullsized":"2024-08-18T23:57:46.984862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:35:22.742458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976993+0000","last_change":"2024-08-18T23:57:46.976993+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976993+0000","last_undegraded":"2024-08-18T23:57:46.976993+0000","last_fullsized":"2024-08-18T23:57:46.976993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.990570+0000","last_change":"2024-08-18T23:57:46.988567+0000","last_active":"2024-08-18T23:57:46.990570+0000","last_peered":"2024-08-18T23:57:46.990570+0000","last_clean":"2024-08-18T23:57:46.990570+0000","last_became_active":"2024-08-18T23:57:46.988285+0000","last_became_peered":"2024-08-18T23:57:46.988285+0000","last_unstale":"2024-08-18T23:57:46.990570+0000","last_undegraded":"2024-08-18T23:57:46.990570+0000","last_fullsized":"2024-08-18T23:57:46.990570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.980124+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:57:46.980124+0000","last_peered":"2024-08-18T23:57:46.980124+0000","last_clean":"2024-08-18T23:57:46.980124+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:57:46.980124+0000","last_undegraded":"2024-08-18T23:57:46.980124+0000","last_fullsized":"2024-08-18T23:57:46.980124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":760040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":760040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:50.939 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:51.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.073+0000 7f517f2df640 1 Processor -- start 2024-08-18T23:57:51.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.073+0000 7f517f2df640 1 -- start start 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517f2df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51780d19c0 0x7f51780d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517f2df640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f517806df90 0x7f51780cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517f2df640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51780d22e0 con 0x7f517806db50 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517f2df640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f517806fa80 con 0x7f517806df90 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517f2df640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f517806fd60 con 0x7f51780d19c0 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517c87a640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f517806db50 0x7f51780ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42234/0 (socket says 172.21.15.103:42234) 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517c87a640 1 -- 172.21.15.103:0/3238963822 learned_addr learned my addr 172.21.15.103:0/3238963822 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739733389 0 0) 0x7f51780d22e0 con 0x7f517806db50 2024-08-18T23:57:51.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5164003520 con 0x7f517806db50 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517d07b640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51780d19c0 0x7f51780d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f517d87c640 1 --2- 172.21.15.103:0/3238963822 >> v2:172.21.15.190:3300/0 conn(0x7f517806df90 0x7f51780cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3293819913 0 0) 0x7f5164003520 con 0x7f517806db50 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51780d19c0 msgr2=0x7f51780d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51780d19c0 0x7f51780d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 >> v2:172.21.15.190:3300/0 conn(0x7f517806df90 msgr2=0x7f51780cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 --2- 172.21.15.103:0/3238963822 >> v2:172.21.15.190:3300/0 conn(0x7f517806df90 0x7f51780cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5178070040 con 0x7f517806db50 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f5168001670 con 0x7f517806db50 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 >> v1:172.21.15.103:6789/0 conn(0x7f517806db50 legacy=0x7f51780ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51780d19c0 0x7f51640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5164003fe0 0x7f5164004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.074+0000 7f516ffff640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5164004d40 0x7f51640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f517806fa80 con 0x7f5164004d40 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f517806fd60 con 0x7f5164003fe0 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f516400bac0 con 0x7f51780d19c0 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f517d87c640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5164004d40 0x7f51640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f517d07b640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51780d19c0 0x7f51640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f517c87a640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5164003fe0 0x7f5164004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f517d87c640 1 -- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51780d19c0 msgr2=0x7f51640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f517d87c640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51780d19c0 0x7f51640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f517d87c640 1 -- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5164003fe0 msgr2=0x7f5164004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f517d87c640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5164003fe0 0x7f5164004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.075+0000 7f517d87c640 1 -- 172.21.15.103:0/3238963822 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5164003520 con 0x7f5164004d40 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f517d87c640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5164004d40 0x7f51640051c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5170007330 tx=0x7f5164005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abeca909ccf8079 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170009be0 con 0x7f5164004d40 2024-08-18T23:57:51.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5170036600 con 0x7f5164004d40 2024-08-18T23:57:51.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f516ffff640 1 -- 172.21.15.103:0/3238963822 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700369d0 con 0x7f5164004d40 2024-08-18T23:57:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f517f2df640 1 -- 172.21.15.103:0/3238963822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5164004d40 msgr2=0x7f51640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f517f2df640 1 --2- 172.21.15.103:0/3238963822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5164004d40 0x7f51640051c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5170007330 tx=0x7f5164005830 comp rx=0 tx=0).stop 2024-08-18T23:57:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f517d87c640 1 -- 172.21.15.103:0/3238963822 reap_dead start 2024-08-18T23:57:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f517f2df640 1 -- 172.21.15.103:0/3238963822 shutdown_connections 2024-08-18T23:57:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f517f2df640 1 -- 172.21.15.103:0/3238963822 >> 172.21.15.103:0/3238963822 conn(0x7f517809aa40 msgr2=0x7f517809ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f517f2df640 1 -- 172.21.15.103:0/3238963822 shutdown_connections 2024-08-18T23:57:51.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.076+0000 7f517f2df640 1 -- 172.21.15.103:0/3238963822 wait complete. 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.077+0000 7f517f2df640 1 Processor -- start 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.077+0000 7f517f2df640 1 -- start start 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517f2df640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5164004d40 0x7f51780b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517f2df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51781f48b0 0x7f51780c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517f2df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51780c83e0 0x7f51780b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517f2df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f517806cc30 con 0x7f51780c83e0 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517f2df640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5178070600 con 0x7f5164004d40 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517f2df640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f517815e510 con 0x7f51781f48b0 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517d87c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51780c83e0 0x7f51780b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517d87c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51780c83e0 0x7f51780b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37054/0 (socket says 172.21.15.103:37054) 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.078+0000 7f517d87c640 1 -- 172.21.15.103:0/3855872059 learned_addr learned my addr 172.21.15.103:0/3855872059 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f517d87c640 1 -- 172.21.15.103:0/3855872059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51781f48b0 msgr2=0x7f51780c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f517d87c640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51781f48b0 0x7f51780c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f517d87c640 1 -- 172.21.15.103:0/3855872059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5164004d40 msgr2=0x7f51780b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f517d87c640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5164004d40 0x7f51780b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f517d87c640 1 -- 172.21.15.103:0/3855872059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51781f4d30 con 0x7f51780c83e0 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f517d87c640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51780c83e0 0x7f51780b38f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f517002b070 tx=0x7f5170004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f516dffb640 1 -- 172.21.15.103:0/3855872059 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170009be0 con 0x7f51780c83e0 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f516dffb640 1 -- 172.21.15.103:0/3855872059 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5170036400 con 0x7f51780c83e0 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f516dffb640 1 -- 172.21.15.103:0/3855872059 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170038520 con 0x7f51780c83e0 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51780c7620 con 0x7f51780c83e0 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.079+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51780c7be0 con 0x7f51780c83e0 2024-08-18T23:57:51.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.080+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51780d1da0 con 0x7f51780c83e0 2024-08-18T23:57:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.080+0000 7f516dffb640 1 -- 172.21.15.103:0/3855872059 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f517002e620 con 0x7f51780c83e0 2024-08-18T23:57:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.081+0000 7f516dffb640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f515c06be60 0x7f515c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.081+0000 7f516dffb640 1 -- 172.21.15.103:0/3855872059 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f51700abad0 con 0x7f51780c83e0 2024-08-18T23:57:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.081+0000 7f517d07b640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f515c06be60 0x7f515c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.081+0000 7f517d07b640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f515c06be60 0x7f515c06e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5174006a90 tx=0x7f5174006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.085+0000 7f516dffb640 1 -- 172.21.15.103:0/3855872059 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5170048060 con 0x7f51780c83e0 2024-08-18T23:57:51.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.247+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f51780d0680 con 0x7f515c06be60 2024-08-18T23:57:51.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.253+0000 7f516dffb640 1 -- 172.21.15.103:0/3855872059 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246634 (secure 0 0 0) 0x7f51780d0680 con 0x7f515c06be60 2024-08-18T23:57:51.255 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:51.266 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f515c06be60 msgr2=0x7f515c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f515c06be60 0x7f515c06e320 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5174006a90 tx=0x7f5174006a20 comp rx=0 tx=0).stop 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51780c83e0 msgr2=0x7f51780b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51780c83e0 0x7f51780b38f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f517002b070 tx=0x7f5170004ab0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 shutdown_connections 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f515c06be60 0x7f515c06e320 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51780c83e0 0x7f51780b38f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51781f48b0 0x7f51780c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 --2- 172.21.15.103:0/3855872059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5164004d40 0x7f51780b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 >> 172.21.15.103:0/3855872059 conn(0x7f517809aa40 msgr2=0x7f51780d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:51.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 shutdown_connections 2024-08-18T23:57:51.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.256+0000 7f517f2df640 1 -- 172.21.15.103:0/3855872059 wait complete. 2024-08-18T23:57:51.270 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-08-18T23:57:50.176750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220472,"kb_used_data":4308,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754248,"statfs":{"total":773094113280,"available":772868349952,"internally_reserved":0,"allocated":4411392,"data_stored":2544779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.214056"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975424+0000","last_change":"2024-08-18T23:57:46.975424+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975424+0000","last_undegraded":"2024-08-18T23:57:46.975424+0000","last_fullsized":"2024-08-18T23:57:46.975424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974932+0000","last_change":"2024-08-18T23:57:46.974932+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974932+0000","last_undegraded":"2024-08-18T23:57:46.974932+0000","last_fullsized":"2024-08-18T23:57:46.974932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976316+0000","last_change":"2024-08-18T23:57:46.976316+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976316+0000","last_undegraded":"2024-08-18T23:57:46.976316+0000","last_fullsized":"2024-08-18T23:57:46.976316+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969632+0000","last_change":"2024-08-18T23:57:46.969632+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969632+0000","last_undegraded":"2024-08-18T23:57:46.969632+0000","last_fullsized":"2024-08-18T23:57:46.969632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968772+0000","last_change":"2024-08-18T23:57:46.968772+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968772+0000","last_undegraded":"2024-08-18T23:57:46.968772+0000","last_fullsized":"2024-08-18T23:57:46.968772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979418+0000","last_change":"2024-08-18T23:57:46.979418+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979418+0000","last_undegraded":"2024-08-18T23:57:46.979418+0000","last_fullsized":"2024-08-18T23:57:46.979418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978627+0000","last_change":"2024-08-18T23:57:46.978627+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978627+0000","last_undegraded":"2024-08-18T23:57:46.978627+0000","last_fullsized":"2024-08-18T23:57:46.978627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974470+0000","last_change":"2024-08-18T23:57:46.974470+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974470+0000","last_undegraded":"2024-08-18T23:57:46.974470+0000","last_fullsized":"2024-08-18T23:57:46.974470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975835+0000","last_change":"2024-08-18T23:57:46.975835+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975835+0000","last_undegraded":"2024-08-18T23:57:46.975835+0000","last_fullsized":"2024-08-18T23:57:46.975835+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978765+0000","last_change":"2024-08-18T23:57:46.978765+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978765+0000","last_undegraded":"2024-08-18T23:57:46.978765+0000","last_fullsized":"2024-08-18T23:57:46.978765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979680+0000","last_change":"2024-08-18T23:57:46.979680+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979680+0000","last_undegraded":"2024-08-18T23:57:46.979680+0000","last_fullsized":"2024-08-18T23:57:46.979680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973067+0000","last_change":"2024-08-18T23:57:46.973067+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973067+0000","last_undegraded":"2024-08-18T23:57:46.973067+0000","last_fullsized":"2024-08-18T23:57:46.973067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974604+0000","last_change":"2024-08-18T23:57:46.974604+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974604+0000","last_undegraded":"2024-08-18T23:57:46.974604+0000","last_fullsized":"2024-08-18T23:57:46.974604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975826+0000","last_change":"2024-08-18T23:57:46.975826+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975826+0000","last_undegraded":"2024-08-18T23:57:46.975826+0000","last_fullsized":"2024-08-18T23:57:46.975826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.977827+0000","last_change":"2024-08-18T23:57:46.977827+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.977827+0000","last_undegraded":"2024-08-18T23:57:46.977827+0000","last_fullsized":"2024-08-18T23:57:46.977827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973170+0000","last_change":"2024-08-18T23:57:46.973170+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973170+0000","last_undegraded":"2024-08-18T23:57:46.973170+0000","last_fullsized":"2024-08-18T23:57:46.973170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971981+0000","last_change":"2024-08-18T23:57:46.971981+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971981+0000","last_undegraded":"2024-08-18T23:57:46.971981+0000","last_fullsized":"2024-08-18T23:57:46.971981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968145+0000","last_change":"2024-08-18T23:57:46.968145+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968145+0000","last_undegraded":"2024-08-18T23:57:46.968145+0000","last_fullsized":"2024-08-18T23:57:46.968145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969033+0000","last_change":"2024-08-18T23:57:46.969033+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969033+0000","last_undegraded":"2024-08-18T23:57:46.969033+0000","last_fullsized":"2024-08-18T23:57:46.969033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968289+0000","last_change":"2024-08-18T23:57:46.968289+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968289+0000","last_undegraded":"2024-08-18T23:57:46.968289+0000","last_fullsized":"2024-08-18T23:57:46.968289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974058+0000","last_change":"2024-08-18T23:57:46.974058+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974058+0000","last_undegraded":"2024-08-18T23:57:46.974058+0000","last_fullsized":"2024-08-18T23:57:46.974058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975380+0000","last_change":"2024-08-18T23:57:46.975380+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975380+0000","last_undegraded":"2024-08-18T23:57:46.975380+0000","last_fullsized":"2024-08-18T23:57:46.975380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972537+0000","last_change":"2024-08-18T23:57:46.972537+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972537+0000","last_undegraded":"2024-08-18T23:57:46.972537+0000","last_fullsized":"2024-08-18T23:57:46.972537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968636+0000","last_change":"2024-08-18T23:57:46.968636+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968636+0000","last_undegraded":"2024-08-18T23:57:46.968636+0000","last_fullsized":"2024-08-18T23:57:46.968636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968350+0000","last_change":"2024-08-18T23:57:46.968350+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968350+0000","last_undegraded":"2024-08-18T23:57:46.968350+0000","last_fullsized":"2024-08-18T23:57:46.968350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978705+0000","last_change":"2024-08-18T23:57:46.978705+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978705+0000","last_undegraded":"2024-08-18T23:57:46.978705+0000","last_fullsized":"2024-08-18T23:57:46.978705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969021+0000","last_change":"2024-08-18T23:57:46.969021+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969021+0000","last_undegraded":"2024-08-18T23:57:46.969021+0000","last_fullsized":"2024-08-18T23:57:46.969021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974982+0000","last_change":"2024-08-18T23:57:46.974982+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974982+0000","last_undegraded":"2024-08-18T23:57:46.974982+0000","last_fullsized":"2024-08-18T23:57:46.974982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968755+0000","last_change":"2024-08-18T23:57:46.968755+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968755+0000","last_undegraded":"2024-08-18T23:57:46.968755+0000","last_fullsized":"2024-08-18T23:57:46.968755+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.967950+0000","last_change":"2024-08-18T23:57:46.967950+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.967950+0000","last_undegraded":"2024-08-18T23:57:46.967950+0000","last_fullsized":"2024-08-18T23:57:46.967950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971645+0000","last_change":"2024-08-18T23:57:46.971645+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971645+0000","last_undegraded":"2024-08-18T23:57:46.971645+0000","last_fullsized":"2024-08-18T23:57:46.971645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978675+0000","last_change":"2024-08-18T23:57:46.978675+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978675+0000","last_undegraded":"2024-08-18T23:57:46.978675+0000","last_fullsized":"2024-08-18T23:57:46.978675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972949+0000","last_change":"2024-08-18T23:57:46.972949+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972949+0000","last_undegraded":"2024-08-18T23:57:46.972949+0000","last_fullsized":"2024-08-18T23:57:46.972949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981304+0000","last_change":"2024-08-18T23:57:46.978262+0000","last_active":"2024-08-18T23:57:46.981304+0000","last_peered":"2024-08-18T23:57:46.981304+0000","last_clean":"2024-08-18T23:57:46.981304+0000","last_became_active":"2024-08-18T23:57:46.977521+0000","last_became_peered":"2024-08-18T23:57:46.977521+0000","last_unstale":"2024-08-18T23:57:46.981304+0000","last_undegraded":"2024-08-18T23:57:46.981304+0000","last_fullsized":"2024-08-18T23:57:46.981304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975878+0000","last_change":"2024-08-18T23:57:46.975878+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975878+0000","last_undegraded":"2024-08-18T23:57:46.975878+0000","last_fullsized":"2024-08-18T23:57:46.975878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988135+0000","last_change":"2024-08-18T23:57:46.986870+0000","last_active":"2024-08-18T23:57:46.988135+0000","last_peered":"2024-08-18T23:57:46.988135+0000","last_clean":"2024-08-18T23:57:46.988135+0000","last_became_active":"2024-08-18T23:57:46.986630+0000","last_became_peered":"2024-08-18T23:57:46.986630+0000","last_unstale":"2024-08-18T23:57:46.988135+0000","last_undegraded":"2024-08-18T23:57:46.988135+0000","last_fullsized":"2024-08-18T23:57:46.988135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976097+0000","last_change":"2024-08-18T23:57:46.976097+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976097+0000","last_undegraded":"2024-08-18T23:57:46.976097+0000","last_fullsized":"2024-08-18T23:57:46.976097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988243+0000","last_change":"2024-08-18T23:57:46.986467+0000","last_active":"2024-08-18T23:57:46.988243+0000","last_peered":"2024-08-18T23:57:46.988243+0000","last_clean":"2024-08-18T23:57:46.988243+0000","last_became_active":"2024-08-18T23:57:46.986141+0000","last_became_peered":"2024-08-18T23:57:46.986141+0000","last_unstale":"2024-08-18T23:57:46.988243+0000","last_undegraded":"2024-08-18T23:57:46.988243+0000","last_fullsized":"2024-08-18T23:57:46.988243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974099+0000","last_change":"2024-08-18T23:57:46.974099+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974099+0000","last_undegraded":"2024-08-18T23:57:46.974099+0000","last_fullsized":"2024-08-18T23:57:46.974099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985100+0000","last_change":"2024-08-18T23:57:46.977433+0000","last_active":"2024-08-18T23:57:46.985100+0000","last_peered":"2024-08-18T23:57:46.985100+0000","last_clean":"2024-08-18T23:57:46.985100+0000","last_became_active":"2024-08-18T23:57:46.977134+0000","last_became_peered":"2024-08-18T23:57:46.977134+0000","last_unstale":"2024-08-18T23:57:46.985100+0000","last_undegraded":"2024-08-18T23:57:46.985100+0000","last_fullsized":"2024-08-18T23:57:46.985100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:35.309577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973061+0000","last_change":"2024-08-18T23:57:46.973061+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973061+0000","last_undegraded":"2024-08-18T23:57:46.973061+0000","last_fullsized":"2024-08-18T23:57:46.973061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988552+0000","last_change":"2024-08-18T23:57:46.986008+0000","last_active":"2024-08-18T23:57:46.988552+0000","last_peered":"2024-08-18T23:57:46.988552+0000","last_clean":"2024-08-18T23:57:46.988552+0000","last_became_active":"2024-08-18T23:57:46.984486+0000","last_became_peered":"2024-08-18T23:57:46.984486+0000","last_unstale":"2024-08-18T23:57:46.988552+0000","last_undegraded":"2024-08-18T23:57:46.988552+0000","last_fullsized":"2024-08-18T23:57:46.988552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:49:36.222131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973927+0000","last_change":"2024-08-18T23:57:46.973927+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973927+0000","last_undegraded":"2024-08-18T23:57:46.973927+0000","last_fullsized":"2024-08-18T23:57:46.973927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.989184+0000","last_change":"2024-08-18T23:57:46.986931+0000","last_active":"2024-08-18T23:57:46.989184+0000","last_peered":"2024-08-18T23:57:46.989184+0000","last_clean":"2024-08-18T23:57:46.989184+0000","last_became_active":"2024-08-18T23:57:46.986652+0000","last_became_peered":"2024-08-18T23:57:46.986652+0000","last_unstale":"2024-08-18T23:57:46.989184+0000","last_undegraded":"2024-08-18T23:57:46.989184+0000","last_fullsized":"2024-08-18T23:57:46.989184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974753+0000","last_change":"2024-08-18T23:57:46.974753+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974753+0000","last_undegraded":"2024-08-18T23:57:46.974753+0000","last_fullsized":"2024-08-18T23:57:46.974753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988258+0000","last_change":"2024-08-18T23:57:46.986792+0000","last_active":"2024-08-18T23:57:46.988258+0000","last_peered":"2024-08-18T23:57:46.988258+0000","last_clean":"2024-08-18T23:57:46.988258+0000","last_became_active":"2024-08-18T23:57:46.986493+0000","last_became_peered":"2024-08-18T23:57:46.986493+0000","last_unstale":"2024-08-18T23:57:46.988258+0000","last_undegraded":"2024-08-18T23:57:46.988258+0000","last_fullsized":"2024-08-18T23:57:46.988258+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976139+0000","last_change":"2024-08-18T23:57:46.976139+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976139+0000","last_undegraded":"2024-08-18T23:57:46.976139+0000","last_fullsized":"2024-08-18T23:57:46.976139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985654+0000","last_change":"2024-08-18T23:57:46.982717+0000","last_active":"2024-08-18T23:57:46.985654+0000","last_peered":"2024-08-18T23:57:46.985654+0000","last_clean":"2024-08-18T23:57:46.985654+0000","last_became_active":"2024-08-18T23:57:46.982435+0000","last_became_peered":"2024-08-18T23:57:46.982435+0000","last_unstale":"2024-08-18T23:57:46.985654+0000","last_undegraded":"2024-08-18T23:57:46.985654+0000","last_fullsized":"2024-08-18T23:57:46.985654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968931+0000","last_change":"2024-08-18T23:57:46.968931+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968931+0000","last_undegraded":"2024-08-18T23:57:46.968931+0000","last_fullsized":"2024-08-18T23:57:46.968931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.984834+0000","last_change":"2024-08-18T23:57:46.981068+0000","last_active":"2024-08-18T23:57:46.984834+0000","last_peered":"2024-08-18T23:57:46.984834+0000","last_clean":"2024-08-18T23:57:46.984834+0000","last_became_active":"2024-08-18T23:57:46.980803+0000","last_became_peered":"2024-08-18T23:57:46.980803+0000","last_unstale":"2024-08-18T23:57:46.984834+0000","last_undegraded":"2024-08-18T23:57:46.984834+0000","last_fullsized":"2024-08-18T23:57:46.984834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:47.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975770+0000","last_change":"2024-08-18T23:57:46.975770+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975770+0000","last_undegraded":"2024-08-18T23:57:46.975770+0000","last_fullsized":"2024-08-18T23:57:46.975770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987348+0000","last_change":"2024-08-18T23:57:46.982223+0000","last_active":"2024-08-18T23:57:46.987348+0000","last_peered":"2024-08-18T23:57:46.987348+0000","last_clean":"2024-08-18T23:57:46.987348+0000","last_became_active":"2024-08-18T23:57:46.981942+0000","last_became_peered":"2024-08-18T23:57:46.981942+0000","last_unstale":"2024-08-18T23:57:46.987348+0000","last_undegraded":"2024-08-18T23:57:46.987348+0000","last_fullsized":"2024-08-18T23:57:46.987348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972174+0000","last_change":"2024-08-18T23:57:46.972174+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972174+0000","last_undegraded":"2024-08-18T23:57:46.972174+0000","last_fullsized":"2024-08-18T23:57:46.972174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987965+0000","last_change":"2024-08-18T23:57:46.984581+0000","last_active":"2024-08-18T23:57:46.987965+0000","last_peered":"2024-08-18T23:57:46.987965+0000","last_clean":"2024-08-18T23:57:46.987965+0000","last_became_active":"2024-08-18T23:57:46.984283+0000","last_became_peered":"2024-08-18T23:57:46.984283+0000","last_unstale":"2024-08-18T23:57:46.987965+0000","last_undegraded":"2024-08-18T23:57:46.987965+0000","last_fullsized":"2024-08-18T23:57:46.987965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974066+0000","last_change":"2024-08-18T23:57:46.974066+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974066+0000","last_undegraded":"2024-08-18T23:57:46.974066+0000","last_fullsized":"2024-08-18T23:57:46.974066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985069+0000","last_change":"2024-08-18T23:57:46.979935+0000","last_active":"2024-08-18T23:57:46.985069+0000","last_peered":"2024-08-18T23:57:46.985069+0000","last_clean":"2024-08-18T23:57:46.985069+0000","last_became_active":"2024-08-18T23:57:46.979515+0000","last_became_peered":"2024-08-18T23:57:46.979515+0000","last_unstale":"2024-08-18T23:57:46.985069+0000","last_undegraded":"2024-08-18T23:57:46.985069+0000","last_fullsized":"2024-08-18T23:57:46.985069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:54:29.031353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972538+0000","last_change":"2024-08-18T23:57:46.972538+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972538+0000","last_undegraded":"2024-08-18T23:57:46.972538+0000","last_fullsized":"2024-08-18T23:57:46.972538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979304+0000","last_change":"2024-08-18T23:57:46.976894+0000","last_active":"2024-08-18T23:57:46.979304+0000","last_peered":"2024-08-18T23:57:46.979304+0000","last_clean":"2024-08-18T23:57:46.979304+0000","last_became_active":"2024-08-18T23:57:46.976632+0000","last_became_peered":"2024-08-18T23:57:46.976632+0000","last_unstale":"2024-08-18T23:57:46.979304+0000","last_undegraded":"2024-08-18T23:57:46.979304+0000","last_fullsized":"2024-08-18T23:57:46.979304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:21.950504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973663+0000","last_change":"2024-08-18T23:57:46.973663+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973663+0000","last_undegraded":"2024-08-18T23:57:46.973663+0000","last_fullsized":"2024-08-18T23:57:46.973663+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.995773+0000","last_change":"2024-08-18T23:57:46.988097+0000","last_active":"2024-08-18T23:57:46.995773+0000","last_peered":"2024-08-18T23:57:46.995773+0000","last_clean":"2024-08-18T23:57:46.995773+0000","last_became_active":"2024-08-18T23:57:46.987806+0000","last_became_peered":"2024-08-18T23:57:46.987806+0000","last_unstale":"2024-08-18T23:57:46.995773+0000","last_undegraded":"2024-08-18T23:57:46.995773+0000","last_fullsized":"2024-08-18T23:57:46.995773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972239+0000","last_change":"2024-08-18T23:57:46.972239+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972239+0000","last_undegraded":"2024-08-18T23:57:46.972239+0000","last_fullsized":"2024-08-18T23:57:46.972239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.978114+0000","last_change":"2024-08-18T23:57:46.974889+0000","last_active":"2024-08-18T23:57:46.978114+0000","last_peered":"2024-08-18T23:57:46.978114+0000","last_clean":"2024-08-18T23:57:46.978114+0000","last_became_active":"2024-08-18T23:57:46.974493+0000","last_became_peered":"2024-08-18T23:57:46.974493+0000","last_unstale":"2024-08-18T23:57:46.978114+0000","last_undegraded":"2024-08-18T23:57:46.978114+0000","last_fullsized":"2024-08-18T23:57:46.978114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975683+0000","last_change":"2024-08-18T23:57:46.975683+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975683+0000","last_undegraded":"2024-08-18T23:57:46.975683+0000","last_fullsized":"2024-08-18T23:57:46.975683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987984+0000","last_change":"2024-08-18T23:57:46.986352+0000","last_active":"2024-08-18T23:57:46.987984+0000","last_peered":"2024-08-18T23:57:46.987984+0000","last_clean":"2024-08-18T23:57:46.987984+0000","last_became_active":"2024-08-18T23:57:46.986080+0000","last_became_peered":"2024-08-18T23:57:46.986080+0000","last_unstale":"2024-08-18T23:57:46.987984+0000","last_undegraded":"2024-08-18T23:57:46.987984+0000","last_fullsized":"2024-08-18T23:57:46.987984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974081+0000","last_change":"2024-08-18T23:57:46.974081+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974081+0000","last_undegraded":"2024-08-18T23:57:46.974081+0000","last_fullsized":"2024-08-18T23:57:46.974081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988103+0000","last_change":"2024-08-18T23:57:46.986782+0000","last_active":"2024-08-18T23:57:46.988103+0000","last_peered":"2024-08-18T23:57:46.988103+0000","last_clean":"2024-08-18T23:57:46.988103+0000","last_became_active":"2024-08-18T23:57:46.986512+0000","last_became_peered":"2024-08-18T23:57:46.986512+0000","last_unstale":"2024-08-18T23:57:46.988103+0000","last_undegraded":"2024-08-18T23:57:46.988103+0000","last_fullsized":"2024-08-18T23:57:46.988103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:54:49.793571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979212+0000","last_change":"2024-08-18T23:57:46.979212+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979212+0000","last_undegraded":"2024-08-18T23:57:46.979212+0000","last_fullsized":"2024-08-18T23:57:46.979212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985529+0000","last_change":"2024-08-18T23:57:46.980792+0000","last_active":"2024-08-18T23:57:46.985529+0000","last_peered":"2024-08-18T23:57:46.985529+0000","last_clean":"2024-08-18T23:57:46.985529+0000","last_became_active":"2024-08-18T23:57:46.980487+0000","last_became_peered":"2024-08-18T23:57:46.980487+0000","last_unstale":"2024-08-18T23:57:46.985529+0000","last_undegraded":"2024-08-18T23:57:46.985529+0000","last_fullsized":"2024-08-18T23:57:46.985529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:43.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973569+0000","last_change":"2024-08-18T23:57:46.973569+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973569+0000","last_undegraded":"2024-08-18T23:57:46.973569+0000","last_fullsized":"2024-08-18T23:57:46.973569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987283+0000","last_change":"2024-08-18T23:57:46.980654+0000","last_active":"2024-08-18T23:57:46.987283+0000","last_peered":"2024-08-18T23:57:46.987283+0000","last_clean":"2024-08-18T23:57:46.987283+0000","last_became_active":"2024-08-18T23:57:46.980406+0000","last_became_peered":"2024-08-18T23:57:46.980406+0000","last_unstale":"2024-08-18T23:57:46.987283+0000","last_undegraded":"2024-08-18T23:57:46.987283+0000","last_fullsized":"2024-08-18T23:57:46.987283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.626751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968921+0000","last_change":"2024-08-18T23:57:46.968921+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968921+0000","last_undegraded":"2024-08-18T23:57:46.968921+0000","last_fullsized":"2024-08-18T23:57:46.968921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988215+0000","last_change":"2024-08-18T23:57:46.985787+0000","last_active":"2024-08-18T23:57:46.988215+0000","last_peered":"2024-08-18T23:57:46.988215+0000","last_clean":"2024-08-18T23:57:46.988215+0000","last_became_active":"2024-08-18T23:57:46.985559+0000","last_became_peered":"2024-08-18T23:57:46.985559+0000","last_unstale":"2024-08-18T23:57:46.988215+0000","last_undegraded":"2024-08-18T23:57:46.988215+0000","last_fullsized":"2024-08-18T23:57:46.988215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:43.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972363+0000","last_change":"2024-08-18T23:57:46.972363+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972363+0000","last_undegraded":"2024-08-18T23:57:46.972363+0000","last_fullsized":"2024-08-18T23:57:46.972363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979036+0000","last_change":"2024-08-18T23:57:46.975935+0000","last_active":"2024-08-18T23:57:46.979036+0000","last_peered":"2024-08-18T23:57:46.979036+0000","last_clean":"2024-08-18T23:57:46.979036+0000","last_became_active":"2024-08-18T23:57:46.974922+0000","last_became_peered":"2024-08-18T23:57:46.974922+0000","last_unstale":"2024-08-18T23:57:46.979036+0000","last_undegraded":"2024-08-18T23:57:46.979036+0000","last_fullsized":"2024-08-18T23:57:46.979036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:23.499961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972171+0000","last_change":"2024-08-18T23:57:46.972171+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972171+0000","last_undegraded":"2024-08-18T23:57:46.972171+0000","last_fullsized":"2024-08-18T23:57:46.972171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979087+0000","last_change":"2024-08-18T23:57:46.977722+0000","last_active":"2024-08-18T23:57:46.979087+0000","last_peered":"2024-08-18T23:57:46.979087+0000","last_clean":"2024-08-18T23:57:46.979087+0000","last_became_active":"2024-08-18T23:57:46.977358+0000","last_became_peered":"2024-08-18T23:57:46.977358+0000","last_unstale":"2024-08-18T23:57:46.979087+0000","last_undegraded":"2024-08-18T23:57:46.979087+0000","last_fullsized":"2024-08-18T23:57:46.979087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:34.548703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974068+0000","last_change":"2024-08-18T23:57:46.974068+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974068+0000","last_undegraded":"2024-08-18T23:57:46.974068+0000","last_fullsized":"2024-08-18T23:57:46.974068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.986638+0000","last_change":"2024-08-18T23:57:46.985675+0000","last_active":"2024-08-18T23:57:46.986638+0000","last_peered":"2024-08-18T23:57:46.986638+0000","last_clean":"2024-08-18T23:57:46.986638+0000","last_became_active":"2024-08-18T23:57:46.985422+0000","last_became_peered":"2024-08-18T23:57:46.985422+0000","last_unstale":"2024-08-18T23:57:46.986638+0000","last_undegraded":"2024-08-18T23:57:46.986638+0000","last_fullsized":"2024-08-18T23:57:46.986638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:45.942020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974834+0000","last_change":"2024-08-18T23:57:46.974834+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974834+0000","last_undegraded":"2024-08-18T23:57:46.974834+0000","last_fullsized":"2024-08-18T23:57:46.974834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.976133+0000","last_change":"2024-08-18T23:57:46.972731+0000","last_active":"2024-08-18T23:57:46.976133+0000","last_peered":"2024-08-18T23:57:46.976133+0000","last_clean":"2024-08-18T23:57:46.976133+0000","last_became_active":"2024-08-18T23:57:46.972286+0000","last_became_peered":"2024-08-18T23:57:46.972286+0000","last_unstale":"2024-08-18T23:57:46.976133+0000","last_undegraded":"2024-08-18T23:57:46.976133+0000","last_fullsized":"2024-08-18T23:57:46.976133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:49:14.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975018+0000","last_change":"2024-08-18T23:57:46.975018+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975018+0000","last_undegraded":"2024-08-18T23:57:46.975018+0000","last_fullsized":"2024-08-18T23:57:46.975018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988083+0000","last_change":"2024-08-18T23:57:46.984792+0000","last_active":"2024-08-18T23:57:46.988083+0000","last_peered":"2024-08-18T23:57:46.988083+0000","last_clean":"2024-08-18T23:57:46.988083+0000","last_became_active":"2024-08-18T23:57:46.984390+0000","last_became_peered":"2024-08-18T23:57:46.984390+0000","last_unstale":"2024-08-18T23:57:46.988083+0000","last_undegraded":"2024-08-18T23:57:46.988083+0000","last_fullsized":"2024-08-18T23:57:46.988083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975329+0000","last_change":"2024-08-18T23:57:46.975329+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975329+0000","last_undegraded":"2024-08-18T23:57:46.975329+0000","last_fullsized":"2024-08-18T23:57:46.975329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987821+0000","last_change":"2024-08-18T23:57:46.986267+0000","last_active":"2024-08-18T23:57:46.987821+0000","last_peered":"2024-08-18T23:57:46.987821+0000","last_clean":"2024-08-18T23:57:46.987821+0000","last_became_active":"2024-08-18T23:57:46.985949+0000","last_became_peered":"2024-08-18T23:57:46.985949+0000","last_unstale":"2024-08-18T23:57:46.987821+0000","last_undegraded":"2024-08-18T23:57:46.987821+0000","last_fullsized":"2024-08-18T23:57:46.987821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:53.830731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973560+0000","last_change":"2024-08-18T23:57:46.973560+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973560+0000","last_undegraded":"2024-08-18T23:57:46.973560+0000","last_fullsized":"2024-08-18T23:57:46.973560+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981443+0000","last_change":"2024-08-18T23:57:46.980140+0000","last_active":"2024-08-18T23:57:46.981443+0000","last_peered":"2024-08-18T23:57:46.981443+0000","last_clean":"2024-08-18T23:57:46.981443+0000","last_became_active":"2024-08-18T23:57:46.979861+0000","last_became_peered":"2024-08-18T23:57:46.979861+0000","last_unstale":"2024-08-18T23:57:46.981443+0000","last_undegraded":"2024-08-18T23:57:46.981443+0000","last_fullsized":"2024-08-18T23:57:46.981443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971926+0000","last_change":"2024-08-18T23:57:46.971926+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971926+0000","last_undegraded":"2024-08-18T23:57:46.971926+0000","last_fullsized":"2024-08-18T23:57:46.971926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.983867+0000","last_change":"2024-08-18T23:57:46.982236+0000","last_active":"2024-08-18T23:57:46.983867+0000","last_peered":"2024-08-18T23:57:46.983867+0000","last_clean":"2024-08-18T23:57:46.983867+0000","last_became_active":"2024-08-18T23:57:46.981988+0000","last_became_peered":"2024-08-18T23:57:46.981988+0000","last_unstale":"2024-08-18T23:57:46.983867+0000","last_undegraded":"2024-08-18T23:57:46.983867+0000","last_fullsized":"2024-08-18T23:57:46.983867+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973204+0000","last_change":"2024-08-18T23:57:46.973204+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973204+0000","last_undegraded":"2024-08-18T23:57:46.973204+0000","last_fullsized":"2024-08-18T23:57:46.973204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981262+0000","last_change":"2024-08-18T23:57:46.979340+0000","last_active":"2024-08-18T23:57:46.981262+0000","last_peered":"2024-08-18T23:57:46.981262+0000","last_clean":"2024-08-18T23:57:46.981262+0000","last_became_active":"2024-08-18T23:57:46.978986+0000","last_became_peered":"2024-08-18T23:57:46.978986+0000","last_unstale":"2024-08-18T23:57:46.981262+0000","last_undegraded":"2024-08-18T23:57:46.981262+0000","last_fullsized":"2024-08-18T23:57:46.981262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973245+0000","last_change":"2024-08-18T23:57:46.973245+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973245+0000","last_undegraded":"2024-08-18T23:57:46.973245+0000","last_fullsized":"2024-08-18T23:57:46.973245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985217+0000","last_change":"2024-08-18T23:57:46.977443+0000","last_active":"2024-08-18T23:57:46.985217+0000","last_peered":"2024-08-18T23:57:46.985217+0000","last_clean":"2024-08-18T23:57:46.985217+0000","last_became_active":"2024-08-18T23:57:46.977118+0000","last_became_peered":"2024-08-18T23:57:46.977118+0000","last_unstale":"2024-08-18T23:57:46.985217+0000","last_undegraded":"2024-08-18T23:57:46.985217+0000","last_fullsized":"2024-08-18T23:57:46.985217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:13:21.453951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971984+0000","last_change":"2024-08-18T23:57:46.971984+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971984+0000","last_undegraded":"2024-08-18T23:57:46.971984+0000","last_fullsized":"2024-08-18T23:57:46.971984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.984862+0000","last_change":"2024-08-18T23:57:46.980301+0000","last_active":"2024-08-18T23:57:46.984862+0000","last_peered":"2024-08-18T23:57:46.984862+0000","last_clean":"2024-08-18T23:57:46.984862+0000","last_became_active":"2024-08-18T23:57:46.980039+0000","last_became_peered":"2024-08-18T23:57:46.980039+0000","last_unstale":"2024-08-18T23:57:46.984862+0000","last_undegraded":"2024-08-18T23:57:46.984862+0000","last_fullsized":"2024-08-18T23:57:46.984862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:35:22.742458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976993+0000","last_change":"2024-08-18T23:57:46.976993+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976993+0000","last_undegraded":"2024-08-18T23:57:46.976993+0000","last_fullsized":"2024-08-18T23:57:46.976993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.990570+0000","last_change":"2024-08-18T23:57:46.988567+0000","last_active":"2024-08-18T23:57:46.990570+0000","last_peered":"2024-08-18T23:57:46.990570+0000","last_clean":"2024-08-18T23:57:46.990570+0000","last_became_active":"2024-08-18T23:57:46.988285+0000","last_became_peered":"2024-08-18T23:57:46.988285+0000","last_unstale":"2024-08-18T23:57:46.990570+0000","last_undegraded":"2024-08-18T23:57:46.990570+0000","last_fullsized":"2024-08-18T23:57:46.990570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.980124+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:57:46.980124+0000","last_peered":"2024-08-18T23:57:46.980124+0000","last_clean":"2024-08-18T23:57:46.980124+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:57:46.980124+0000","last_undegraded":"2024-08-18T23:57:46.980124+0000","last_fullsized":"2024-08-18T23:57:46.980124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":760040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":760040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:51.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:51.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.392+0000 7fe00aa47640 1 Processor -- start 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.392+0000 7fe00aa47640 1 -- start start 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe00aa47640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe00415ade0 0x7fe00406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe00aa47640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe0040ae9e0 0x7fe00406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe00aa47640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe004072610 con 0x7fe0040b4370 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe00aa47640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe00406db10 con 0x7fe00415ade0 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe00aa47640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe00415b1c0 con 0x7fe0040ae9e0 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe003fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe00415ade0 0x7fe00406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe003fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe00415ade0 0x7fe00406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37066/0 (socket says 172.21.15.103:37066) 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe003fff640 1 -- 172.21.15.103:0/3941007330 learned_addr learned my addr 172.21.15.103:0/3941007330 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe008fe4640 1 --2- 172.21.15.103:0/3941007330 >> v2:172.21.15.190:3300/0 conn(0x7fe0040ae9e0 0x7fe00406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe003fff640 1 -- 172.21.15.103:0/3941007330 >> v2:172.21.15.190:3300/0 conn(0x7fe0040ae9e0 msgr2=0x7fe00406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe003fff640 1 --2- 172.21.15.103:0/3941007330 >> v2:172.21.15.190:3300/0 conn(0x7fe0040ae9e0 0x7fe00406f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe003fff640 1 -- 172.21.15.103:0/3941007330 >> v1:172.21.15.190:6789/0 conn(0x7fe0040b4370 legacy=0x7fe00415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.393+0000 7fe003fff640 1 -- 172.21.15.103:0/3941007330 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0040728f0 con 0x7fe00415ade0 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.394+0000 7fe003fff640 1 --2- 172.21.15.103:0/3941007330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe00415ade0 0x7fe00406f060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe00415f940 tx=0x7fdff402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0394844c091d44 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.394+0000 7fe002ffd640 1 -- 172.21.15.103:0/3941007330 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4037070 con 0x7fe00415ade0 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.394+0000 7fe002ffd640 1 -- 172.21.15.103:0/3941007330 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff4032440 con 0x7fe00415ade0 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.394+0000 7fe002ffd640 1 -- 172.21.15.103:0/3941007330 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff4032810 con 0x7fe00415ade0 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.395+0000 7fe00aa47640 1 -- 172.21.15.103:0/3941007330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe00415ade0 msgr2=0x7fe00406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.395+0000 7fe00aa47640 1 --2- 172.21.15.103:0/3941007330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe00415ade0 0x7fe00406f060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe00415f940 tx=0x7fdff402a1e0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.395+0000 7fe00aa47640 1 -- 172.21.15.103:0/3941007330 shutdown_connections 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.395+0000 7fe00aa47640 1 --2- 172.21.15.103:0/3941007330 >> v2:172.21.15.190:3300/0 conn(0x7fe0040ae9e0 0x7fe00406f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.395+0000 7fe00aa47640 1 --2- 172.21.15.103:0/3941007330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe00415ade0 0x7fe00406f060 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.395+0000 7fe00aa47640 1 -- 172.21.15.103:0/3941007330 >> 172.21.15.103:0/3941007330 conn(0x7fe0040cfc40 msgr2=0x7fe0040d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.395+0000 7fe00aa47640 1 -- 172.21.15.103:0/3941007330 shutdown_connections 2024-08-18T23:57:51.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.395+0000 7fe00aa47640 1 -- 172.21.15.103:0/3941007330 wait complete. 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.396+0000 7fe00aa47640 1 Processor -- start 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.396+0000 7fe00aa47640 1 -- start start 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe00aa47640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0040ae9e0 0x7fe00414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe00aa47640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0040b4370 0x7fe00415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe00aa47640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe00415ade0 0x7fe0041ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe00aa47640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe00406d6c0 con 0x7fe0040b4370 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe00aa47640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe004072eb0 con 0x7fe0040ae9e0 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe00aa47640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe00406d840 con 0x7fe00415ade0 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe0037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0040b4370 0x7fe00415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe0037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0040b4370 0x7fe00415cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37082/0 (socket says 172.21.15.103:37082) 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe0037fe640 1 -- 172.21.15.103:0/671722283 learned_addr learned my addr 172.21.15.103:0/671722283 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe003fff640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0040ae9e0 0x7fe00414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe008fe4640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe00415ade0 0x7fe0041ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe0037fe640 1 -- 172.21.15.103:0/671722283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe00415ade0 msgr2=0x7fe0041ef430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe0037fe640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe00415ade0 0x7fe0041ef430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe0037fe640 1 -- 172.21.15.103:0/671722283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0040ae9e0 msgr2=0x7fe00414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe0037fe640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0040ae9e0 0x7fe00414b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.397+0000 7fe0037fe640 1 -- 172.21.15.103:0/671722283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0041537a0 con 0x7fe0040b4370 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.398+0000 7fe0037fe640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0040b4370 0x7fe00415cda0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdff800c400 tx=0x7fdff800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.398+0000 7fe000ff9640 1 -- 172.21.15.103:0/671722283 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff80052d0 con 0x7fe0040b4370 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.398+0000 7fe000ff9640 1 -- 172.21.15.103:0/671722283 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdff8005490 con 0x7fe0040b4370 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.398+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe00415d430 con 0x7fe0040b4370 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.398+0000 7fe000ff9640 1 -- 172.21.15.103:0/671722283 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdff8007260 con 0x7fe0040b4370 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.398+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe00415d9f0 con 0x7fe0040b4370 2024-08-18T23:57:51.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.399+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0040b47b0 con 0x7fe0040b4370 2024-08-18T23:57:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.399+0000 7fe000ff9640 1 -- 172.21.15.103:0/671722283 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdff8007400 con 0x7fe0040b4370 2024-08-18T23:57:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.400+0000 7fe000ff9640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdff006be60 0x7fdff006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.400+0000 7fe003fff640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdff006be60 0x7fdff006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.400+0000 7fe000ff9640 1 -- 172.21.15.103:0/671722283 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fdff808a3f0 con 0x7fe0040b4370 2024-08-18T23:57:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.400+0000 7fe003fff640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdff006be60 0x7fdff006e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdff4034000 tx=0x7fdff402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.404+0000 7fe000ff9640 1 -- 172.21.15.103:0/671722283 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fdff8058650 con 0x7fe0040b4370 2024-08-18T23:57:51.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.566+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0040ae5a0 con 0x7fdff006be60 2024-08-18T23:57:51.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.572+0000 7fe000ff9640 1 -- 172.21.15.103:0/671722283 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246634 (secure 0 0 0) 0x7fe0040ae5a0 con 0x7fdff006be60 2024-08-18T23:57:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:51.576 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdff006be60 msgr2=0x7fdff006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdff006be60 0x7fdff006e320 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdff4034000 tx=0x7fdff402e000 comp rx=0 tx=0).stop 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0040b4370 msgr2=0x7fe00415cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0040b4370 0x7fe00415cda0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdff800c400 tx=0x7fdff800c8c0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 shutdown_connections 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fdff006be60 0x7fdff006e320 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe00415ade0 0x7fe0041ef430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0040b4370 0x7fe00415cda0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 --2- 172.21.15.103:0/671722283 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe0040ae9e0 0x7fe00414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 >> 172.21.15.103:0/671722283 conn(0x7fe0040cfc40 msgr2=0x7fe00415e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 shutdown_connections 2024-08-18T23:57:51.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.575+0000 7fe00aa47640 1 -- 172.21.15.103:0/671722283 wait complete. 2024-08-18T23:57:51.587 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-08-18T23:57:50.176750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220472,"kb_used_data":4308,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754248,"statfs":{"total":773094113280,"available":772868349952,"internally_reserved":0,"allocated":4411392,"data_stored":2544779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.214056"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975424+0000","last_change":"2024-08-18T23:57:46.975424+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975424+0000","last_undegraded":"2024-08-18T23:57:46.975424+0000","last_fullsized":"2024-08-18T23:57:46.975424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974932+0000","last_change":"2024-08-18T23:57:46.974932+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974932+0000","last_undegraded":"2024-08-18T23:57:46.974932+0000","last_fullsized":"2024-08-18T23:57:46.974932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976316+0000","last_change":"2024-08-18T23:57:46.976316+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976316+0000","last_undegraded":"2024-08-18T23:57:46.976316+0000","last_fullsized":"2024-08-18T23:57:46.976316+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969632+0000","last_change":"2024-08-18T23:57:46.969632+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969632+0000","last_undegraded":"2024-08-18T23:57:46.969632+0000","last_fullsized":"2024-08-18T23:57:46.969632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968772+0000","last_change":"2024-08-18T23:57:46.968772+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968772+0000","last_undegraded":"2024-08-18T23:57:46.968772+0000","last_fullsized":"2024-08-18T23:57:46.968772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979418+0000","last_change":"2024-08-18T23:57:46.979418+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979418+0000","last_undegraded":"2024-08-18T23:57:46.979418+0000","last_fullsized":"2024-08-18T23:57:46.979418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978627+0000","last_change":"2024-08-18T23:57:46.978627+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978627+0000","last_undegraded":"2024-08-18T23:57:46.978627+0000","last_fullsized":"2024-08-18T23:57:46.978627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974470+0000","last_change":"2024-08-18T23:57:46.974470+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974470+0000","last_undegraded":"2024-08-18T23:57:46.974470+0000","last_fullsized":"2024-08-18T23:57:46.974470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975835+0000","last_change":"2024-08-18T23:57:46.975835+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975835+0000","last_undegraded":"2024-08-18T23:57:46.975835+0000","last_fullsized":"2024-08-18T23:57:46.975835+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978765+0000","last_change":"2024-08-18T23:57:46.978765+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978765+0000","last_undegraded":"2024-08-18T23:57:46.978765+0000","last_fullsized":"2024-08-18T23:57:46.978765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979680+0000","last_change":"2024-08-18T23:57:46.979680+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979680+0000","last_undegraded":"2024-08-18T23:57:46.979680+0000","last_fullsized":"2024-08-18T23:57:46.979680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973067+0000","last_change":"2024-08-18T23:57:46.973067+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973067+0000","last_undegraded":"2024-08-18T23:57:46.973067+0000","last_fullsized":"2024-08-18T23:57:46.973067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974604+0000","last_change":"2024-08-18T23:57:46.974604+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974604+0000","last_undegraded":"2024-08-18T23:57:46.974604+0000","last_fullsized":"2024-08-18T23:57:46.974604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975826+0000","last_change":"2024-08-18T23:57:46.975826+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975826+0000","last_undegraded":"2024-08-18T23:57:46.975826+0000","last_fullsized":"2024-08-18T23:57:46.975826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.977827+0000","last_change":"2024-08-18T23:57:46.977827+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.977827+0000","last_undegraded":"2024-08-18T23:57:46.977827+0000","last_fullsized":"2024-08-18T23:57:46.977827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973170+0000","last_change":"2024-08-18T23:57:46.973170+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973170+0000","last_undegraded":"2024-08-18T23:57:46.973170+0000","last_fullsized":"2024-08-18T23:57:46.973170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971981+0000","last_change":"2024-08-18T23:57:46.971981+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971981+0000","last_undegraded":"2024-08-18T23:57:46.971981+0000","last_fullsized":"2024-08-18T23:57:46.971981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968145+0000","last_change":"2024-08-18T23:57:46.968145+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968145+0000","last_undegraded":"2024-08-18T23:57:46.968145+0000","last_fullsized":"2024-08-18T23:57:46.968145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969033+0000","last_change":"2024-08-18T23:57:46.969033+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969033+0000","last_undegraded":"2024-08-18T23:57:46.969033+0000","last_fullsized":"2024-08-18T23:57:46.969033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968289+0000","last_change":"2024-08-18T23:57:46.968289+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968289+0000","last_undegraded":"2024-08-18T23:57:46.968289+0000","last_fullsized":"2024-08-18T23:57:46.968289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974058+0000","last_change":"2024-08-18T23:57:46.974058+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974058+0000","last_undegraded":"2024-08-18T23:57:46.974058+0000","last_fullsized":"2024-08-18T23:57:46.974058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975380+0000","last_change":"2024-08-18T23:57:46.975380+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975380+0000","last_undegraded":"2024-08-18T23:57:46.975380+0000","last_fullsized":"2024-08-18T23:57:46.975380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972537+0000","last_change":"2024-08-18T23:57:46.972537+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972537+0000","last_undegraded":"2024-08-18T23:57:46.972537+0000","last_fullsized":"2024-08-18T23:57:46.972537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968636+0000","last_change":"2024-08-18T23:57:46.968636+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968636+0000","last_undegraded":"2024-08-18T23:57:46.968636+0000","last_fullsized":"2024-08-18T23:57:46.968636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968350+0000","last_change":"2024-08-18T23:57:46.968350+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968350+0000","last_undegraded":"2024-08-18T23:57:46.968350+0000","last_fullsized":"2024-08-18T23:57:46.968350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978705+0000","last_change":"2024-08-18T23:57:46.978705+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978705+0000","last_undegraded":"2024-08-18T23:57:46.978705+0000","last_fullsized":"2024-08-18T23:57:46.978705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969021+0000","last_change":"2024-08-18T23:57:46.969021+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969021+0000","last_undegraded":"2024-08-18T23:57:46.969021+0000","last_fullsized":"2024-08-18T23:57:46.969021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974982+0000","last_change":"2024-08-18T23:57:46.974982+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974982+0000","last_undegraded":"2024-08-18T23:57:46.974982+0000","last_fullsized":"2024-08-18T23:57:46.974982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968755+0000","last_change":"2024-08-18T23:57:46.968755+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968755+0000","last_undegraded":"2024-08-18T23:57:46.968755+0000","last_fullsized":"2024-08-18T23:57:46.968755+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.967950+0000","last_change":"2024-08-18T23:57:46.967950+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.967950+0000","last_undegraded":"2024-08-18T23:57:46.967950+0000","last_fullsized":"2024-08-18T23:57:46.967950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971645+0000","last_change":"2024-08-18T23:57:46.971645+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971645+0000","last_undegraded":"2024-08-18T23:57:46.971645+0000","last_fullsized":"2024-08-18T23:57:46.971645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978675+0000","last_change":"2024-08-18T23:57:46.978675+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978675+0000","last_undegraded":"2024-08-18T23:57:46.978675+0000","last_fullsized":"2024-08-18T23:57:46.978675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972949+0000","last_change":"2024-08-18T23:57:46.972949+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972949+0000","last_undegraded":"2024-08-18T23:57:46.972949+0000","last_fullsized":"2024-08-18T23:57:46.972949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981304+0000","last_change":"2024-08-18T23:57:46.978262+0000","last_active":"2024-08-18T23:57:46.981304+0000","last_peered":"2024-08-18T23:57:46.981304+0000","last_clean":"2024-08-18T23:57:46.981304+0000","last_became_active":"2024-08-18T23:57:46.977521+0000","last_became_peered":"2024-08-18T23:57:46.977521+0000","last_unstale":"2024-08-18T23:57:46.981304+0000","last_undegraded":"2024-08-18T23:57:46.981304+0000","last_fullsized":"2024-08-18T23:57:46.981304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975878+0000","last_change":"2024-08-18T23:57:46.975878+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975878+0000","last_undegraded":"2024-08-18T23:57:46.975878+0000","last_fullsized":"2024-08-18T23:57:46.975878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988135+0000","last_change":"2024-08-18T23:57:46.986870+0000","last_active":"2024-08-18T23:57:46.988135+0000","last_peered":"2024-08-18T23:57:46.988135+0000","last_clean":"2024-08-18T23:57:46.988135+0000","last_became_active":"2024-08-18T23:57:46.986630+0000","last_became_peered":"2024-08-18T23:57:46.986630+0000","last_unstale":"2024-08-18T23:57:46.988135+0000","last_undegraded":"2024-08-18T23:57:46.988135+0000","last_fullsized":"2024-08-18T23:57:46.988135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976097+0000","last_change":"2024-08-18T23:57:46.976097+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976097+0000","last_undegraded":"2024-08-18T23:57:46.976097+0000","last_fullsized":"2024-08-18T23:57:46.976097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988243+0000","last_change":"2024-08-18T23:57:46.986467+0000","last_active":"2024-08-18T23:57:46.988243+0000","last_peered":"2024-08-18T23:57:46.988243+0000","last_clean":"2024-08-18T23:57:46.988243+0000","last_became_active":"2024-08-18T23:57:46.986141+0000","last_became_peered":"2024-08-18T23:57:46.986141+0000","last_unstale":"2024-08-18T23:57:46.988243+0000","last_undegraded":"2024-08-18T23:57:46.988243+0000","last_fullsized":"2024-08-18T23:57:46.988243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974099+0000","last_change":"2024-08-18T23:57:46.974099+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974099+0000","last_undegraded":"2024-08-18T23:57:46.974099+0000","last_fullsized":"2024-08-18T23:57:46.974099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985100+0000","last_change":"2024-08-18T23:57:46.977433+0000","last_active":"2024-08-18T23:57:46.985100+0000","last_peered":"2024-08-18T23:57:46.985100+0000","last_clean":"2024-08-18T23:57:46.985100+0000","last_became_active":"2024-08-18T23:57:46.977134+0000","last_became_peered":"2024-08-18T23:57:46.977134+0000","last_unstale":"2024-08-18T23:57:46.985100+0000","last_undegraded":"2024-08-18T23:57:46.985100+0000","last_fullsized":"2024-08-18T23:57:46.985100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:35.309577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973061+0000","last_change":"2024-08-18T23:57:46.973061+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973061+0000","last_undegraded":"2024-08-18T23:57:46.973061+0000","last_fullsized":"2024-08-18T23:57:46.973061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988552+0000","last_change":"2024-08-18T23:57:46.986008+0000","last_active":"2024-08-18T23:57:46.988552+0000","last_peered":"2024-08-18T23:57:46.988552+0000","last_clean":"2024-08-18T23:57:46.988552+0000","last_became_active":"2024-08-18T23:57:46.984486+0000","last_became_peered":"2024-08-18T23:57:46.984486+0000","last_unstale":"2024-08-18T23:57:46.988552+0000","last_undegraded":"2024-08-18T23:57:46.988552+0000","last_fullsized":"2024-08-18T23:57:46.988552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:49:36.222131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973927+0000","last_change":"2024-08-18T23:57:46.973927+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973927+0000","last_undegraded":"2024-08-18T23:57:46.973927+0000","last_fullsized":"2024-08-18T23:57:46.973927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.989184+0000","last_change":"2024-08-18T23:57:46.986931+0000","last_active":"2024-08-18T23:57:46.989184+0000","last_peered":"2024-08-18T23:57:46.989184+0000","last_clean":"2024-08-18T23:57:46.989184+0000","last_became_active":"2024-08-18T23:57:46.986652+0000","last_became_peered":"2024-08-18T23:57:46.986652+0000","last_unstale":"2024-08-18T23:57:46.989184+0000","last_undegraded":"2024-08-18T23:57:46.989184+0000","last_fullsized":"2024-08-18T23:57:46.989184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974753+0000","last_change":"2024-08-18T23:57:46.974753+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974753+0000","last_undegraded":"2024-08-18T23:57:46.974753+0000","last_fullsized":"2024-08-18T23:57:46.974753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988258+0000","last_change":"2024-08-18T23:57:46.986792+0000","last_active":"2024-08-18T23:57:46.988258+0000","last_peered":"2024-08-18T23:57:46.988258+0000","last_clean":"2024-08-18T23:57:46.988258+0000","last_became_active":"2024-08-18T23:57:46.986493+0000","last_became_peered":"2024-08-18T23:57:46.986493+0000","last_unstale":"2024-08-18T23:57:46.988258+0000","last_undegraded":"2024-08-18T23:57:46.988258+0000","last_fullsized":"2024-08-18T23:57:46.988258+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976139+0000","last_change":"2024-08-18T23:57:46.976139+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976139+0000","last_undegraded":"2024-08-18T23:57:46.976139+0000","last_fullsized":"2024-08-18T23:57:46.976139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985654+0000","last_change":"2024-08-18T23:57:46.982717+0000","last_active":"2024-08-18T23:57:46.985654+0000","last_peered":"2024-08-18T23:57:46.985654+0000","last_clean":"2024-08-18T23:57:46.985654+0000","last_became_active":"2024-08-18T23:57:46.982435+0000","last_became_peered":"2024-08-18T23:57:46.982435+0000","last_unstale":"2024-08-18T23:57:46.985654+0000","last_undegraded":"2024-08-18T23:57:46.985654+0000","last_fullsized":"2024-08-18T23:57:46.985654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968931+0000","last_change":"2024-08-18T23:57:46.968931+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968931+0000","last_undegraded":"2024-08-18T23:57:46.968931+0000","last_fullsized":"2024-08-18T23:57:46.968931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.984834+0000","last_change":"2024-08-18T23:57:46.981068+0000","last_active":"2024-08-18T23:57:46.984834+0000","last_peered":"2024-08-18T23:57:46.984834+0000","last_clean":"2024-08-18T23:57:46.984834+0000","last_became_active":"2024-08-18T23:57:46.980803+0000","last_became_peered":"2024-08-18T23:57:46.980803+0000","last_unstale":"2024-08-18T23:57:46.984834+0000","last_undegraded":"2024-08-18T23:57:46.984834+0000","last_fullsized":"2024-08-18T23:57:46.984834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:47.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975770+0000","last_change":"2024-08-18T23:57:46.975770+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975770+0000","last_undegraded":"2024-08-18T23:57:46.975770+0000","last_fullsized":"2024-08-18T23:57:46.975770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987348+0000","last_change":"2024-08-18T23:57:46.982223+0000","last_active":"2024-08-18T23:57:46.987348+0000","last_peered":"2024-08-18T23:57:46.987348+0000","last_clean":"2024-08-18T23:57:46.987348+0000","last_became_active":"2024-08-18T23:57:46.981942+0000","last_became_peered":"2024-08-18T23:57:46.981942+0000","last_unstale":"2024-08-18T23:57:46.987348+0000","last_undegraded":"2024-08-18T23:57:46.987348+0000","last_fullsized":"2024-08-18T23:57:46.987348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972174+0000","last_change":"2024-08-18T23:57:46.972174+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972174+0000","last_undegraded":"2024-08-18T23:57:46.972174+0000","last_fullsized":"2024-08-18T23:57:46.972174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987965+0000","last_change":"2024-08-18T23:57:46.984581+0000","last_active":"2024-08-18T23:57:46.987965+0000","last_peered":"2024-08-18T23:57:46.987965+0000","last_clean":"2024-08-18T23:57:46.987965+0000","last_became_active":"2024-08-18T23:57:46.984283+0000","last_became_peered":"2024-08-18T23:57:46.984283+0000","last_unstale":"2024-08-18T23:57:46.987965+0000","last_undegraded":"2024-08-18T23:57:46.987965+0000","last_fullsized":"2024-08-18T23:57:46.987965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974066+0000","last_change":"2024-08-18T23:57:46.974066+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974066+0000","last_undegraded":"2024-08-18T23:57:46.974066+0000","last_fullsized":"2024-08-18T23:57:46.974066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985069+0000","last_change":"2024-08-18T23:57:46.979935+0000","last_active":"2024-08-18T23:57:46.985069+0000","last_peered":"2024-08-18T23:57:46.985069+0000","last_clean":"2024-08-18T23:57:46.985069+0000","last_became_active":"2024-08-18T23:57:46.979515+0000","last_became_peered":"2024-08-18T23:57:46.979515+0000","last_unstale":"2024-08-18T23:57:46.985069+0000","last_undegraded":"2024-08-18T23:57:46.985069+0000","last_fullsized":"2024-08-18T23:57:46.985069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:54:29.031353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972538+0000","last_change":"2024-08-18T23:57:46.972538+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972538+0000","last_undegraded":"2024-08-18T23:57:46.972538+0000","last_fullsized":"2024-08-18T23:57:46.972538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979304+0000","last_change":"2024-08-18T23:57:46.976894+0000","last_active":"2024-08-18T23:57:46.979304+0000","last_peered":"2024-08-18T23:57:46.979304+0000","last_clean":"2024-08-18T23:57:46.979304+0000","last_became_active":"2024-08-18T23:57:46.976632+0000","last_became_peered":"2024-08-18T23:57:46.976632+0000","last_unstale":"2024-08-18T23:57:46.979304+0000","last_undegraded":"2024-08-18T23:57:46.979304+0000","last_fullsized":"2024-08-18T23:57:46.979304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:21.950504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973663+0000","last_change":"2024-08-18T23:57:46.973663+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973663+0000","last_undegraded":"2024-08-18T23:57:46.973663+0000","last_fullsized":"2024-08-18T23:57:46.973663+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.995773+0000","last_change":"2024-08-18T23:57:46.988097+0000","last_active":"2024-08-18T23:57:46.995773+0000","last_peered":"2024-08-18T23:57:46.995773+0000","last_clean":"2024-08-18T23:57:46.995773+0000","last_became_active":"2024-08-18T23:57:46.987806+0000","last_became_peered":"2024-08-18T23:57:46.987806+0000","last_unstale":"2024-08-18T23:57:46.995773+0000","last_undegraded":"2024-08-18T23:57:46.995773+0000","last_fullsized":"2024-08-18T23:57:46.995773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972239+0000","last_change":"2024-08-18T23:57:46.972239+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972239+0000","last_undegraded":"2024-08-18T23:57:46.972239+0000","last_fullsized":"2024-08-18T23:57:46.972239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.978114+0000","last_change":"2024-08-18T23:57:46.974889+0000","last_active":"2024-08-18T23:57:46.978114+0000","last_peered":"2024-08-18T23:57:46.978114+0000","last_clean":"2024-08-18T23:57:46.978114+0000","last_became_active":"2024-08-18T23:57:46.974493+0000","last_became_peered":"2024-08-18T23:57:46.974493+0000","last_unstale":"2024-08-18T23:57:46.978114+0000","last_undegraded":"2024-08-18T23:57:46.978114+0000","last_fullsized":"2024-08-18T23:57:46.978114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975683+0000","last_change":"2024-08-18T23:57:46.975683+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975683+0000","last_undegraded":"2024-08-18T23:57:46.975683+0000","last_fullsized":"2024-08-18T23:57:46.975683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987984+0000","last_change":"2024-08-18T23:57:46.986352+0000","last_active":"2024-08-18T23:57:46.987984+0000","last_peered":"2024-08-18T23:57:46.987984+0000","last_clean":"2024-08-18T23:57:46.987984+0000","last_became_active":"2024-08-18T23:57:46.986080+0000","last_became_peered":"2024-08-18T23:57:46.986080+0000","last_unstale":"2024-08-18T23:57:46.987984+0000","last_undegraded":"2024-08-18T23:57:46.987984+0000","last_fullsized":"2024-08-18T23:57:46.987984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974081+0000","last_change":"2024-08-18T23:57:46.974081+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974081+0000","last_undegraded":"2024-08-18T23:57:46.974081+0000","last_fullsized":"2024-08-18T23:57:46.974081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988103+0000","last_change":"2024-08-18T23:57:46.986782+0000","last_active":"2024-08-18T23:57:46.988103+0000","last_peered":"2024-08-18T23:57:46.988103+0000","last_clean":"2024-08-18T23:57:46.988103+0000","last_became_active":"2024-08-18T23:57:46.986512+0000","last_became_peered":"2024-08-18T23:57:46.986512+0000","last_unstale":"2024-08-18T23:57:46.988103+0000","last_undegraded":"2024-08-18T23:57:46.988103+0000","last_fullsized":"2024-08-18T23:57:46.988103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:54:49.793571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979212+0000","last_change":"2024-08-18T23:57:46.979212+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979212+0000","last_undegraded":"2024-08-18T23:57:46.979212+0000","last_fullsized":"2024-08-18T23:57:46.979212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985529+0000","last_change":"2024-08-18T23:57:46.980792+0000","last_active":"2024-08-18T23:57:46.985529+0000","last_peered":"2024-08-18T23:57:46.985529+0000","last_clean":"2024-08-18T23:57:46.985529+0000","last_became_active":"2024-08-18T23:57:46.980487+0000","last_became_peered":"2024-08-18T23:57:46.980487+0000","last_unstale":"2024-08-18T23:57:46.985529+0000","last_undegraded":"2024-08-18T23:57:46.985529+0000","last_fullsized":"2024-08-18T23:57:46.985529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:43.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973569+0000","last_change":"2024-08-18T23:57:46.973569+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973569+0000","last_undegraded":"2024-08-18T23:57:46.973569+0000","last_fullsized":"2024-08-18T23:57:46.973569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987283+0000","last_change":"2024-08-18T23:57:46.980654+0000","last_active":"2024-08-18T23:57:46.987283+0000","last_peered":"2024-08-18T23:57:46.987283+0000","last_clean":"2024-08-18T23:57:46.987283+0000","last_became_active":"2024-08-18T23:57:46.980406+0000","last_became_peered":"2024-08-18T23:57:46.980406+0000","last_unstale":"2024-08-18T23:57:46.987283+0000","last_undegraded":"2024-08-18T23:57:46.987283+0000","last_fullsized":"2024-08-18T23:57:46.987283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.626751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968921+0000","last_change":"2024-08-18T23:57:46.968921+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968921+0000","last_undegraded":"2024-08-18T23:57:46.968921+0000","last_fullsized":"2024-08-18T23:57:46.968921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988215+0000","last_change":"2024-08-18T23:57:46.985787+0000","last_active":"2024-08-18T23:57:46.988215+0000","last_peered":"2024-08-18T23:57:46.988215+0000","last_clean":"2024-08-18T23:57:46.988215+0000","last_became_active":"2024-08-18T23:57:46.985559+0000","last_became_peered":"2024-08-18T23:57:46.985559+0000","last_unstale":"2024-08-18T23:57:46.988215+0000","last_undegraded":"2024-08-18T23:57:46.988215+0000","last_fullsized":"2024-08-18T23:57:46.988215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:43.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972363+0000","last_change":"2024-08-18T23:57:46.972363+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972363+0000","last_undegraded":"2024-08-18T23:57:46.972363+0000","last_fullsized":"2024-08-18T23:57:46.972363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979036+0000","last_change":"2024-08-18T23:57:46.975935+0000","last_active":"2024-08-18T23:57:46.979036+0000","last_peered":"2024-08-18T23:57:46.979036+0000","last_clean":"2024-08-18T23:57:46.979036+0000","last_became_active":"2024-08-18T23:57:46.974922+0000","last_became_peered":"2024-08-18T23:57:46.974922+0000","last_unstale":"2024-08-18T23:57:46.979036+0000","last_undegraded":"2024-08-18T23:57:46.979036+0000","last_fullsized":"2024-08-18T23:57:46.979036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:23.499961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972171+0000","last_change":"2024-08-18T23:57:46.972171+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972171+0000","last_undegraded":"2024-08-18T23:57:46.972171+0000","last_fullsized":"2024-08-18T23:57:46.972171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979087+0000","last_change":"2024-08-18T23:57:46.977722+0000","last_active":"2024-08-18T23:57:46.979087+0000","last_peered":"2024-08-18T23:57:46.979087+0000","last_clean":"2024-08-18T23:57:46.979087+0000","last_became_active":"2024-08-18T23:57:46.977358+0000","last_became_peered":"2024-08-18T23:57:46.977358+0000","last_unstale":"2024-08-18T23:57:46.979087+0000","last_undegraded":"2024-08-18T23:57:46.979087+0000","last_fullsized":"2024-08-18T23:57:46.979087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:34.548703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974068+0000","last_change":"2024-08-18T23:57:46.974068+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974068+0000","last_undegraded":"2024-08-18T23:57:46.974068+0000","last_fullsized":"2024-08-18T23:57:46.974068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.986638+0000","last_change":"2024-08-18T23:57:46.985675+0000","last_active":"2024-08-18T23:57:46.986638+0000","last_peered":"2024-08-18T23:57:46.986638+0000","last_clean":"2024-08-18T23:57:46.986638+0000","last_became_active":"2024-08-18T23:57:46.985422+0000","last_became_peered":"2024-08-18T23:57:46.985422+0000","last_unstale":"2024-08-18T23:57:46.986638+0000","last_undegraded":"2024-08-18T23:57:46.986638+0000","last_fullsized":"2024-08-18T23:57:46.986638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:45.942020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974834+0000","last_change":"2024-08-18T23:57:46.974834+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974834+0000","last_undegraded":"2024-08-18T23:57:46.974834+0000","last_fullsized":"2024-08-18T23:57:46.974834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.976133+0000","last_change":"2024-08-18T23:57:46.972731+0000","last_active":"2024-08-18T23:57:46.976133+0000","last_peered":"2024-08-18T23:57:46.976133+0000","last_clean":"2024-08-18T23:57:46.976133+0000","last_became_active":"2024-08-18T23:57:46.972286+0000","last_became_peered":"2024-08-18T23:57:46.972286+0000","last_unstale":"2024-08-18T23:57:46.976133+0000","last_undegraded":"2024-08-18T23:57:46.976133+0000","last_fullsized":"2024-08-18T23:57:46.976133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:49:14.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975018+0000","last_change":"2024-08-18T23:57:46.975018+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975018+0000","last_undegraded":"2024-08-18T23:57:46.975018+0000","last_fullsized":"2024-08-18T23:57:46.975018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988083+0000","last_change":"2024-08-18T23:57:46.984792+0000","last_active":"2024-08-18T23:57:46.988083+0000","last_peered":"2024-08-18T23:57:46.988083+0000","last_clean":"2024-08-18T23:57:46.988083+0000","last_became_active":"2024-08-18T23:57:46.984390+0000","last_became_peered":"2024-08-18T23:57:46.984390+0000","last_unstale":"2024-08-18T23:57:46.988083+0000","last_undegraded":"2024-08-18T23:57:46.988083+0000","last_fullsized":"2024-08-18T23:57:46.988083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975329+0000","last_change":"2024-08-18T23:57:46.975329+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975329+0000","last_undegraded":"2024-08-18T23:57:46.975329+0000","last_fullsized":"2024-08-18T23:57:46.975329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987821+0000","last_change":"2024-08-18T23:57:46.986267+0000","last_active":"2024-08-18T23:57:46.987821+0000","last_peered":"2024-08-18T23:57:46.987821+0000","last_clean":"2024-08-18T23:57:46.987821+0000","last_became_active":"2024-08-18T23:57:46.985949+0000","last_became_peered":"2024-08-18T23:57:46.985949+0000","last_unstale":"2024-08-18T23:57:46.987821+0000","last_undegraded":"2024-08-18T23:57:46.987821+0000","last_fullsized":"2024-08-18T23:57:46.987821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:53.830731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973560+0000","last_change":"2024-08-18T23:57:46.973560+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973560+0000","last_undegraded":"2024-08-18T23:57:46.973560+0000","last_fullsized":"2024-08-18T23:57:46.973560+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981443+0000","last_change":"2024-08-18T23:57:46.980140+0000","last_active":"2024-08-18T23:57:46.981443+0000","last_peered":"2024-08-18T23:57:46.981443+0000","last_clean":"2024-08-18T23:57:46.981443+0000","last_became_active":"2024-08-18T23:57:46.979861+0000","last_became_peered":"2024-08-18T23:57:46.979861+0000","last_unstale":"2024-08-18T23:57:46.981443+0000","last_undegraded":"2024-08-18T23:57:46.981443+0000","last_fullsized":"2024-08-18T23:57:46.981443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971926+0000","last_change":"2024-08-18T23:57:46.971926+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971926+0000","last_undegraded":"2024-08-18T23:57:46.971926+0000","last_fullsized":"2024-08-18T23:57:46.971926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.983867+0000","last_change":"2024-08-18T23:57:46.982236+0000","last_active":"2024-08-18T23:57:46.983867+0000","last_peered":"2024-08-18T23:57:46.983867+0000","last_clean":"2024-08-18T23:57:46.983867+0000","last_became_active":"2024-08-18T23:57:46.981988+0000","last_became_peered":"2024-08-18T23:57:46.981988+0000","last_unstale":"2024-08-18T23:57:46.983867+0000","last_undegraded":"2024-08-18T23:57:46.983867+0000","last_fullsized":"2024-08-18T23:57:46.983867+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973204+0000","last_change":"2024-08-18T23:57:46.973204+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973204+0000","last_undegraded":"2024-08-18T23:57:46.973204+0000","last_fullsized":"2024-08-18T23:57:46.973204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981262+0000","last_change":"2024-08-18T23:57:46.979340+0000","last_active":"2024-08-18T23:57:46.981262+0000","last_peered":"2024-08-18T23:57:46.981262+0000","last_clean":"2024-08-18T23:57:46.981262+0000","last_became_active":"2024-08-18T23:57:46.978986+0000","last_became_peered":"2024-08-18T23:57:46.978986+0000","last_unstale":"2024-08-18T23:57:46.981262+0000","last_undegraded":"2024-08-18T23:57:46.981262+0000","last_fullsized":"2024-08-18T23:57:46.981262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973245+0000","last_change":"2024-08-18T23:57:46.973245+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973245+0000","last_undegraded":"2024-08-18T23:57:46.973245+0000","last_fullsized":"2024-08-18T23:57:46.973245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985217+0000","last_change":"2024-08-18T23:57:46.977443+0000","last_active":"2024-08-18T23:57:46.985217+0000","last_peered":"2024-08-18T23:57:46.985217+0000","last_clean":"2024-08-18T23:57:46.985217+0000","last_became_active":"2024-08-18T23:57:46.977118+0000","last_became_peered":"2024-08-18T23:57:46.977118+0000","last_unstale":"2024-08-18T23:57:46.985217+0000","last_undegraded":"2024-08-18T23:57:46.985217+0000","last_fullsized":"2024-08-18T23:57:46.985217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:13:21.453951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971984+0000","last_change":"2024-08-18T23:57:46.971984+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971984+0000","last_undegraded":"2024-08-18T23:57:46.971984+0000","last_fullsized":"2024-08-18T23:57:46.971984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.984862+0000","last_change":"2024-08-18T23:57:46.980301+0000","last_active":"2024-08-18T23:57:46.984862+0000","last_peered":"2024-08-18T23:57:46.984862+0000","last_clean":"2024-08-18T23:57:46.984862+0000","last_became_active":"2024-08-18T23:57:46.980039+0000","last_became_peered":"2024-08-18T23:57:46.980039+0000","last_unstale":"2024-08-18T23:57:46.984862+0000","last_undegraded":"2024-08-18T23:57:46.984862+0000","last_fullsized":"2024-08-18T23:57:46.984862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:35:22.742458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976993+0000","last_change":"2024-08-18T23:57:46.976993+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976993+0000","last_undegraded":"2024-08-18T23:57:46.976993+0000","last_fullsized":"2024-08-18T23:57:46.976993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.990570+0000","last_change":"2024-08-18T23:57:46.988567+0000","last_active":"2024-08-18T23:57:46.990570+0000","last_peered":"2024-08-18T23:57:46.990570+0000","last_clean":"2024-08-18T23:57:46.990570+0000","last_became_active":"2024-08-18T23:57:46.988285+0000","last_became_peered":"2024-08-18T23:57:46.988285+0000","last_unstale":"2024-08-18T23:57:46.990570+0000","last_undegraded":"2024-08-18T23:57:46.990570+0000","last_fullsized":"2024-08-18T23:57:46.990570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.980124+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:57:46.980124+0000","last_peered":"2024-08-18T23:57:46.980124+0000","last_clean":"2024-08-18T23:57:46.980124+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:57:46.980124+0000","last_undegraded":"2024-08-18T23:57:46.980124+0000","last_fullsized":"2024-08-18T23:57:46.980124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":760040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":760040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:51.591 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-08-18T23:57:51.591 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975424+0000', 'last_change': '2024-08-18T23:57:46.975424+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975424+0000', 'last_undegraded': '2024-08-18T23:57:46.975424+0000', 'last_fullsized': '2024-08-18T23:57:46.975424+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.591 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-08-18T23:57:51.591 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974932+0000', 'last_change': '2024-08-18T23:57:46.974932+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974932+0000', 'last_undegraded': '2024-08-18T23:57:46.974932+0000', 'last_fullsized': '2024-08-18T23:57:46.974932+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.591 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-08-18T23:57:51.591 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.976316+0000', 'last_change': '2024-08-18T23:57:46.976316+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.976316+0000', 'last_undegraded': '2024-08-18T23:57:46.976316+0000', 'last_fullsized': '2024-08-18T23:57:46.976316+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T23:57:51.591 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-08-18T23:57:51.591 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.969632+0000', 'last_change': '2024-08-18T23:57:46.969632+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.969632+0000', 'last_undegraded': '2024-08-18T23:57:46.969632+0000', 'last_fullsized': '2024-08-18T23:57:46.969632+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.968772+0000', 'last_change': '2024-08-18T23:57:46.968772+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.968772+0000', 'last_undegraded': '2024-08-18T23:57:46.968772+0000', 'last_fullsized': '2024-08-18T23:57:46.968772+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.979418+0000', 'last_change': '2024-08-18T23:57:46.979418+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.979418+0000', 'last_undegraded': '2024-08-18T23:57:46.979418+0000', 'last_fullsized': '2024-08-18T23:57:46.979418+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.978627+0000', 'last_change': '2024-08-18T23:57:46.978627+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.978627+0000', 'last_undegraded': '2024-08-18T23:57:46.978627+0000', 'last_fullsized': '2024-08-18T23:57:46.978627+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974470+0000', 'last_change': '2024-08-18T23:57:46.974470+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974470+0000', 'last_undegraded': '2024-08-18T23:57:46.974470+0000', 'last_fullsized': '2024-08-18T23:57:46.974470+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975835+0000', 'last_change': '2024-08-18T23:57:46.975835+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975835+0000', 'last_undegraded': '2024-08-18T23:57:46.975835+0000', 'last_fullsized': '2024-08-18T23:57:46.975835+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T23:57:51.592 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.978765+0000', 'last_change': '2024-08-18T23:57:46.978765+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.978765+0000', 'last_undegraded': '2024-08-18T23:57:46.978765+0000', 'last_fullsized': '2024-08-18T23:57:46.978765+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.979680+0000', 'last_change': '2024-08-18T23:57:46.979680+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.979680+0000', 'last_undegraded': '2024-08-18T23:57:46.979680+0000', 'last_fullsized': '2024-08-18T23:57:46.979680+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973067+0000', 'last_change': '2024-08-18T23:57:46.973067+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973067+0000', 'last_undegraded': '2024-08-18T23:57:46.973067+0000', 'last_fullsized': '2024-08-18T23:57:46.973067+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974604+0000', 'last_change': '2024-08-18T23:57:46.974604+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974604+0000', 'last_undegraded': '2024-08-18T23:57:46.974604+0000', 'last_fullsized': '2024-08-18T23:57:46.974604+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975826+0000', 'last_change': '2024-08-18T23:57:46.975826+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975826+0000', 'last_undegraded': '2024-08-18T23:57:46.975826+0000', 'last_fullsized': '2024-08-18T23:57:46.975826+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T23:57:51.593 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.977827+0000', 'last_change': '2024-08-18T23:57:46.977827+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.977827+0000', 'last_undegraded': '2024-08-18T23:57:46.977827+0000', 'last_fullsized': '2024-08-18T23:57:46.977827+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973170+0000', 'last_change': '2024-08-18T23:57:46.973170+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973170+0000', 'last_undegraded': '2024-08-18T23:57:46.973170+0000', 'last_fullsized': '2024-08-18T23:57:46.973170+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.971981+0000', 'last_change': '2024-08-18T23:57:46.971981+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.971981+0000', 'last_undegraded': '2024-08-18T23:57:46.971981+0000', 'last_fullsized': '2024-08-18T23:57:46.971981+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.968145+0000', 'last_change': '2024-08-18T23:57:46.968145+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.968145+0000', 'last_undegraded': '2024-08-18T23:57:46.968145+0000', 'last_fullsized': '2024-08-18T23:57:46.968145+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.969033+0000', 'last_change': '2024-08-18T23:57:46.969033+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.969033+0000', 'last_undegraded': '2024-08-18T23:57:46.969033+0000', 'last_fullsized': '2024-08-18T23:57:46.969033+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-08-18T23:57:51.594 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.968289+0000', 'last_change': '2024-08-18T23:57:46.968289+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.968289+0000', 'last_undegraded': '2024-08-18T23:57:46.968289+0000', 'last_fullsized': '2024-08-18T23:57:46.968289+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974058+0000', 'last_change': '2024-08-18T23:57:46.974058+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974058+0000', 'last_undegraded': '2024-08-18T23:57:46.974058+0000', 'last_fullsized': '2024-08-18T23:57:46.974058+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975380+0000', 'last_change': '2024-08-18T23:57:46.975380+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975380+0000', 'last_undegraded': '2024-08-18T23:57:46.975380+0000', 'last_fullsized': '2024-08-18T23:57:46.975380+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.972537+0000', 'last_change': '2024-08-18T23:57:46.972537+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.972537+0000', 'last_undegraded': '2024-08-18T23:57:46.972537+0000', 'last_fullsized': '2024-08-18T23:57:46.972537+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.968636+0000', 'last_change': '2024-08-18T23:57:46.968636+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.968636+0000', 'last_undegraded': '2024-08-18T23:57:46.968636+0000', 'last_fullsized': '2024-08-18T23:57:46.968636+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.968350+0000', 'last_change': '2024-08-18T23:57:46.968350+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.968350+0000', 'last_undegraded': '2024-08-18T23:57:46.968350+0000', 'last_fullsized': '2024-08-18T23:57:46.968350+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T23:57:51.595 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.978705+0000', 'last_change': '2024-08-18T23:57:46.978705+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.978705+0000', 'last_undegraded': '2024-08-18T23:57:46.978705+0000', 'last_fullsized': '2024-08-18T23:57:46.978705+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.969021+0000', 'last_change': '2024-08-18T23:57:46.969021+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.969021+0000', 'last_undegraded': '2024-08-18T23:57:46.969021+0000', 'last_fullsized': '2024-08-18T23:57:46.969021+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974982+0000', 'last_change': '2024-08-18T23:57:46.974982+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974982+0000', 'last_undegraded': '2024-08-18T23:57:46.974982+0000', 'last_fullsized': '2024-08-18T23:57:46.974982+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.968755+0000', 'last_change': '2024-08-18T23:57:46.968755+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.968755+0000', 'last_undegraded': '2024-08-18T23:57:46.968755+0000', 'last_fullsized': '2024-08-18T23:57:46.968755+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.967950+0000', 'last_change': '2024-08-18T23:57:46.967950+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.967950+0000', 'last_undegraded': '2024-08-18T23:57:46.967950+0000', 'last_fullsized': '2024-08-18T23:57:46.967950+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-08-18T23:57:51.596 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.971645+0000', 'last_change': '2024-08-18T23:57:46.971645+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.971645+0000', 'last_undegraded': '2024-08-18T23:57:46.971645+0000', 'last_fullsized': '2024-08-18T23:57:46.971645+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.978675+0000', 'last_change': '2024-08-18T23:57:46.978675+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.978675+0000', 'last_undegraded': '2024-08-18T23:57:46.978675+0000', 'last_fullsized': '2024-08-18T23:57:46.978675+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.972949+0000', 'last_change': '2024-08-18T23:57:46.972949+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.972949+0000', 'last_undegraded': '2024-08-18T23:57:46.972949+0000', 'last_fullsized': '2024-08-18T23:57:46.972949+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975878+0000', 'last_change': '2024-08-18T23:57:46.975878+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975878+0000', 'last_undegraded': '2024-08-18T23:57:46.975878+0000', 'last_fullsized': '2024-08-18T23:57:46.975878+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.976097+0000', 'last_change': '2024-08-18T23:57:46.976097+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.976097+0000', 'last_undegraded': '2024-08-18T23:57:46.976097+0000', 'last_fullsized': '2024-08-18T23:57:46.976097+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974099+0000', 'last_change': '2024-08-18T23:57:46.974099+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974099+0000', 'last_undegraded': '2024-08-18T23:57:46.974099+0000', 'last_fullsized': '2024-08-18T23:57:46.974099+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-08-18T23:57:51.597 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973061+0000', 'last_change': '2024-08-18T23:57:46.973061+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973061+0000', 'last_undegraded': '2024-08-18T23:57:46.973061+0000', 'last_fullsized': '2024-08-18T23:57:46.973061+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973927+0000', 'last_change': '2024-08-18T23:57:46.973927+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973927+0000', 'last_undegraded': '2024-08-18T23:57:46.973927+0000', 'last_fullsized': '2024-08-18T23:57:46.973927+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974753+0000', 'last_change': '2024-08-18T23:57:46.974753+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974753+0000', 'last_undegraded': '2024-08-18T23:57:46.974753+0000', 'last_fullsized': '2024-08-18T23:57:46.974753+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.976139+0000', 'last_change': '2024-08-18T23:57:46.976139+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.976139+0000', 'last_undegraded': '2024-08-18T23:57:46.976139+0000', 'last_fullsized': '2024-08-18T23:57:46.976139+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.968931+0000', 'last_change': '2024-08-18T23:57:46.968931+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.968931+0000', 'last_undegraded': '2024-08-18T23:57:46.968931+0000', 'last_fullsized': '2024-08-18T23:57:46.968931+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-08-18T23:57:51.598 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975770+0000', 'last_change': '2024-08-18T23:57:46.975770+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975770+0000', 'last_undegraded': '2024-08-18T23:57:46.975770+0000', 'last_fullsized': '2024-08-18T23:57:46.975770+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.972174+0000', 'last_change': '2024-08-18T23:57:46.972174+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.972174+0000', 'last_undegraded': '2024-08-18T23:57:46.972174+0000', 'last_fullsized': '2024-08-18T23:57:46.972174+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974066+0000', 'last_change': '2024-08-18T23:57:46.974066+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974066+0000', 'last_undegraded': '2024-08-18T23:57:46.974066+0000', 'last_fullsized': '2024-08-18T23:57:46.974066+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.972538+0000', 'last_change': '2024-08-18T23:57:46.972538+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.972538+0000', 'last_undegraded': '2024-08-18T23:57:46.972538+0000', 'last_fullsized': '2024-08-18T23:57:46.972538+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973663+0000', 'last_change': '2024-08-18T23:57:46.973663+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973663+0000', 'last_undegraded': '2024-08-18T23:57:46.973663+0000', 'last_fullsized': '2024-08-18T23:57:46.973663+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.972239+0000', 'last_change': '2024-08-18T23:57:46.972239+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.972239+0000', 'last_undegraded': '2024-08-18T23:57:46.972239+0000', 'last_fullsized': '2024-08-18T23:57:46.972239+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-08-18T23:57:51.599 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975683+0000', 'last_change': '2024-08-18T23:57:46.975683+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975683+0000', 'last_undegraded': '2024-08-18T23:57:46.975683+0000', 'last_fullsized': '2024-08-18T23:57:46.975683+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974081+0000', 'last_change': '2024-08-18T23:57:46.974081+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974081+0000', 'last_undegraded': '2024-08-18T23:57:46.974081+0000', 'last_fullsized': '2024-08-18T23:57:46.974081+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.979212+0000', 'last_change': '2024-08-18T23:57:46.979212+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.979212+0000', 'last_undegraded': '2024-08-18T23:57:46.979212+0000', 'last_fullsized': '2024-08-18T23:57:46.979212+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973569+0000', 'last_change': '2024-08-18T23:57:46.973569+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973569+0000', 'last_undegraded': '2024-08-18T23:57:46.973569+0000', 'last_fullsized': '2024-08-18T23:57:46.973569+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.968921+0000', 'last_change': '2024-08-18T23:57:46.968921+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.968921+0000', 'last_undegraded': '2024-08-18T23:57:46.968921+0000', 'last_fullsized': '2024-08-18T23:57:46.968921+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.972363+0000', 'last_change': '2024-08-18T23:57:46.972363+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.972363+0000', 'last_undegraded': '2024-08-18T23:57:46.972363+0000', 'last_fullsized': '2024-08-18T23:57:46.972363+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.600 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.972171+0000', 'last_change': '2024-08-18T23:57:46.972171+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.972171+0000', 'last_undegraded': '2024-08-18T23:57:46.972171+0000', 'last_fullsized': '2024-08-18T23:57:46.972171+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974068+0000', 'last_change': '2024-08-18T23:57:46.974068+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974068+0000', 'last_undegraded': '2024-08-18T23:57:46.974068+0000', 'last_fullsized': '2024-08-18T23:57:46.974068+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.974834+0000', 'last_change': '2024-08-18T23:57:46.974834+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.974834+0000', 'last_undegraded': '2024-08-18T23:57:46.974834+0000', 'last_fullsized': '2024-08-18T23:57:46.974834+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975018+0000', 'last_change': '2024-08-18T23:57:46.975018+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975018+0000', 'last_undegraded': '2024-08-18T23:57:46.975018+0000', 'last_fullsized': '2024-08-18T23:57:46.975018+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.975329+0000', 'last_change': '2024-08-18T23:57:46.975329+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.975329+0000', 'last_undegraded': '2024-08-18T23:57:46.975329+0000', 'last_fullsized': '2024-08-18T23:57:46.975329+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-08-18T23:57:51.601 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973560+0000', 'last_change': '2024-08-18T23:57:46.973560+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973560+0000', 'last_undegraded': '2024-08-18T23:57:46.973560+0000', 'last_fullsized': '2024-08-18T23:57:46.973560+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.971926+0000', 'last_change': '2024-08-18T23:57:46.971926+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.971926+0000', 'last_undegraded': '2024-08-18T23:57:46.971926+0000', 'last_fullsized': '2024-08-18T23:57:46.971926+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973204+0000', 'last_change': '2024-08-18T23:57:46.973204+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973204+0000', 'last_undegraded': '2024-08-18T23:57:46.973204+0000', 'last_fullsized': '2024-08-18T23:57:46.973204+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.973245+0000', 'last_change': '2024-08-18T23:57:46.973245+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.973245+0000', 'last_undegraded': '2024-08-18T23:57:46.973245+0000', 'last_fullsized': '2024-08-18T23:57:46.973245+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.971984+0000', 'last_change': '2024-08-18T23:57:46.971984+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.971984+0000', 'last_undegraded': '2024-08-18T23:57:46.971984+0000', 'last_fullsized': '2024-08-18T23:57:46.971984+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-08-18T23:57:51.602 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2024-08-18T23:57:46.976993+0000', 'last_change': '2024-08-18T23:57:46.976993+0000', 'last_active': '2024-08-18T23:57:46.962204+0000', 'last_peered': '2024-08-18T23:57:46.962204+0000', 'last_clean': '2024-08-18T23:57:46.962204+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-08-18T23:57:46.976993+0000', 'last_undegraded': '2024-08-18T23:57:46.976993+0000', 'last_fullsized': '2024-08-18T23:57:46.976993+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'last_clean_scrub_stamp': '2024-08-18T23:57:46.962204+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-08-18T23:57:51.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-18T23:57:51.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.724+0000 7fc8a19b9640 1 Processor -- start 2024-08-18T23:57:51.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.724+0000 7fc8a19b9640 1 -- start start 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8a19b9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc89c15f8a0 0x7fc89c0d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8a19b9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc89c0d4bc0 0x7fc89c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8a19b9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8a19b9640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fc89c0cfc00 con 0x7fc89c0d4bc0 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8a19b9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc89c0d0860 con 0x7fc89c15f8a0 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8a19b9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc89c0b32c0 con 0x7fc89c0d1530 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8927fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc89c0d4bc0 0x7fc89c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8927fc640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc89c0d4bc0 0x7fc89c0d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37084/0 (socket says 172.21.15.103:37084) 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8927fc640 1 -- 172.21.15.103:0/2410705230 learned_addr learned my addr 172.21.15.103:0/2410705230 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc89affd640 1 --2- 172.21.15.103:0/2410705230 >> v2:172.21.15.190:3300/0 conn(0x7fc89c15f8a0 0x7fc89c0d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc89b7fe640 1 --2- 172.21.15.103:0/2410705230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8927fc640 1 -- 172.21.15.103:0/2410705230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 msgr2=0x7fc89c0d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:51.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8927fc640 1 --2- 172.21.15.103:0/2410705230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8927fc640 1 -- 172.21.15.103:0/2410705230 >> v2:172.21.15.190:3300/0 conn(0x7fc89c15f8a0 msgr2=0x7fc89c0d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:51.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8927fc640 1 --2- 172.21.15.103:0/2410705230 >> v2:172.21.15.190:3300/0 conn(0x7fc89c15f8a0 0x7fc89c0d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc8927fc640 1 -- 172.21.15.103:0/2410705230 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c0d0090 con 0x7fc89c0d4bc0 2024-08-18T23:57:51.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.725+0000 7fc89b7fe640 1 --2- 172.21.15.103:0/2410705230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:51.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.726+0000 7fc8927fc640 1 --2- 172.21.15.103:0/2410705230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c0d4bc0 0x7fc89c0d0ff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc89c06c430 tx=0x7fc88402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe55e6ee7a04a376 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.726+0000 7fc89a7fc640 1 -- 172.21.15.103:0/2410705230 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc884037070 con 0x7fc89c0d4bc0 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.726+0000 7fc89a7fc640 1 -- 172.21.15.103:0/2410705230 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc884032440 con 0x7fc89c0d4bc0 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.726+0000 7fc89a7fc640 1 -- 172.21.15.103:0/2410705230 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc884032810 con 0x7fc89c0d4bc0 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 -- 172.21.15.103:0/2410705230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c0d4bc0 msgr2=0x7fc89c0d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/2410705230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c0d4bc0 0x7fc89c0d0ff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc89c06c430 tx=0x7fc88402a1e0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 -- 172.21.15.103:0/2410705230 shutdown_connections 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/2410705230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/2410705230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c0d4bc0 0x7fc89c0d0ff0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/2410705230 >> v2:172.21.15.190:3300/0 conn(0x7fc89c15f8a0 0x7fc89c0d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 -- 172.21.15.103:0/2410705230 >> 172.21.15.103:0/2410705230 conn(0x7fc89c0d40a0 msgr2=0x7fc89c0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 -- 172.21.15.103:0/2410705230 shutdown_connections 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.727+0000 7fc8a19b9640 1 -- 172.21.15.103:0/2410705230 wait complete. 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.728+0000 7fc8a19b9640 1 Processor -- start 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.728+0000 7fc8a19b9640 1 -- start start 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc8a19b9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0b9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc8a19b9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc89c0d4bc0 0x7fc89c0b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc8a19b9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c15f8a0 0x7fc89c0b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc8a19b9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c0b2fb0 con 0x7fc89c15f8a0 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc8a19b9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc89c0cf890 con 0x7fc89c0d4bc0 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc8a19b9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc89c15fc80 con 0x7fc89c0d1530 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c15f8a0 0x7fc89c0b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c15f8a0 0x7fc89c0b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37094/0 (socket says 172.21.15.103:37094) 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89b7fe640 1 -- 172.21.15.103:0/3018426960 learned_addr learned my addr 172.21.15.103:0/3018426960 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:51.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89affd640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc8927fc640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc89c0d4bc0 0x7fc89c0b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89b7fe640 1 -- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 msgr2=0x7fc89c0b9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89b7fe640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0b9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89b7fe640 1 -- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc89c0d4bc0 msgr2=0x7fc89c0b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89b7fe640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc89c0d4bc0 0x7fc89c0b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89b7fe640 1 -- 172.21.15.103:0/3018426960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc89c15b190 con 0x7fc89c15f8a0 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc89affd640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.729+0000 7fc8927fc640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc89c0d4bc0 0x7fc89c0b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.730+0000 7fc89b7fe640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c15f8a0 0x7fc89c0b2030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc894007e40 tx=0x7fc89400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.730+0000 7fc898ff9640 1 -- 172.21.15.103:0/3018426960 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89401a070 con 0x7fc89c15f8a0 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.730+0000 7fc898ff9640 1 -- 172.21.15.103:0/3018426960 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc894003b90 con 0x7fc89c15f8a0 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.730+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89c0cbb70 con 0x7fc89c15f8a0 2024-08-18T23:57:51.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.730+0000 7fc898ff9640 1 -- 172.21.15.103:0/3018426960 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89400de80 con 0x7fc89c15f8a0 2024-08-18T23:57:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.730+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89c15e850 con 0x7fc89c15f8a0 2024-08-18T23:57:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.731+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc89c0d0ab0 con 0x7fc89c15f8a0 2024-08-18T23:57:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.731+0000 7fc898ff9640 1 -- 172.21.15.103:0/3018426960 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc89401d070 con 0x7fc89c15f8a0 2024-08-18T23:57:51.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.732+0000 7fc898ff9640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc87c06be30 0x7fc87c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.732+0000 7fc898ff9640 1 -- 172.21.15.103:0/3018426960 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fc89408b330 con 0x7fc89c15f8a0 2024-08-18T23:57:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.732+0000 7fc89affd640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc87c06be30 0x7fc87c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:51.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.732+0000 7fc89affd640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc87c06be30 0x7fc87c06e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009af0 tx=0x7fc88c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:51.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.736+0000 7fc898ff9640 1 -- 172.21.15.103:0/3018426960 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc894010070 con 0x7fc89c15f8a0 2024-08-18T23:57:51.947 INFO:tasks.ceph.mds.a.smithi103.stderr:2024-08-18T23:57:51.945+0000 7fcf56ced640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T23:57:51.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.966+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc89c074580 con 0x7fc89c15f8a0 2024-08-18T23:57:51.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.967+0000 7fc898ff9640 1 -- 172.21.15.103:0/3018426960 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1623 (secure 0 0 0) 0x7fc894059ac0 con 0x7fc89c15f8a0 2024-08-18T23:57:51.968 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:51.968 INFO:teuthology.orchestra.run.smithi103.stdout:{"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":81,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":38,"num_osds":8,"num_up_osds":8,"osd_up_since":1724025401,"num_in_osds":8,"osd_in_since":1724025392,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225763328,"bytes_avail":772868349952,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4917}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-08-18T23:57:44.175892+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-08-18T23:57:51.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc87c06be30 msgr2=0x7fc87c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc87c06be30 0x7fc87c06e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009af0 tx=0x7fc88c008040 comp rx=0 tx=0).stop 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c15f8a0 msgr2=0x7fc89c0b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c15f8a0 0x7fc89c0b2030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc894007e40 tx=0x7fc89400d4a0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 shutdown_connections 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc87c06be30 0x7fc87c06e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc89c15f8a0 0x7fc89c0b2030 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc89c0d4bc0 0x7fc89c0b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 --2- 172.21.15.103:0/3018426960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc89c0d1530 0x7fc89c0b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 >> 172.21.15.103:0/3018426960 conn(0x7fc89c0d40a0 msgr2=0x7fc89c160ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 shutdown_connections 2024-08-18T23:57:51.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:51.969+0000 7fc8a19b9640 1 -- 172.21.15.103:0/3018426960 wait complete. 2024-08-18T23:57:51.981 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-08-18T23:57:51.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:52.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.078+0000 7f8e652d2640 1 Processor -- start 2024-08-18T23:57:52.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.079+0000 7f8e652d2640 1 -- start start 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.079+0000 7f8e652d2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8e6006ced0 0x7f8e600b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.079+0000 7f8e652d2640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600b1f20 con 0x7f8e6015e320 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.079+0000 7f8e652d2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600b2200 con 0x7f8e600b2ce0 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.079+0000 7f8e652d2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8e600b1b70 con 0x7f8e6006ced0 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.079+0000 7f8e5e7fc640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8e6015e320 0x7f8e6006d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:42246/0 (socket says 172.21.15.103:42246) 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5e7fc640 1 -- 172.21.15.103:0/553420207 learned_addr learned my addr 172.21.15.103:0/553420207 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419065859 0 0) 0x7f8e600b1f20 con 0x7f8e6015e320 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e48003520 con 0x7f8e6015e320 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5effd640 1 --2- 172.21.15.103:0/553420207 >> v2:172.21.15.190:3300/0 conn(0x7f8e6006ced0 0x7f8e600b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3169993890 0 0) 0x7f8e48003520 con 0x7f8e6015e320 2024-08-18T23:57:52.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 >> v2:172.21.15.190:3300/0 conn(0x7f8e6006ced0 msgr2=0x7f8e600b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 --2- 172.21.15.103:0/553420207 >> v2:172.21.15.190:3300/0 conn(0x7f8e6006ced0 0x7f8e600b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 >> v1:172.21.15.190:6789/0 conn(0x7f8e600b2ce0 legacy=0x7f8e600cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e600b24e0 con 0x7f8e6015e320 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f8e54001670 con 0x7f8e6015e320 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 >> v1:172.21.15.103:6789/0 conn(0x7f8e6015e320 legacy=0x7f8e6006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e48004800 0x7f8e48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e480051c0 0x7f8e4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e600b1b70 con 0x7f8e480039b0 2024-08-18T23:57:52.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4800c110 con 0x7f8e48004800 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4800c310 con 0x7f8e480051c0 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5effd640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5e7fc640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e48004800 0x7f8e48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5f7fe640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e480051c0 0x7f8e4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5effd640 1 -- 172.21.15.103:0/553420207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e480051c0 msgr2=0x7f8e4800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5effd640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e480051c0 0x7f8e4800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5effd640 1 -- 172.21.15.103:0/553420207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e48004800 msgr2=0x7f8e48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5effd640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e48004800 0x7f8e48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5effd640 1 -- 172.21.15.103:0/553420207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e48003520 con 0x7f8e480039b0 2024-08-18T23:57:52.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.080+0000 7f8e5f7fe640 1 -- 172.21.15.103:0/553420207 reap_dead start 2024-08-18T23:57:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.081+0000 7f8e5effd640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e48003dd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000ba30 tx=0x7f8e48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f212a1ed8245b22 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.081+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50030070 con 0x7f8e480039b0 2024-08-18T23:57:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.081+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e5002ade0 con 0x7f8e480039b0 2024-08-18T23:57:52.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.081+0000 7f8e5dffb640 1 -- 172.21.15.103:0/553420207 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000b600 con 0x7f8e480039b0 2024-08-18T23:57:52.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.082+0000 7f8e652d2640 1 -- 172.21.15.103:0/553420207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 msgr2=0x7f8e48003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:52.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.082+0000 7f8e652d2640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e48003dd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000ba30 tx=0x7f8e48005830 comp rx=0 tx=0).stop 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.082+0000 7f8e652d2640 1 -- 172.21.15.103:0/553420207 shutdown_connections 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.082+0000 7f8e652d2640 1 --2- 172.21.15.103:0/553420207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e48003dd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.082+0000 7f8e652d2640 1 -- 172.21.15.103:0/553420207 >> 172.21.15.103:0/553420207 conn(0x7f8e6006c400 msgr2=0x7f8e6009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.082+0000 7f8e652d2640 1 -- 172.21.15.103:0/553420207 shutdown_connections 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.082+0000 7f8e652d2640 1 -- 172.21.15.103:0/553420207 wait complete. 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.083+0000 7f8e652d2640 1 Processor -- start 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.083+0000 7f8e652d2640 1 -- start start 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e652d2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e60156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e652d2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e601597c0 0x7f8e60159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e652d2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e600b6e90 0x7f8e600b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e652d2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e600cf3d0 con 0x7f8e480039b0 2024-08-18T23:57:52.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e652d2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8e600cf250 con 0x7f8e601597c0 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e652d2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8e600cf550 con 0x7f8e600b6e90 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e60156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e60156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37116/0 (socket says 172.21.15.103:37116) 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5effd640 1 -- 172.21.15.103:0/565698232 learned_addr learned my addr 172.21.15.103:0/565698232 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5f7fe640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e600b6e90 0x7f8e600b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5e7fc640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e601597c0 0x7f8e60159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5effd640 1 -- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e600b6e90 msgr2=0x7f8e600b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5effd640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e600b6e90 0x7f8e600b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5effd640 1 -- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e601597c0 msgr2=0x7f8e60159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5effd640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e601597c0 0x7f8e60159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5effd640 1 -- 172.21.15.103:0/565698232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e60160cf0 con 0x7f8e480039b0 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.084+0000 7f8e5f7fe640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e600b6e90 0x7f8e600b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:52.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.085+0000 7f8e5effd640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e60156330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e5002a8d0 tx=0x7f8e500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.085+0000 7f8e477fe640 1 -- 172.21.15.103:0/565698232 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50043030 con 0x7f8e480039b0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.085+0000 7f8e477fe640 1 -- 172.21.15.103:0/565698232 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e5002abe0 con 0x7f8e480039b0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.085+0000 7f8e477fe640 1 -- 172.21.15.103:0/565698232 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5000b600 con 0x7f8e480039b0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.085+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e60160f90 con 0x7f8e480039b0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.085+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6015a280 con 0x7f8e480039b0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.086+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6009b7a0 con 0x7f8e480039b0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.086+0000 7f8e477fe640 1 -- 172.21.15.103:0/565698232 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e50046070 con 0x7f8e480039b0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.086+0000 7f8e477fe640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8e4c06be60 0x7f8e4c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.087+0000 7f8e477fe640 1 -- 172.21.15.103:0/565698232 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f8e500ab9b0 con 0x7f8e480039b0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.087+0000 7f8e5e7fc640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8e4c06be60 0x7f8e4c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:52.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.087+0000 7f8e5e7fc640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8e4c06be60 0x7f8e4c06e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8e600af550 tx=0x7f8e54009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:52.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.091+0000 7f8e477fe640 1 -- 172.21.15.103:0/565698232 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f8e5003c3a0 con 0x7f8e480039b0 2024-08-18T23:57:52.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.255+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e600af880 con 0x7f8e4c06be60 2024-08-18T23:57:52.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.260+0000 7f8e477fe640 1 -- 172.21.15.103:0/565698232 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246634 (secure 0 0 0) 0x7f8e600af880 con 0x7f8e4c06be60 2024-08-18T23:57:52.264 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:52.265 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8e4c06be60 msgr2=0x7f8e4c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8e4c06be60 0x7f8e4c06e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8e600af550 tx=0x7f8e54009040 comp rx=0 tx=0).stop 2024-08-18T23:57:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 msgr2=0x7f8e60156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e60156330 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8e5002a8d0 tx=0x7f8e500046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 shutdown_connections 2024-08-18T23:57:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f8e4c06be60 0x7f8e4c06e320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8e600b6e90 0x7f8e600b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8e601597c0 0x7f8e60159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 --2- 172.21.15.103:0/565698232 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e480039b0 0x7f8e60156330 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.263+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 >> 172.21.15.103:0/565698232 conn(0x7f8e6006c400 msgr2=0x7f8e600aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.264+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 shutdown_connections 2024-08-18T23:57:52.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:52.264+0000 7f8e652d2640 1 -- 172.21.15.103:0/565698232 wait complete. 2024-08-18T23:57:52.276 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-08-18T23:57:52.177045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220472,"kb_used_data":4308,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754248,"statfs":{"total":773094113280,"available":772868349952,"internally_reserved":0,"allocated":4411392,"data_stored":2544779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000897"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975424+0000","last_change":"2024-08-18T23:57:46.975424+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975424+0000","last_undegraded":"2024-08-18T23:57:46.975424+0000","last_fullsized":"2024-08-18T23:57:46.975424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974932+0000","last_change":"2024-08-18T23:57:46.974932+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974932+0000","last_undegraded":"2024-08-18T23:57:46.974932+0000","last_fullsized":"2024-08-18T23:57:46.974932+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976316+0000","last_change":"2024-08-18T23:57:46.976316+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976316+0000","last_undegraded":"2024-08-18T23:57:46.976316+0000","last_fullsized":"2024-08-18T23:57:46.976316+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969632+0000","last_change":"2024-08-18T23:57:46.969632+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969632+0000","last_undegraded":"2024-08-18T23:57:46.969632+0000","last_fullsized":"2024-08-18T23:57:46.969632+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968772+0000","last_change":"2024-08-18T23:57:46.968772+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968772+0000","last_undegraded":"2024-08-18T23:57:46.968772+0000","last_fullsized":"2024-08-18T23:57:46.968772+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979418+0000","last_change":"2024-08-18T23:57:46.979418+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979418+0000","last_undegraded":"2024-08-18T23:57:46.979418+0000","last_fullsized":"2024-08-18T23:57:46.979418+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978627+0000","last_change":"2024-08-18T23:57:46.978627+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978627+0000","last_undegraded":"2024-08-18T23:57:46.978627+0000","last_fullsized":"2024-08-18T23:57:46.978627+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974470+0000","last_change":"2024-08-18T23:57:46.974470+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974470+0000","last_undegraded":"2024-08-18T23:57:46.974470+0000","last_fullsized":"2024-08-18T23:57:46.974470+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975835+0000","last_change":"2024-08-18T23:57:46.975835+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975835+0000","last_undegraded":"2024-08-18T23:57:46.975835+0000","last_fullsized":"2024-08-18T23:57:46.975835+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978765+0000","last_change":"2024-08-18T23:57:46.978765+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978765+0000","last_undegraded":"2024-08-18T23:57:46.978765+0000","last_fullsized":"2024-08-18T23:57:46.978765+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979680+0000","last_change":"2024-08-18T23:57:46.979680+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979680+0000","last_undegraded":"2024-08-18T23:57:46.979680+0000","last_fullsized":"2024-08-18T23:57:46.979680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973067+0000","last_change":"2024-08-18T23:57:46.973067+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973067+0000","last_undegraded":"2024-08-18T23:57:46.973067+0000","last_fullsized":"2024-08-18T23:57:46.973067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974604+0000","last_change":"2024-08-18T23:57:46.974604+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974604+0000","last_undegraded":"2024-08-18T23:57:46.974604+0000","last_fullsized":"2024-08-18T23:57:46.974604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975826+0000","last_change":"2024-08-18T23:57:46.975826+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975826+0000","last_undegraded":"2024-08-18T23:57:46.975826+0000","last_fullsized":"2024-08-18T23:57:46.975826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.977827+0000","last_change":"2024-08-18T23:57:46.977827+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.977827+0000","last_undegraded":"2024-08-18T23:57:46.977827+0000","last_fullsized":"2024-08-18T23:57:46.977827+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973170+0000","last_change":"2024-08-18T23:57:46.973170+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973170+0000","last_undegraded":"2024-08-18T23:57:46.973170+0000","last_fullsized":"2024-08-18T23:57:46.973170+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971981+0000","last_change":"2024-08-18T23:57:46.971981+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971981+0000","last_undegraded":"2024-08-18T23:57:46.971981+0000","last_fullsized":"2024-08-18T23:57:46.971981+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968145+0000","last_change":"2024-08-18T23:57:46.968145+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968145+0000","last_undegraded":"2024-08-18T23:57:46.968145+0000","last_fullsized":"2024-08-18T23:57:46.968145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969033+0000","last_change":"2024-08-18T23:57:46.969033+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969033+0000","last_undegraded":"2024-08-18T23:57:46.969033+0000","last_fullsized":"2024-08-18T23:57:46.969033+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968289+0000","last_change":"2024-08-18T23:57:46.968289+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968289+0000","last_undegraded":"2024-08-18T23:57:46.968289+0000","last_fullsized":"2024-08-18T23:57:46.968289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974058+0000","last_change":"2024-08-18T23:57:46.974058+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974058+0000","last_undegraded":"2024-08-18T23:57:46.974058+0000","last_fullsized":"2024-08-18T23:57:46.974058+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975380+0000","last_change":"2024-08-18T23:57:46.975380+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975380+0000","last_undegraded":"2024-08-18T23:57:46.975380+0000","last_fullsized":"2024-08-18T23:57:46.975380+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972537+0000","last_change":"2024-08-18T23:57:46.972537+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972537+0000","last_undegraded":"2024-08-18T23:57:46.972537+0000","last_fullsized":"2024-08-18T23:57:46.972537+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968636+0000","last_change":"2024-08-18T23:57:46.968636+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968636+0000","last_undegraded":"2024-08-18T23:57:46.968636+0000","last_fullsized":"2024-08-18T23:57:46.968636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968350+0000","last_change":"2024-08-18T23:57:46.968350+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968350+0000","last_undegraded":"2024-08-18T23:57:46.968350+0000","last_fullsized":"2024-08-18T23:57:46.968350+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978705+0000","last_change":"2024-08-18T23:57:46.978705+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978705+0000","last_undegraded":"2024-08-18T23:57:46.978705+0000","last_fullsized":"2024-08-18T23:57:46.978705+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.969021+0000","last_change":"2024-08-18T23:57:46.969021+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.969021+0000","last_undegraded":"2024-08-18T23:57:46.969021+0000","last_fullsized":"2024-08-18T23:57:46.969021+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974982+0000","last_change":"2024-08-18T23:57:46.974982+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974982+0000","last_undegraded":"2024-08-18T23:57:46.974982+0000","last_fullsized":"2024-08-18T23:57:46.974982+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968755+0000","last_change":"2024-08-18T23:57:46.968755+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968755+0000","last_undegraded":"2024-08-18T23:57:46.968755+0000","last_fullsized":"2024-08-18T23:57:46.968755+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.967950+0000","last_change":"2024-08-18T23:57:46.967950+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.967950+0000","last_undegraded":"2024-08-18T23:57:46.967950+0000","last_fullsized":"2024-08-18T23:57:46.967950+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971645+0000","last_change":"2024-08-18T23:57:46.971645+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971645+0000","last_undegraded":"2024-08-18T23:57:46.971645+0000","last_fullsized":"2024-08-18T23:57:46.971645+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.978675+0000","last_change":"2024-08-18T23:57:46.978675+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.978675+0000","last_undegraded":"2024-08-18T23:57:46.978675+0000","last_fullsized":"2024-08-18T23:57:46.978675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972949+0000","last_change":"2024-08-18T23:57:46.972949+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972949+0000","last_undegraded":"2024-08-18T23:57:46.972949+0000","last_fullsized":"2024-08-18T23:57:46.972949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981304+0000","last_change":"2024-08-18T23:57:46.978262+0000","last_active":"2024-08-18T23:57:46.981304+0000","last_peered":"2024-08-18T23:57:46.981304+0000","last_clean":"2024-08-18T23:57:46.981304+0000","last_became_active":"2024-08-18T23:57:46.977521+0000","last_became_peered":"2024-08-18T23:57:46.977521+0000","last_unstale":"2024-08-18T23:57:46.981304+0000","last_undegraded":"2024-08-18T23:57:46.981304+0000","last_fullsized":"2024-08-18T23:57:46.981304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975878+0000","last_change":"2024-08-18T23:57:46.975878+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975878+0000","last_undegraded":"2024-08-18T23:57:46.975878+0000","last_fullsized":"2024-08-18T23:57:46.975878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988135+0000","last_change":"2024-08-18T23:57:46.986870+0000","last_active":"2024-08-18T23:57:46.988135+0000","last_peered":"2024-08-18T23:57:46.988135+0000","last_clean":"2024-08-18T23:57:46.988135+0000","last_became_active":"2024-08-18T23:57:46.986630+0000","last_became_peered":"2024-08-18T23:57:46.986630+0000","last_unstale":"2024-08-18T23:57:46.988135+0000","last_undegraded":"2024-08-18T23:57:46.988135+0000","last_fullsized":"2024-08-18T23:57:46.988135+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976097+0000","last_change":"2024-08-18T23:57:46.976097+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976097+0000","last_undegraded":"2024-08-18T23:57:46.976097+0000","last_fullsized":"2024-08-18T23:57:46.976097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988243+0000","last_change":"2024-08-18T23:57:46.986467+0000","last_active":"2024-08-18T23:57:46.988243+0000","last_peered":"2024-08-18T23:57:46.988243+0000","last_clean":"2024-08-18T23:57:46.988243+0000","last_became_active":"2024-08-18T23:57:46.986141+0000","last_became_peered":"2024-08-18T23:57:46.986141+0000","last_unstale":"2024-08-18T23:57:46.988243+0000","last_undegraded":"2024-08-18T23:57:46.988243+0000","last_fullsized":"2024-08-18T23:57:46.988243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974099+0000","last_change":"2024-08-18T23:57:46.974099+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974099+0000","last_undegraded":"2024-08-18T23:57:46.974099+0000","last_fullsized":"2024-08-18T23:57:46.974099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985100+0000","last_change":"2024-08-18T23:57:46.977433+0000","last_active":"2024-08-18T23:57:46.985100+0000","last_peered":"2024-08-18T23:57:46.985100+0000","last_clean":"2024-08-18T23:57:46.985100+0000","last_became_active":"2024-08-18T23:57:46.977134+0000","last_became_peered":"2024-08-18T23:57:46.977134+0000","last_unstale":"2024-08-18T23:57:46.985100+0000","last_undegraded":"2024-08-18T23:57:46.985100+0000","last_fullsized":"2024-08-18T23:57:46.985100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:21:35.309577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973061+0000","last_change":"2024-08-18T23:57:46.973061+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973061+0000","last_undegraded":"2024-08-18T23:57:46.973061+0000","last_fullsized":"2024-08-18T23:57:46.973061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988552+0000","last_change":"2024-08-18T23:57:46.986008+0000","last_active":"2024-08-18T23:57:46.988552+0000","last_peered":"2024-08-18T23:57:46.988552+0000","last_clean":"2024-08-18T23:57:46.988552+0000","last_became_active":"2024-08-18T23:57:46.984486+0000","last_became_peered":"2024-08-18T23:57:46.984486+0000","last_unstale":"2024-08-18T23:57:46.988552+0000","last_undegraded":"2024-08-18T23:57:46.988552+0000","last_fullsized":"2024-08-18T23:57:46.988552+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:49:36.222131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973927+0000","last_change":"2024-08-18T23:57:46.973927+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973927+0000","last_undegraded":"2024-08-18T23:57:46.973927+0000","last_fullsized":"2024-08-18T23:57:46.973927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.989184+0000","last_change":"2024-08-18T23:57:46.986931+0000","last_active":"2024-08-18T23:57:46.989184+0000","last_peered":"2024-08-18T23:57:46.989184+0000","last_clean":"2024-08-18T23:57:46.989184+0000","last_became_active":"2024-08-18T23:57:46.986652+0000","last_became_peered":"2024-08-18T23:57:46.986652+0000","last_unstale":"2024-08-18T23:57:46.989184+0000","last_undegraded":"2024-08-18T23:57:46.989184+0000","last_fullsized":"2024-08-18T23:57:46.989184+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974753+0000","last_change":"2024-08-18T23:57:46.974753+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974753+0000","last_undegraded":"2024-08-18T23:57:46.974753+0000","last_fullsized":"2024-08-18T23:57:46.974753+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988258+0000","last_change":"2024-08-18T23:57:46.986792+0000","last_active":"2024-08-18T23:57:46.988258+0000","last_peered":"2024-08-18T23:57:46.988258+0000","last_clean":"2024-08-18T23:57:46.988258+0000","last_became_active":"2024-08-18T23:57:46.986493+0000","last_became_peered":"2024-08-18T23:57:46.986493+0000","last_unstale":"2024-08-18T23:57:46.988258+0000","last_undegraded":"2024-08-18T23:57:46.988258+0000","last_fullsized":"2024-08-18T23:57:46.988258+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976139+0000","last_change":"2024-08-18T23:57:46.976139+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976139+0000","last_undegraded":"2024-08-18T23:57:46.976139+0000","last_fullsized":"2024-08-18T23:57:46.976139+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985654+0000","last_change":"2024-08-18T23:57:46.982717+0000","last_active":"2024-08-18T23:57:46.985654+0000","last_peered":"2024-08-18T23:57:46.985654+0000","last_clean":"2024-08-18T23:57:46.985654+0000","last_became_active":"2024-08-18T23:57:46.982435+0000","last_became_peered":"2024-08-18T23:57:46.982435+0000","last_unstale":"2024-08-18T23:57:46.985654+0000","last_undegraded":"2024-08-18T23:57:46.985654+0000","last_fullsized":"2024-08-18T23:57:46.985654+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968931+0000","last_change":"2024-08-18T23:57:46.968931+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968931+0000","last_undegraded":"2024-08-18T23:57:46.968931+0000","last_fullsized":"2024-08-18T23:57:46.968931+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.984834+0000","last_change":"2024-08-18T23:57:46.981068+0000","last_active":"2024-08-18T23:57:46.984834+0000","last_peered":"2024-08-18T23:57:46.984834+0000","last_clean":"2024-08-18T23:57:46.984834+0000","last_became_active":"2024-08-18T23:57:46.980803+0000","last_became_peered":"2024-08-18T23:57:46.980803+0000","last_unstale":"2024-08-18T23:57:46.984834+0000","last_undegraded":"2024-08-18T23:57:46.984834+0000","last_fullsized":"2024-08-18T23:57:46.984834+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:47.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975770+0000","last_change":"2024-08-18T23:57:46.975770+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975770+0000","last_undegraded":"2024-08-18T23:57:46.975770+0000","last_fullsized":"2024-08-18T23:57:46.975770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987348+0000","last_change":"2024-08-18T23:57:46.982223+0000","last_active":"2024-08-18T23:57:46.987348+0000","last_peered":"2024-08-18T23:57:46.987348+0000","last_clean":"2024-08-18T23:57:46.987348+0000","last_became_active":"2024-08-18T23:57:46.981942+0000","last_became_peered":"2024-08-18T23:57:46.981942+0000","last_unstale":"2024-08-18T23:57:46.987348+0000","last_undegraded":"2024-08-18T23:57:46.987348+0000","last_fullsized":"2024-08-18T23:57:46.987348+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972174+0000","last_change":"2024-08-18T23:57:46.972174+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972174+0000","last_undegraded":"2024-08-18T23:57:46.972174+0000","last_fullsized":"2024-08-18T23:57:46.972174+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987965+0000","last_change":"2024-08-18T23:57:46.984581+0000","last_active":"2024-08-18T23:57:46.987965+0000","last_peered":"2024-08-18T23:57:46.987965+0000","last_clean":"2024-08-18T23:57:46.987965+0000","last_became_active":"2024-08-18T23:57:46.984283+0000","last_became_peered":"2024-08-18T23:57:46.984283+0000","last_unstale":"2024-08-18T23:57:46.987965+0000","last_undegraded":"2024-08-18T23:57:46.987965+0000","last_fullsized":"2024-08-18T23:57:46.987965+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974066+0000","last_change":"2024-08-18T23:57:46.974066+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974066+0000","last_undegraded":"2024-08-18T23:57:46.974066+0000","last_fullsized":"2024-08-18T23:57:46.974066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985069+0000","last_change":"2024-08-18T23:57:46.979935+0000","last_active":"2024-08-18T23:57:46.985069+0000","last_peered":"2024-08-18T23:57:46.985069+0000","last_clean":"2024-08-18T23:57:46.985069+0000","last_became_active":"2024-08-18T23:57:46.979515+0000","last_became_peered":"2024-08-18T23:57:46.979515+0000","last_unstale":"2024-08-18T23:57:46.985069+0000","last_undegraded":"2024-08-18T23:57:46.985069+0000","last_fullsized":"2024-08-18T23:57:46.985069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:54:29.031353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972538+0000","last_change":"2024-08-18T23:57:46.972538+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972538+0000","last_undegraded":"2024-08-18T23:57:46.972538+0000","last_fullsized":"2024-08-18T23:57:46.972538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979304+0000","last_change":"2024-08-18T23:57:46.976894+0000","last_active":"2024-08-18T23:57:46.979304+0000","last_peered":"2024-08-18T23:57:46.979304+0000","last_clean":"2024-08-18T23:57:46.979304+0000","last_became_active":"2024-08-18T23:57:46.976632+0000","last_became_peered":"2024-08-18T23:57:46.976632+0000","last_unstale":"2024-08-18T23:57:46.979304+0000","last_undegraded":"2024-08-18T23:57:46.979304+0000","last_fullsized":"2024-08-18T23:57:46.979304+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:21.950504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973663+0000","last_change":"2024-08-18T23:57:46.973663+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973663+0000","last_undegraded":"2024-08-18T23:57:46.973663+0000","last_fullsized":"2024-08-18T23:57:46.973663+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.995773+0000","last_change":"2024-08-18T23:57:46.988097+0000","last_active":"2024-08-18T23:57:46.995773+0000","last_peered":"2024-08-18T23:57:46.995773+0000","last_clean":"2024-08-18T23:57:46.995773+0000","last_became_active":"2024-08-18T23:57:46.987806+0000","last_became_peered":"2024-08-18T23:57:46.987806+0000","last_unstale":"2024-08-18T23:57:46.995773+0000","last_undegraded":"2024-08-18T23:57:46.995773+0000","last_fullsized":"2024-08-18T23:57:46.995773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972239+0000","last_change":"2024-08-18T23:57:46.972239+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972239+0000","last_undegraded":"2024-08-18T23:57:46.972239+0000","last_fullsized":"2024-08-18T23:57:46.972239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.978114+0000","last_change":"2024-08-18T23:57:46.974889+0000","last_active":"2024-08-18T23:57:46.978114+0000","last_peered":"2024-08-18T23:57:46.978114+0000","last_clean":"2024-08-18T23:57:46.978114+0000","last_became_active":"2024-08-18T23:57:46.974493+0000","last_became_peered":"2024-08-18T23:57:46.974493+0000","last_unstale":"2024-08-18T23:57:46.978114+0000","last_undegraded":"2024-08-18T23:57:46.978114+0000","last_fullsized":"2024-08-18T23:57:46.978114+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975683+0000","last_change":"2024-08-18T23:57:46.975683+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975683+0000","last_undegraded":"2024-08-18T23:57:46.975683+0000","last_fullsized":"2024-08-18T23:57:46.975683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987984+0000","last_change":"2024-08-18T23:57:46.986352+0000","last_active":"2024-08-18T23:57:46.987984+0000","last_peered":"2024-08-18T23:57:46.987984+0000","last_clean":"2024-08-18T23:57:46.987984+0000","last_became_active":"2024-08-18T23:57:46.986080+0000","last_became_peered":"2024-08-18T23:57:46.986080+0000","last_unstale":"2024-08-18T23:57:46.987984+0000","last_undegraded":"2024-08-18T23:57:46.987984+0000","last_fullsized":"2024-08-18T23:57:46.987984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974081+0000","last_change":"2024-08-18T23:57:46.974081+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974081+0000","last_undegraded":"2024-08-18T23:57:46.974081+0000","last_fullsized":"2024-08-18T23:57:46.974081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988103+0000","last_change":"2024-08-18T23:57:46.986782+0000","last_active":"2024-08-18T23:57:46.988103+0000","last_peered":"2024-08-18T23:57:46.988103+0000","last_clean":"2024-08-18T23:57:46.988103+0000","last_became_active":"2024-08-18T23:57:46.986512+0000","last_became_peered":"2024-08-18T23:57:46.986512+0000","last_unstale":"2024-08-18T23:57:46.988103+0000","last_undegraded":"2024-08-18T23:57:46.988103+0000","last_fullsized":"2024-08-18T23:57:46.988103+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:54:49.793571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.979212+0000","last_change":"2024-08-18T23:57:46.979212+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.979212+0000","last_undegraded":"2024-08-18T23:57:46.979212+0000","last_fullsized":"2024-08-18T23:57:46.979212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985529+0000","last_change":"2024-08-18T23:57:46.980792+0000","last_active":"2024-08-18T23:57:46.985529+0000","last_peered":"2024-08-18T23:57:46.985529+0000","last_clean":"2024-08-18T23:57:46.985529+0000","last_became_active":"2024-08-18T23:57:46.980487+0000","last_became_peered":"2024-08-18T23:57:46.980487+0000","last_unstale":"2024-08-18T23:57:46.985529+0000","last_undegraded":"2024-08-18T23:57:46.985529+0000","last_fullsized":"2024-08-18T23:57:46.985529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:43.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973569+0000","last_change":"2024-08-18T23:57:46.973569+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973569+0000","last_undegraded":"2024-08-18T23:57:46.973569+0000","last_fullsized":"2024-08-18T23:57:46.973569+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987283+0000","last_change":"2024-08-18T23:57:46.980654+0000","last_active":"2024-08-18T23:57:46.987283+0000","last_peered":"2024-08-18T23:57:46.987283+0000","last_clean":"2024-08-18T23:57:46.987283+0000","last_became_active":"2024-08-18T23:57:46.980406+0000","last_became_peered":"2024-08-18T23:57:46.980406+0000","last_unstale":"2024-08-18T23:57:46.987283+0000","last_undegraded":"2024-08-18T23:57:46.987283+0000","last_fullsized":"2024-08-18T23:57:46.987283+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:02:59.626751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.968921+0000","last_change":"2024-08-18T23:57:46.968921+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.968921+0000","last_undegraded":"2024-08-18T23:57:46.968921+0000","last_fullsized":"2024-08-18T23:57:46.968921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988215+0000","last_change":"2024-08-18T23:57:46.985787+0000","last_active":"2024-08-18T23:57:46.988215+0000","last_peered":"2024-08-18T23:57:46.988215+0000","last_clean":"2024-08-18T23:57:46.988215+0000","last_became_active":"2024-08-18T23:57:46.985559+0000","last_became_peered":"2024-08-18T23:57:46.985559+0000","last_unstale":"2024-08-18T23:57:46.988215+0000","last_undegraded":"2024-08-18T23:57:46.988215+0000","last_fullsized":"2024-08-18T23:57:46.988215+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:06:43.710587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972363+0000","last_change":"2024-08-18T23:57:46.972363+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972363+0000","last_undegraded":"2024-08-18T23:57:46.972363+0000","last_fullsized":"2024-08-18T23:57:46.972363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979036+0000","last_change":"2024-08-18T23:57:46.975935+0000","last_active":"2024-08-18T23:57:46.979036+0000","last_peered":"2024-08-18T23:57:46.979036+0000","last_clean":"2024-08-18T23:57:46.979036+0000","last_became_active":"2024-08-18T23:57:46.974922+0000","last_became_peered":"2024-08-18T23:57:46.974922+0000","last_unstale":"2024-08-18T23:57:46.979036+0000","last_undegraded":"2024-08-18T23:57:46.979036+0000","last_fullsized":"2024-08-18T23:57:46.979036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:33:23.499961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.972171+0000","last_change":"2024-08-18T23:57:46.972171+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.972171+0000","last_undegraded":"2024-08-18T23:57:46.972171+0000","last_fullsized":"2024-08-18T23:57:46.972171+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.979087+0000","last_change":"2024-08-18T23:57:46.977722+0000","last_active":"2024-08-18T23:57:46.979087+0000","last_peered":"2024-08-18T23:57:46.979087+0000","last_clean":"2024-08-18T23:57:46.979087+0000","last_became_active":"2024-08-18T23:57:46.977358+0000","last_became_peered":"2024-08-18T23:57:46.977358+0000","last_unstale":"2024-08-18T23:57:46.979087+0000","last_undegraded":"2024-08-18T23:57:46.979087+0000","last_fullsized":"2024-08-18T23:57:46.979087+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:46:34.548703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974068+0000","last_change":"2024-08-18T23:57:46.974068+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974068+0000","last_undegraded":"2024-08-18T23:57:46.974068+0000","last_fullsized":"2024-08-18T23:57:46.974068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.986638+0000","last_change":"2024-08-18T23:57:46.985675+0000","last_active":"2024-08-18T23:57:46.986638+0000","last_peered":"2024-08-18T23:57:46.986638+0000","last_clean":"2024-08-18T23:57:46.986638+0000","last_became_active":"2024-08-18T23:57:46.985422+0000","last_became_peered":"2024-08-18T23:57:46.985422+0000","last_unstale":"2024-08-18T23:57:46.986638+0000","last_undegraded":"2024-08-18T23:57:46.986638+0000","last_fullsized":"2024-08-18T23:57:46.986638+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:45.942020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.974834+0000","last_change":"2024-08-18T23:57:46.974834+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.974834+0000","last_undegraded":"2024-08-18T23:57:46.974834+0000","last_fullsized":"2024-08-18T23:57:46.974834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.976133+0000","last_change":"2024-08-18T23:57:46.972731+0000","last_active":"2024-08-18T23:57:46.976133+0000","last_peered":"2024-08-18T23:57:46.976133+0000","last_clean":"2024-08-18T23:57:46.976133+0000","last_became_active":"2024-08-18T23:57:46.972286+0000","last_became_peered":"2024-08-18T23:57:46.972286+0000","last_unstale":"2024-08-18T23:57:46.976133+0000","last_undegraded":"2024-08-18T23:57:46.976133+0000","last_fullsized":"2024-08-18T23:57:46.976133+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:49:14.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975018+0000","last_change":"2024-08-18T23:57:46.975018+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975018+0000","last_undegraded":"2024-08-18T23:57:46.975018+0000","last_fullsized":"2024-08-18T23:57:46.975018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.988083+0000","last_change":"2024-08-18T23:57:46.984792+0000","last_active":"2024-08-18T23:57:46.988083+0000","last_peered":"2024-08-18T23:57:46.988083+0000","last_clean":"2024-08-18T23:57:46.988083+0000","last_became_active":"2024-08-18T23:57:46.984390+0000","last_became_peered":"2024-08-18T23:57:46.984390+0000","last_unstale":"2024-08-18T23:57:46.988083+0000","last_undegraded":"2024-08-18T23:57:46.988083+0000","last_fullsized":"2024-08-18T23:57:46.988083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.975329+0000","last_change":"2024-08-18T23:57:46.975329+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.975329+0000","last_undegraded":"2024-08-18T23:57:46.975329+0000","last_fullsized":"2024-08-18T23:57:46.975329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.987821+0000","last_change":"2024-08-18T23:57:46.986267+0000","last_active":"2024-08-18T23:57:46.987821+0000","last_peered":"2024-08-18T23:57:46.987821+0000","last_clean":"2024-08-18T23:57:46.987821+0000","last_became_active":"2024-08-18T23:57:46.985949+0000","last_became_peered":"2024-08-18T23:57:46.985949+0000","last_unstale":"2024-08-18T23:57:46.987821+0000","last_undegraded":"2024-08-18T23:57:46.987821+0000","last_fullsized":"2024-08-18T23:57:46.987821+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:09:53.830731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973560+0000","last_change":"2024-08-18T23:57:46.973560+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973560+0000","last_undegraded":"2024-08-18T23:57:46.973560+0000","last_fullsized":"2024-08-18T23:57:46.973560+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981443+0000","last_change":"2024-08-18T23:57:46.980140+0000","last_active":"2024-08-18T23:57:46.981443+0000","last_peered":"2024-08-18T23:57:46.981443+0000","last_clean":"2024-08-18T23:57:46.981443+0000","last_became_active":"2024-08-18T23:57:46.979861+0000","last_became_peered":"2024-08-18T23:57:46.979861+0000","last_unstale":"2024-08-18T23:57:46.981443+0000","last_undegraded":"2024-08-18T23:57:46.981443+0000","last_fullsized":"2024-08-18T23:57:46.981443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:35:39.633884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971926+0000","last_change":"2024-08-18T23:57:46.971926+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971926+0000","last_undegraded":"2024-08-18T23:57:46.971926+0000","last_fullsized":"2024-08-18T23:57:46.971926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.983867+0000","last_change":"2024-08-18T23:57:46.982236+0000","last_active":"2024-08-18T23:57:46.983867+0000","last_peered":"2024-08-18T23:57:46.983867+0000","last_clean":"2024-08-18T23:57:46.983867+0000","last_became_active":"2024-08-18T23:57:46.981988+0000","last_became_peered":"2024-08-18T23:57:46.981988+0000","last_unstale":"2024-08-18T23:57:46.983867+0000","last_undegraded":"2024-08-18T23:57:46.983867+0000","last_fullsized":"2024-08-18T23:57:46.983867+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:09.729353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973204+0000","last_change":"2024-08-18T23:57:46.973204+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973204+0000","last_undegraded":"2024-08-18T23:57:46.973204+0000","last_fullsized":"2024-08-18T23:57:46.973204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.981262+0000","last_change":"2024-08-18T23:57:46.979340+0000","last_active":"2024-08-18T23:57:46.981262+0000","last_peered":"2024-08-18T23:57:46.981262+0000","last_clean":"2024-08-18T23:57:46.981262+0000","last_became_active":"2024-08-18T23:57:46.978986+0000","last_became_peered":"2024-08-18T23:57:46.978986+0000","last_unstale":"2024-08-18T23:57:46.981262+0000","last_undegraded":"2024-08-18T23:57:46.981262+0000","last_fullsized":"2024-08-18T23:57:46.981262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.973245+0000","last_change":"2024-08-18T23:57:46.973245+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.973245+0000","last_undegraded":"2024-08-18T23:57:46.973245+0000","last_fullsized":"2024-08-18T23:57:46.973245+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.985217+0000","last_change":"2024-08-18T23:57:46.977443+0000","last_active":"2024-08-18T23:57:46.985217+0000","last_peered":"2024-08-18T23:57:46.985217+0000","last_clean":"2024-08-18T23:57:46.985217+0000","last_became_active":"2024-08-18T23:57:46.977118+0000","last_became_peered":"2024-08-18T23:57:46.977118+0000","last_unstale":"2024-08-18T23:57:46.985217+0000","last_undegraded":"2024-08-18T23:57:46.985217+0000","last_fullsized":"2024-08-18T23:57:46.985217+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:13:21.453951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.971984+0000","last_change":"2024-08-18T23:57:46.971984+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.971984+0000","last_undegraded":"2024-08-18T23:57:46.971984+0000","last_fullsized":"2024-08-18T23:57:46.971984+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.984862+0000","last_change":"2024-08-18T23:57:46.980301+0000","last_active":"2024-08-18T23:57:46.984862+0000","last_peered":"2024-08-18T23:57:46.984862+0000","last_clean":"2024-08-18T23:57:46.984862+0000","last_became_active":"2024-08-18T23:57:46.980039+0000","last_became_peered":"2024-08-18T23:57:46.980039+0000","last_unstale":"2024-08-18T23:57:46.984862+0000","last_undegraded":"2024-08-18T23:57:46.984862+0000","last_fullsized":"2024-08-18T23:57:46.984862+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:35:22.742458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2024-08-18T23:57:46.976993+0000","last_change":"2024-08-18T23:57:46.976993+0000","last_active":"2024-08-18T23:57:46.962204+0000","last_peered":"2024-08-18T23:57:46.962204+0000","last_clean":"2024-08-18T23:57:46.962204+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-18T23:57:46.976993+0000","last_undegraded":"2024-08-18T23:57:46.976993+0000","last_fullsized":"2024-08-18T23:57:46.976993+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.990570+0000","last_change":"2024-08-18T23:57:46.988567+0000","last_active":"2024-08-18T23:57:46.990570+0000","last_peered":"2024-08-18T23:57:46.990570+0000","last_clean":"2024-08-18T23:57:46.990570+0000","last_became_active":"2024-08-18T23:57:46.988285+0000","last_became_peered":"2024-08-18T23:57:46.988285+0000","last_unstale":"2024-08-18T23:57:46.990570+0000","last_undegraded":"2024-08-18T23:57:46.990570+0000","last_fullsized":"2024-08-18T23:57:46.990570+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-08-18T23:57:46.980124+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:57:46.980124+0000","last_peered":"2024-08-18T23:57:46.980124+0000","last_clean":"2024-08-18T23:57:46.980124+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:57:46.980124+0000","last_undegraded":"2024-08-18T23:57:46.980124+0000","last_fullsized":"2024-08-18T23:57:46.980124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":760040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":413696,"data_stored":176339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":169672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":760040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:54.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:57:54.360 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:57:55.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:57:55.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.390+0000 7feac4dd8640 1 Processor -- start 2024-08-18T23:57:55.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.390+0000 7feac4dd8640 1 -- start start 2024-08-18T23:57:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.391+0000 7feac4dd8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feac00b4370 0x7feac00ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.391+0000 7feac4dd8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac0072610 con 0x7feac006f770 2024-08-18T23:57:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.391+0000 7feac4dd8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac00728f0 con 0x7feac015ade0 2024-08-18T23:57:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.391+0000 7feac4dd8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7feac006db10 con 0x7feac00b4370 2024-08-18T23:57:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.391+0000 7feabed9d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7feac00b4370 0x7feac00ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.391+0000 7feab5d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7feac006f770 0x7feac00ad9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59072/0 (socket says 172.21.15.103:59072) 2024-08-18T23:57:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.391+0000 7feab5d9b640 1 -- 172.21.15.103:0/1135078550 learned_addr learned my addr 172.21.15.103:0/1135078550 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.392+0000 7feabed9d640 1 -- 172.21.15.103:0/1135078550 >> v1:172.21.15.190:6789/0 conn(0x7feac015ade0 legacy=0x7feac006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.392+0000 7feabed9d640 1 -- 172.21.15.103:0/1135078550 >> v1:172.21.15.103:6789/0 conn(0x7feac006f770 legacy=0x7feac00ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.392+0000 7feabed9d640 1 -- 172.21.15.103:0/1135078550 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac0072bd0 con 0x7feac00b4370 2024-08-18T23:57:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.392+0000 7feabed9d640 1 --2- 172.21.15.103:0/1135078550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac00ae0e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feab800bfa0 tx=0x7feab802c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12e33125b810460 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.392+0000 7feabdd9b640 1 -- 172.21.15.103:0/1135078550 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8039070 con 0x7feac00b4370 2024-08-18T23:57:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.392+0000 7feabdd9b640 1 -- 172.21.15.103:0/1135078550 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab8009540 con 0x7feac00b4370 2024-08-18T23:57:55.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.392+0000 7feabdd9b640 1 -- 172.21.15.103:0/1135078550 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8009910 con 0x7feac00b4370 2024-08-18T23:57:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.393+0000 7feac4dd8640 1 -- 172.21.15.103:0/1135078550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 msgr2=0x7feac00ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.393+0000 7feac4dd8640 1 --2- 172.21.15.103:0/1135078550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac00ae0e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feab800bfa0 tx=0x7feab802c870 comp rx=0 tx=0).stop 2024-08-18T23:57:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.393+0000 7feac4dd8640 1 -- 172.21.15.103:0/1135078550 shutdown_connections 2024-08-18T23:57:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.393+0000 7feac4dd8640 1 --2- 172.21.15.103:0/1135078550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac00ae0e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.393+0000 7feac4dd8640 1 -- 172.21.15.103:0/1135078550 >> 172.21.15.103:0/1135078550 conn(0x7feac00cfc40 msgr2=0x7feac00d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.393+0000 7feac4dd8640 1 -- 172.21.15.103:0/1135078550 shutdown_connections 2024-08-18T23:57:55.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.393+0000 7feac4dd8640 1 -- 172.21.15.103:0/1135078550 wait complete. 2024-08-18T23:57:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.395+0000 7feac4dd8640 1 Processor -- start 2024-08-18T23:57:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.395+0000 7feac4dd8640 1 -- start start 2024-08-18T23:57:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.395+0000 7feac4dd8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac006f770 0x7feac0154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.395+0000 7feac4dd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.395+0000 7feac4dd8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac015ade0 0x7feac006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.395+0000 7feac4dd8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7feac006d6c0 con 0x7feac00b4370 2024-08-18T23:57:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.395+0000 7feac4dd8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feac015b1c0 con 0x7feac015ade0 2024-08-18T23:57:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.395+0000 7feac4dd8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feac006d840 con 0x7feac006f770 2024-08-18T23:57:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac006e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48106/0 (socket says 172.21.15.103:48106) 2024-08-18T23:57:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 -- 172.21.15.103:0/2481076559 learned_addr learned my addr 172.21.15.103:0/2481076559 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feabed9d640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac015ade0 0x7feac006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feabe59c640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac006f770 0x7feac0154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 -- 172.21.15.103:0/2481076559 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac006f770 msgr2=0x7feac0154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac006f770 0x7feac0154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 -- 172.21.15.103:0/2481076559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac015ade0 msgr2=0x7feac006ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac015ade0 0x7feac006ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 -- 172.21.15.103:0/2481076559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac009bd60 con 0x7feac00b4370 2024-08-18T23:57:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab5d9b640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac006e7d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feaa800c4a0 tx=0x7feaa800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:55.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab77fe640 1 -- 172.21.15.103:0/2481076559 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8017070 con 0x7feac00b4370 2024-08-18T23:57:55.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab77fe640 1 -- 172.21.15.103:0/2481076559 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaa8005ce0 con 0x7feac00b4370 2024-08-18T23:57:55.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac00cdb60 con 0x7feac00b4370 2024-08-18T23:57:55.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feab77fe640 1 -- 172.21.15.103:0/2481076559 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8007270 con 0x7feac00b4370 2024-08-18T23:57:55.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.396+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac00ce120 con 0x7feac00b4370 2024-08-18T23:57:55.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.397+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac009bf30 con 0x7feac00b4370 2024-08-18T23:57:55.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.398+0000 7feab77fe640 1 -- 172.21.15.103:0/2481076559 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feaa801a070 con 0x7feac00b4370 2024-08-18T23:57:55.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.398+0000 7feab77fe640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7feaa006be30 0x7feaa006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.398+0000 7feab77fe640 1 -- 172.21.15.103:0/2481076559 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7feaa808a2b0 con 0x7feac00b4370 2024-08-18T23:57:55.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.398+0000 7feabe59c640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7feaa006be30 0x7feaa006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.399+0000 7feabe59c640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7feaa006be30 0x7feaa006e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feab00016e0 tx=0x7feab0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:55.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.403+0000 7feab77fe640 1 -- 172.21.15.103:0/2481076559 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7feaa8058460 con 0x7feac00b4370 2024-08-18T23:57:55.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.565+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feac01553c0 con 0x7feaa006be30 2024-08-18T23:57:55.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.571+0000 7feab77fe640 1 -- 172.21.15.103:0/2481076559 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7feac01553c0 con 0x7feaa006be30 2024-08-18T23:57:55.574 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:55.576 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:57:55.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7feaa006be30 msgr2=0x7feaa006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7feaa006be30 0x7feaa006e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7feab00016e0 tx=0x7feab0009040 comp rx=0 tx=0).stop 2024-08-18T23:57:55.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 msgr2=0x7feac006e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac006e7d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7feaa800c4a0 tx=0x7feaa800c960 comp rx=0 tx=0).stop 2024-08-18T23:57:55.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 shutdown_connections 2024-08-18T23:57:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7feaa006be30 0x7feaa006e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac015ade0 0x7feac006ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feac00b4370 0x7feac006e7d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 --2- 172.21.15.103:0/2481076559 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac006f770 0x7feac0154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 >> 172.21.15.103:0/2481076559 conn(0x7feac00cfc40 msgr2=0x7feac015ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 shutdown_connections 2024-08-18T23:57:55.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.574+0000 7feac4dd8640 1 -- 172.21.15.103:0/2481076559 wait complete. 2024-08-18T23:57:55.586 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-08-18T23:57:54.177358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220812,"kb_used_data":4648,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753908,"statfs":{"total":773094113280,"available":772868001792,"internally_reserved":0,"allocated":4759552,"data_stored":2707140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.212150"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.009026+0000","last_change":"2024-08-18T23:57:48.013834+0000","last_active":"2024-08-18T23:57:49.009026+0000","last_peered":"2024-08-18T23:57:49.009026+0000","last_clean":"2024-08-18T23:57:49.009026+0000","last_became_active":"2024-08-18T23:57:48.013546+0000","last_became_peered":"2024-08-18T23:57:48.013546+0000","last_unstale":"2024-08-18T23:57:49.009026+0000","last_undegraded":"2024-08-18T23:57:49.009026+0000","last_fullsized":"2024-08-18T23:57:49.009026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:06:19.150449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008828+0000","last_change":"2024-08-18T23:57:48.010119+0000","last_active":"2024-08-18T23:57:49.008828+0000","last_peered":"2024-08-18T23:57:49.008828+0000","last_clean":"2024-08-18T23:57:49.008828+0000","last_became_active":"2024-08-18T23:57:48.009822+0000","last_became_peered":"2024-08-18T23:57:48.009822+0000","last_unstale":"2024-08-18T23:57:49.008828+0000","last_undegraded":"2024-08-18T23:57:49.008828+0000","last_fullsized":"2024-08-18T23:57:49.008828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:03.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590356+0000","last_change":"2024-08-18T23:57:48.014846+0000","last_active":"2024-08-18T23:57:50.590356+0000","last_peered":"2024-08-18T23:57:50.590356+0000","last_clean":"2024-08-18T23:57:50.590356+0000","last_became_active":"2024-08-18T23:57:48.014572+0000","last_became_peered":"2024-08-18T23:57:48.014572+0000","last_unstale":"2024-08-18T23:57:50.590356+0000","last_undegraded":"2024-08-18T23:57:50.590356+0000","last_fullsized":"2024-08-18T23:57:50.590356+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:52.760705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007900+0000","last_change":"2024-08-18T23:57:48.004063+0000","last_active":"2024-08-18T23:57:49.007900+0000","last_peered":"2024-08-18T23:57:49.007900+0000","last_clean":"2024-08-18T23:57:49.007900+0000","last_became_active":"2024-08-18T23:57:48.003823+0000","last_became_peered":"2024-08-18T23:57:48.003823+0000","last_unstale":"2024-08-18T23:57:49.007900+0000","last_undegraded":"2024-08-18T23:57:49.007900+0000","last_fullsized":"2024-08-18T23:57:49.007900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:40.457054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007768+0000","last_change":"2024-08-18T23:57:48.003421+0000","last_active":"2024-08-18T23:57:49.007768+0000","last_peered":"2024-08-18T23:57:49.007768+0000","last_clean":"2024-08-18T23:57:49.007768+0000","last_became_active":"2024-08-18T23:57:48.003181+0000","last_became_peered":"2024-08-18T23:57:48.003181+0000","last_unstale":"2024-08-18T23:57:49.007768+0000","last_undegraded":"2024-08-18T23:57:49.007768+0000","last_fullsized":"2024-08-18T23:57:49.007768+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:09.535249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590588+0000","last_change":"2024-08-18T23:57:48.014006+0000","last_active":"2024-08-18T23:57:50.590588+0000","last_peered":"2024-08-18T23:57:50.590588+0000","last_clean":"2024-08-18T23:57:50.590588+0000","last_became_active":"2024-08-18T23:57:48.013734+0000","last_became_peered":"2024-08-18T23:57:48.013734+0000","last_unstale":"2024-08-18T23:57:50.590588+0000","last_undegraded":"2024-08-18T23:57:50.590588+0000","last_fullsized":"2024-08-18T23:57:50.590588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:25.997925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798468+0000","last_change":"2024-08-18T23:57:48.016730+0000","last_active":"2024-08-18T23:57:49.798468+0000","last_peered":"2024-08-18T23:57:49.798468+0000","last_clean":"2024-08-18T23:57:49.798468+0000","last_became_active":"2024-08-18T23:57:48.016413+0000","last_became_peered":"2024-08-18T23:57:48.016413+0000","last_unstale":"2024-08-18T23:57:49.798468+0000","last_undegraded":"2024-08-18T23:57:49.798468+0000","last_fullsized":"2024-08-18T23:57:49.798468+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:36.130722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008492+0000","last_change":"2024-08-18T23:57:48.018205+0000","last_active":"2024-08-18T23:57:49.008492+0000","last_peered":"2024-08-18T23:57:49.008492+0000","last_clean":"2024-08-18T23:57:49.008492+0000","last_became_active":"2024-08-18T23:57:48.017917+0000","last_became_peered":"2024-08-18T23:57:48.017917+0000","last_unstale":"2024-08-18T23:57:49.008492+0000","last_undegraded":"2024-08-18T23:57:49.008492+0000","last_fullsized":"2024-08-18T23:57:49.008492+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:11.624487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590567+0000","last_change":"2024-08-18T23:57:48.018213+0000","last_active":"2024-08-18T23:57:50.590567+0000","last_peered":"2024-08-18T23:57:50.590567+0000","last_clean":"2024-08-18T23:57:50.590567+0000","last_became_active":"2024-08-18T23:57:48.017953+0000","last_became_peered":"2024-08-18T23:57:48.017953+0000","last_unstale":"2024-08-18T23:57:50.590567+0000","last_undegraded":"2024-08-18T23:57:50.590567+0000","last_fullsized":"2024-08-18T23:57:50.590567+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:06.427249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798976+0000","last_change":"2024-08-18T23:57:48.022979+0000","last_active":"2024-08-18T23:57:49.798976+0000","last_peered":"2024-08-18T23:57:49.798976+0000","last_clean":"2024-08-18T23:57:49.798976+0000","last_became_active":"2024-08-18T23:57:48.022739+0000","last_became_peered":"2024-08-18T23:57:48.022739+0000","last_unstale":"2024-08-18T23:57:49.798976+0000","last_undegraded":"2024-08-18T23:57:49.798976+0000","last_fullsized":"2024-08-18T23:57:49.798976+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:28.888504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798921+0000","last_change":"2024-08-18T23:57:48.017178+0000","last_active":"2024-08-18T23:57:49.798921+0000","last_peered":"2024-08-18T23:57:49.798921+0000","last_clean":"2024-08-18T23:57:49.798921+0000","last_became_active":"2024-08-18T23:57:48.016720+0000","last_became_peered":"2024-08-18T23:57:48.016720+0000","last_unstale":"2024-08-18T23:57:49.798921+0000","last_undegraded":"2024-08-18T23:57:49.798921+0000","last_fullsized":"2024-08-18T23:57:49.798921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:13.163251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590668+0000","last_change":"2024-08-18T23:57:47.999378+0000","last_active":"2024-08-18T23:57:50.590668+0000","last_peered":"2024-08-18T23:57:50.590668+0000","last_clean":"2024-08-18T23:57:50.590668+0000","last_became_active":"2024-08-18T23:57:47.999067+0000","last_became_peered":"2024-08-18T23:57:47.999067+0000","last_unstale":"2024-08-18T23:57:50.590668+0000","last_undegraded":"2024-08-18T23:57:50.590668+0000","last_fullsized":"2024-08-18T23:57:50.590668+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:33.868490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798550+0000","last_change":"2024-08-18T23:57:48.023215+0000","last_active":"2024-08-18T23:57:49.798550+0000","last_peered":"2024-08-18T23:57:49.798550+0000","last_clean":"2024-08-18T23:57:49.798550+0000","last_became_active":"2024-08-18T23:57:48.022975+0000","last_became_peered":"2024-08-18T23:57:48.022975+0000","last_unstale":"2024-08-18T23:57:49.798550+0000","last_undegraded":"2024-08-18T23:57:49.798550+0000","last_fullsized":"2024-08-18T23:57:49.798550+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:32:52.839805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590349+0000","last_change":"2024-08-18T23:57:48.003678+0000","last_active":"2024-08-18T23:57:50.590349+0000","last_peered":"2024-08-18T23:57:50.590349+0000","last_clean":"2024-08-18T23:57:50.590349+0000","last_became_active":"2024-08-18T23:57:48.003364+0000","last_became_peered":"2024-08-18T23:57:48.003364+0000","last_unstale":"2024-08-18T23:57:50.590349+0000","last_undegraded":"2024-08-18T23:57:50.590349+0000","last_fullsized":"2024-08-18T23:57:50.590349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:54.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798535+0000","last_change":"2024-08-18T23:57:48.008986+0000","last_active":"2024-08-18T23:57:49.798535+0000","last_peered":"2024-08-18T23:57:49.798535+0000","last_clean":"2024-08-18T23:57:49.798535+0000","last_became_active":"2024-08-18T23:57:48.008719+0000","last_became_peered":"2024-08-18T23:57:48.008719+0000","last_unstale":"2024-08-18T23:57:49.798535+0000","last_undegraded":"2024-08-18T23:57:49.798535+0000","last_fullsized":"2024-08-18T23:57:49.798535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:09.476337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489611+0000","last_change":"2024-08-18T23:57:48.018674+0000","last_active":"2024-08-18T23:57:49.489611+0000","last_peered":"2024-08-18T23:57:49.489611+0000","last_clean":"2024-08-18T23:57:49.489611+0000","last_became_active":"2024-08-18T23:57:48.018191+0000","last_became_peered":"2024-08-18T23:57:48.018191+0000","last_unstale":"2024-08-18T23:57:49.489611+0000","last_undegraded":"2024-08-18T23:57:49.489611+0000","last_fullsized":"2024-08-18T23:57:49.489611+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:49:24.456584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.490072+0000","last_change":"2024-08-18T23:57:48.018489+0000","last_active":"2024-08-18T23:57:49.490072+0000","last_peered":"2024-08-18T23:57:49.490072+0000","last_clean":"2024-08-18T23:57:49.490072+0000","last_became_active":"2024-08-18T23:57:48.018213+0000","last_became_peered":"2024-08-18T23:57:48.018213+0000","last_unstale":"2024-08-18T23:57:49.490072+0000","last_undegraded":"2024-08-18T23:57:49.490072+0000","last_fullsized":"2024-08-18T23:57:49.490072+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:32:52.839805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007552+0000","last_change":"2024-08-18T23:57:48.004815+0000","last_active":"2024-08-18T23:57:49.007552+0000","last_peered":"2024-08-18T23:57:49.007552+0000","last_clean":"2024-08-18T23:57:49.007552+0000","last_became_active":"2024-08-18T23:57:48.003795+0000","last_became_peered":"2024-08-18T23:57:48.003795+0000","last_unstale":"2024-08-18T23:57:49.007552+0000","last_undegraded":"2024-08-18T23:57:49.007552+0000","last_fullsized":"2024-08-18T23:57:49.007552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:42.669640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007826+0000","last_change":"2024-08-18T23:57:48.011705+0000","last_active":"2024-08-18T23:57:49.007826+0000","last_peered":"2024-08-18T23:57:49.007826+0000","last_clean":"2024-08-18T23:57:49.007826+0000","last_became_active":"2024-08-18T23:57:48.011445+0000","last_became_peered":"2024-08-18T23:57:48.011445+0000","last_unstale":"2024-08-18T23:57:49.007826+0000","last_undegraded":"2024-08-18T23:57:49.007826+0000","last_fullsized":"2024-08-18T23:57:49.007826+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:46.944038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007329+0000","last_change":"2024-08-18T23:57:48.004515+0000","last_active":"2024-08-18T23:57:49.007329+0000","last_peered":"2024-08-18T23:57:49.007329+0000","last_clean":"2024-08-18T23:57:49.007329+0000","last_became_active":"2024-08-18T23:57:48.004228+0000","last_became_peered":"2024-08-18T23:57:48.004228+0000","last_unstale":"2024-08-18T23:57:49.007329+0000","last_undegraded":"2024-08-18T23:57:49.007329+0000","last_fullsized":"2024-08-18T23:57:49.007329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:54.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798584+0000","last_change":"2024-08-18T23:57:48.021880+0000","last_active":"2024-08-18T23:57:49.798584+0000","last_peered":"2024-08-18T23:57:49.798584+0000","last_clean":"2024-08-18T23:57:49.798584+0000","last_became_active":"2024-08-18T23:57:48.021460+0000","last_became_peered":"2024-08-18T23:57:48.021460+0000","last_unstale":"2024-08-18T23:57:49.798584+0000","last_undegraded":"2024-08-18T23:57:49.798584+0000","last_fullsized":"2024-08-18T23:57:49.798584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:11.624487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590526+0000","last_change":"2024-08-18T23:57:48.007136+0000","last_active":"2024-08-18T23:57:50.590526+0000","last_peered":"2024-08-18T23:57:50.590526+0000","last_clean":"2024-08-18T23:57:50.590526+0000","last_became_active":"2024-08-18T23:57:48.006829+0000","last_became_peered":"2024-08-18T23:57:48.006829+0000","last_unstale":"2024-08-18T23:57:50.590526+0000","last_undegraded":"2024-08-18T23:57:50.590526+0000","last_fullsized":"2024-08-18T23:57:50.590526+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:52.760705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489721+0000","last_change":"2024-08-18T23:57:48.008789+0000","last_active":"2024-08-18T23:57:49.489721+0000","last_peered":"2024-08-18T23:57:49.489721+0000","last_clean":"2024-08-18T23:57:49.489721+0000","last_became_active":"2024-08-18T23:57:48.008476+0000","last_became_peered":"2024-08-18T23:57:48.008476+0000","last_unstale":"2024-08-18T23:57:49.489721+0000","last_undegraded":"2024-08-18T23:57:49.489721+0000","last_fullsized":"2024-08-18T23:57:49.489721+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:40:03.321932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007575+0000","last_change":"2024-08-18T23:57:48.013384+0000","last_active":"2024-08-18T23:57:49.007575+0000","last_peered":"2024-08-18T23:57:49.007575+0000","last_clean":"2024-08-18T23:57:49.007575+0000","last_became_active":"2024-08-18T23:57:48.013145+0000","last_became_peered":"2024-08-18T23:57:48.013145+0000","last_unstale":"2024-08-18T23:57:49.007575+0000","last_undegraded":"2024-08-18T23:57:49.007575+0000","last_fullsized":"2024-08-18T23:57:49.007575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:11:10.731371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007438+0000","last_change":"2024-08-18T23:57:47.998478+0000","last_active":"2024-08-18T23:57:49.007438+0000","last_peered":"2024-08-18T23:57:49.007438+0000","last_clean":"2024-08-18T23:57:49.007438+0000","last_became_active":"2024-08-18T23:57:47.998151+0000","last_became_peered":"2024-08-18T23:57:47.998151+0000","last_unstale":"2024-08-18T23:57:49.007438+0000","last_undegraded":"2024-08-18T23:57:49.007438+0000","last_fullsized":"2024-08-18T23:57:49.007438+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:25.997925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.591026+0000","last_change":"2024-08-18T23:57:48.018303+0000","last_active":"2024-08-18T23:57:50.591026+0000","last_peered":"2024-08-18T23:57:50.591026+0000","last_clean":"2024-08-18T23:57:50.591026+0000","last_became_active":"2024-08-18T23:57:48.018027+0000","last_became_peered":"2024-08-18T23:57:48.018027+0000","last_unstale":"2024-08-18T23:57:50.591026+0000","last_undegraded":"2024-08-18T23:57:50.591026+0000","last_fullsized":"2024-08-18T23:57:50.591026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:33.868490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007364+0000","last_change":"2024-08-18T23:57:48.002642+0000","last_active":"2024-08-18T23:57:49.007364+0000","last_peered":"2024-08-18T23:57:49.007364+0000","last_clean":"2024-08-18T23:57:49.007364+0000","last_became_active":"2024-08-18T23:57:48.002385+0000","last_became_peered":"2024-08-18T23:57:48.002385+0000","last_unstale":"2024-08-18T23:57:49.007364+0000","last_undegraded":"2024-08-18T23:57:49.007364+0000","last_fullsized":"2024-08-18T23:57:49.007364+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:52.760705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798818+0000","last_change":"2024-08-18T23:57:48.017635+0000","last_active":"2024-08-18T23:57:49.798818+0000","last_peered":"2024-08-18T23:57:49.798818+0000","last_clean":"2024-08-18T23:57:49.798818+0000","last_became_active":"2024-08-18T23:57:48.017362+0000","last_became_peered":"2024-08-18T23:57:48.017362+0000","last_unstale":"2024-08-18T23:57:49.798818+0000","last_undegraded":"2024-08-18T23:57:49.798818+0000","last_fullsized":"2024-08-18T23:57:49.798818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:35.393674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007327+0000","last_change":"2024-08-18T23:57:48.009333+0000","last_active":"2024-08-18T23:57:49.007327+0000","last_peered":"2024-08-18T23:57:49.007327+0000","last_clean":"2024-08-18T23:57:49.007327+0000","last_became_active":"2024-08-18T23:57:48.009030+0000","last_became_peered":"2024-08-18T23:57:48.009030+0000","last_unstale":"2024-08-18T23:57:49.007327+0000","last_undegraded":"2024-08-18T23:57:49.007327+0000","last_fullsized":"2024-08-18T23:57:49.007327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:48.458171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007271+0000","last_change":"2024-08-18T23:57:48.013722+0000","last_active":"2024-08-18T23:57:49.007271+0000","last_peered":"2024-08-18T23:57:49.007271+0000","last_clean":"2024-08-18T23:57:49.007271+0000","last_became_active":"2024-08-18T23:57:48.013305+0000","last_became_peered":"2024-08-18T23:57:48.013305+0000","last_unstale":"2024-08-18T23:57:49.007271+0000","last_undegraded":"2024-08-18T23:57:49.007271+0000","last_fullsized":"2024-08-18T23:57:49.007271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:35:23.744475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489815+0000","last_change":"2024-08-18T23:57:48.009458+0000","last_active":"2024-08-18T23:57:49.489815+0000","last_peered":"2024-08-18T23:57:49.489815+0000","last_clean":"2024-08-18T23:57:49.489815+0000","last_became_active":"2024-08-18T23:57:48.009192+0000","last_became_peered":"2024-08-18T23:57:48.009192+0000","last_unstale":"2024-08-18T23:57:49.489815+0000","last_undegraded":"2024-08-18T23:57:49.489815+0000","last_fullsized":"2024-08-18T23:57:49.489815+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:45:15.299029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590232+0000","last_change":"2024-08-18T23:57:48.012701+0000","last_active":"2024-08-18T23:57:50.590232+0000","last_peered":"2024-08-18T23:57:50.590232+0000","last_clean":"2024-08-18T23:57:50.590232+0000","last_became_active":"2024-08-18T23:57:48.012412+0000","last_became_peered":"2024-08-18T23:57:48.012412+0000","last_unstale":"2024-08-18T23:57:50.590232+0000","last_undegraded":"2024-08-18T23:57:50.590232+0000","last_fullsized":"2024-08-18T23:57:50.590232+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:54.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.490099+0000","last_change":"2024-08-18T23:57:48.018350+0000","last_active":"2024-08-18T23:57:49.490099+0000","last_peered":"2024-08-18T23:57:49.490099+0000","last_clean":"2024-08-18T23:57:49.490099+0000","last_became_active":"2024-08-18T23:57:48.018073+0000","last_became_peered":"2024-08-18T23:57:48.018073+0000","last_unstale":"2024-08-18T23:57:49.490099+0000","last_undegraded":"2024-08-18T23:57:49.490099+0000","last_fullsized":"2024-08-18T23:57:49.490099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:50:11.624487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007486+0000","last_change":"2024-08-18T23:57:46.978262+0000","last_active":"2024-08-18T23:57:49.007486+0000","last_peered":"2024-08-18T23:57:49.007486+0000","last_clean":"2024-08-18T23:57:49.007486+0000","last_became_active":"2024-08-18T23:57:46.977521+0000","last_became_peered":"2024-08-18T23:57:46.977521+0000","last_unstale":"2024-08-18T23:57:49.007486+0000","last_undegraded":"2024-08-18T23:57:49.007486+0000","last_fullsized":"2024-08-18T23:57:49.007486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.591003+0000","last_change":"2024-08-18T23:57:48.013845+0000","last_active":"2024-08-18T23:57:50.591003+0000","last_peered":"2024-08-18T23:57:50.591003+0000","last_clean":"2024-08-18T23:57:50.591003+0000","last_became_active":"2024-08-18T23:57:48.013452+0000","last_became_peered":"2024-08-18T23:57:48.013452+0000","last_unstale":"2024-08-18T23:57:50.591003+0000","last_undegraded":"2024-08-18T23:57:50.591003+0000","last_fullsized":"2024-08-18T23:57:50.591003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:06.427249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590906+0000","last_change":"2024-08-18T23:57:46.986870+0000","last_active":"2024-08-18T23:57:50.590906+0000","last_peered":"2024-08-18T23:57:50.590906+0000","last_clean":"2024-08-18T23:57:50.590906+0000","last_became_active":"2024-08-18T23:57:46.986630+0000","last_became_peered":"2024-08-18T23:57:46.986630+0000","last_unstale":"2024-08-18T23:57:50.590906+0000","last_undegraded":"2024-08-18T23:57:50.590906+0000","last_fullsized":"2024-08-18T23:57:50.590906+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590815+0000","last_change":"2024-08-18T23:57:48.002960+0000","last_active":"2024-08-18T23:57:50.590815+0000","last_peered":"2024-08-18T23:57:50.590815+0000","last_clean":"2024-08-18T23:57:50.590815+0000","last_became_active":"2024-08-18T23:57:48.002618+0000","last_became_peered":"2024-08-18T23:57:48.002618+0000","last_unstale":"2024-08-18T23:57:50.590815+0000","last_undegraded":"2024-08-18T23:57:50.590815+0000","last_fullsized":"2024-08-18T23:57:50.590815+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:02:33.764873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.591099+0000","last_change":"2024-08-18T23:57:46.986467+0000","last_active":"2024-08-18T23:57:50.591099+0000","last_peered":"2024-08-18T23:57:50.591099+0000","last_clean":"2024-08-18T23:57:50.591099+0000","last_became_active":"2024-08-18T23:57:46.986141+0000","last_became_peered":"2024-08-18T23:57:46.986141+0000","last_unstale":"2024-08-18T23:57:50.591099+0000","last_undegraded":"2024-08-18T23:57:50.591099+0000","last_fullsized":"2024-08-18T23:57:50.591099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008885+0000","last_change":"2024-08-18T23:57:48.018438+0000","last_active":"2024-08-18T23:57:49.008885+0000","last_peered":"2024-08-18T23:57:49.008885+0000","last_clean":"2024-08-18T23:57:49.008885+0000","last_became_active":"2024-08-18T23:57:48.017555+0000","last_became_peered":"2024-08-18T23:57:48.017555+0000","last_unstale":"2024-08-18T23:57:49.008885+0000","last_undegraded":"2024-08-18T23:57:49.008885+0000","last_fullsized":"2024-08-18T23:57:49.008885+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:07.088956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590630+0000","last_change":"2024-08-18T23:57:46.977433+0000","last_active":"2024-08-18T23:57:50.590630+0000","last_peered":"2024-08-18T23:57:50.590630+0000","last_clean":"2024-08-18T23:57:50.590630+0000","last_became_active":"2024-08-18T23:57:46.977134+0000","last_became_peered":"2024-08-18T23:57:46.977134+0000","last_unstale":"2024-08-18T23:57:50.590630+0000","last_undegraded":"2024-08-18T23:57:50.590630+0000","last_fullsized":"2024-08-18T23:57:50.590630+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590234+0000","last_change":"2024-08-18T23:57:48.009701+0000","last_active":"2024-08-18T23:57:50.590234+0000","last_peered":"2024-08-18T23:57:50.590234+0000","last_clean":"2024-08-18T23:57:50.590234+0000","last_became_active":"2024-08-18T23:57:48.009441+0000","last_became_peered":"2024-08-18T23:57:48.009441+0000","last_unstale":"2024-08-18T23:57:50.590234+0000","last_undegraded":"2024-08-18T23:57:50.590234+0000","last_fullsized":"2024-08-18T23:57:50.590234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:54.081143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798691+0000","last_change":"2024-08-18T23:57:46.986008+0000","last_active":"2024-08-18T23:57:49.798691+0000","last_peered":"2024-08-18T23:57:49.798691+0000","last_clean":"2024-08-18T23:57:49.798691+0000","last_became_active":"2024-08-18T23:57:46.984486+0000","last_became_peered":"2024-08-18T23:57:46.984486+0000","last_unstale":"2024-08-18T23:57:49.798691+0000","last_undegraded":"2024-08-18T23:57:49.798691+0000","last_fullsized":"2024-08-18T23:57:49.798691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:54:29.031353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798675+0000","last_change":"2024-08-18T23:57:48.021748+0000","last_active":"2024-08-18T23:57:49.798675+0000","last_peered":"2024-08-18T23:57:49.798675+0000","last_clean":"2024-08-18T23:57:49.798675+0000","last_became_active":"2024-08-18T23:57:48.021474+0000","last_became_peered":"2024-08-18T23:57:48.021474+0000","last_unstale":"2024-08-18T23:57:49.798675+0000","last_undegraded":"2024-08-18T23:57:49.798675+0000","last_fullsized":"2024-08-18T23:57:49.798675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:03.150035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489759+0000","last_change":"2024-08-18T23:57:46.986931+0000","last_active":"2024-08-18T23:57:49.489759+0000","last_peered":"2024-08-18T23:57:49.489759+0000","last_clean":"2024-08-18T23:57:49.489759+0000","last_became_active":"2024-08-18T23:57:46.986652+0000","last_became_peered":"2024-08-18T23:57:46.986652+0000","last_unstale":"2024-08-18T23:57:49.489759+0000","last_undegraded":"2024-08-18T23:57:49.489759+0000","last_fullsized":"2024-08-18T23:57:49.489759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:49:36.222131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590784+0000","last_change":"2024-08-18T23:57:48.013821+0000","last_active":"2024-08-18T23:57:50.590784+0000","last_peered":"2024-08-18T23:57:50.590784+0000","last_clean":"2024-08-18T23:57:50.590784+0000","last_became_active":"2024-08-18T23:57:48.013249+0000","last_became_peered":"2024-08-18T23:57:48.013249+0000","last_unstale":"2024-08-18T23:57:50.590784+0000","last_undegraded":"2024-08-18T23:57:50.590784+0000","last_fullsized":"2024-08-18T23:57:50.590784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:32:06.427249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590797+0000","last_change":"2024-08-18T23:57:46.986792+0000","last_active":"2024-08-18T23:57:50.590797+0000","last_peered":"2024-08-18T23:57:50.590797+0000","last_clean":"2024-08-18T23:57:50.590797+0000","last_became_active":"2024-08-18T23:57:46.986493+0000","last_became_peered":"2024-08-18T23:57:46.986493+0000","last_unstale":"2024-08-18T23:57:50.590797+0000","last_undegraded":"2024-08-18T23:57:50.590797+0000","last_fullsized":"2024-08-18T23:57:50.590797+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:49:36.222131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008677+0000","last_change":"2024-08-18T23:57:48.019914+0000","last_active":"2024-08-18T23:57:49.008677+0000","last_peered":"2024-08-18T23:57:49.008677+0000","last_clean":"2024-08-18T23:57:49.008677+0000","last_became_active":"2024-08-18T23:57:48.019512+0000","last_became_peered":"2024-08-18T23:57:48.019512+0000","last_unstale":"2024-08-18T23:57:49.008677+0000","last_undegraded":"2024-08-18T23:57:49.008677+0000","last_fullsized":"2024-08-18T23:57:49.008677+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:03.150035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590249+0000","last_change":"2024-08-18T23:57:46.982717+0000","last_active":"2024-08-18T23:57:50.590249+0000","last_peered":"2024-08-18T23:57:50.590249+0000","last_clean":"2024-08-18T23:57:50.590249+0000","last_became_active":"2024-08-18T23:57:46.982435+0000","last_became_peered":"2024-08-18T23:57:46.982435+0000","last_unstale":"2024-08-18T23:57:50.590249+0000","last_undegraded":"2024-08-18T23:57:50.590249+0000","last_fullsized":"2024-08-18T23:57:50.590249+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007935+0000","last_change":"2024-08-18T23:57:48.005355+0000","last_active":"2024-08-18T23:57:49.007935+0000","last_peered":"2024-08-18T23:57:49.007935+0000","last_clean":"2024-08-18T23:57:49.007935+0000","last_became_active":"2024-08-18T23:57:48.005087+0000","last_became_peered":"2024-08-18T23:57:48.005087+0000","last_unstale":"2024-08-18T23:57:49.007935+0000","last_undegraded":"2024-08-18T23:57:49.007935+0000","last_fullsized":"2024-08-18T23:57:49.007935+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:40.887908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.009004+0000","last_change":"2024-08-18T23:57:46.981068+0000","last_active":"2024-08-18T23:57:49.009004+0000","last_peered":"2024-08-18T23:57:49.009004+0000","last_clean":"2024-08-18T23:57:49.009004+0000","last_became_active":"2024-08-18T23:57:46.980803+0000","last_became_peered":"2024-08-18T23:57:46.980803+0000","last_unstale":"2024-08-18T23:57:49.009004+0000","last_undegraded":"2024-08-18T23:57:49.009004+0000","last_fullsized":"2024-08-18T23:57:49.009004+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:51.758687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489969+0000","last_change":"2024-08-18T23:57:48.005829+0000","last_active":"2024-08-18T23:57:49.489969+0000","last_peered":"2024-08-18T23:57:49.489969+0000","last_clean":"2024-08-18T23:57:49.489969+0000","last_became_active":"2024-08-18T23:57:48.005539+0000","last_became_peered":"2024-08-18T23:57:48.005539+0000","last_unstale":"2024-08-18T23:57:49.489969+0000","last_undegraded":"2024-08-18T23:57:49.489969+0000","last_fullsized":"2024-08-18T23:57:49.489969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:34:36.130722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.799095+0000","last_change":"2024-08-18T23:57:46.982223+0000","last_active":"2024-08-18T23:57:49.799095+0000","last_peered":"2024-08-18T23:57:49.799095+0000","last_clean":"2024-08-18T23:57:49.799095+0000","last_became_active":"2024-08-18T23:57:46.981942+0000","last_became_peered":"2024-08-18T23:57:46.981942+0000","last_unstale":"2024-08-18T23:57:49.799095+0000","last_undegraded":"2024-08-18T23:57:49.799095+0000","last_fullsized":"2024-08-18T23:57:49.799095+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:21.950504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590828+0000","last_change":"2024-08-18T23:57:48.011152+0000","last_active":"2024-08-18T23:57:50.590828+0000","last_peered":"2024-08-18T23:57:50.590828+0000","last_clean":"2024-08-18T23:57:50.590828+0000","last_became_active":"2024-08-18T23:57:48.010830+0000","last_became_peered":"2024-08-18T23:57:48.010830+0000","last_unstale":"2024-08-18T23:57:50.590828+0000","last_undegraded":"2024-08-18T23:57:50.590828+0000","last_fullsized":"2024-08-18T23:57:50.590828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:02:33.764873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.799048+0000","last_change":"2024-08-18T23:57:46.984581+0000","last_active":"2024-08-18T23:57:49.799048+0000","last_peered":"2024-08-18T23:57:49.799048+0000","last_clean":"2024-08-18T23:57:49.799048+0000","last_became_active":"2024-08-18T23:57:46.984283+0000","last_became_peered":"2024-08-18T23:57:46.984283+0000","last_unstale":"2024-08-18T23:57:49.799048+0000","last_undegraded":"2024-08-18T23:57:49.799048+0000","last_fullsized":"2024-08-18T23:57:49.799048+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:44:22.014538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590803+0000","last_change":"2024-08-18T23:57:48.006241+0000","last_active":"2024-08-18T23:57:50.590803+0000","last_peered":"2024-08-18T23:57:50.590803+0000","last_clean":"2024-08-18T23:57:50.590803+0000","last_became_active":"2024-08-18T23:57:48.005955+0000","last_became_peered":"2024-08-18T23:57:48.005955+0000","last_unstale":"2024-08-18T23:57:50.590803+0000","last_undegraded":"2024-08-18T23:57:50.590803+0000","last_fullsized":"2024-08-18T23:57:50.590803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:10:33.868490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":20,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008807+0000","last_change":"2024-08-18T23:57:46.979935+0000","last_active":"2024-08-18T23:57:49.008807+0000","last_peered":"2024-08-18T23:57:49.008807+0000","last_clean":"2024-08-18T23:57:49.008807+0000","last_became_active":"2024-08-18T23:57:46.979515+0000","last_became_peered":"2024-08-18T23:57:46.979515+0000","last_unstale":"2024-08-18T23:57:49.008807+0000","last_undegraded":"2024-08-18T23:57:49.008807+0000","last_fullsized":"2024-08-18T23:57:49.008807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:53.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590390+0000","last_change":"2024-08-18T23:57:48.016115+0000","last_active":"2024-08-18T23:57:50.590390+0000","last_peered":"2024-08-18T23:57:50.590390+0000","last_clean":"2024-08-18T23:57:50.590390+0000","last_became_active":"2024-08-18T23:57:48.015585+0000","last_became_peered":"2024-08-18T23:57:48.015585+0000","last_unstale":"2024-08-18T23:57:50.590390+0000","last_undegraded":"2024-08-18T23:57:50.590390+0000","last_fullsized":"2024-08-18T23:57:50.590390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:25.997925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008870+0000","last_change":"2024-08-18T23:57:46.976894+0000","last_active":"2024-08-18T23:57:49.008870+0000","last_peered":"2024-08-18T23:57:49.008870+0000","last_clean":"2024-08-18T23:57:49.008870+0000","last_became_active":"2024-08-18T23:57:46.976632+0000","last_became_peered":"2024-08-18T23:57:46.976632+0000","last_unstale":"2024-08-18T23:57:49.008870+0000","last_undegraded":"2024-08-18T23:57:49.008870+0000","last_fullsized":"2024-08-18T23:57:49.008870+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:24.995908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008533+0000","last_change":"2024-08-18T23:57:48.014634+0000","last_active":"2024-08-18T23:57:49.008533+0000","last_peered":"2024-08-18T23:57:49.008533+0000","last_clean":"2024-08-18T23:57:49.008533+0000","last_became_active":"2024-08-18T23:57:48.014368+0000","last_became_peered":"2024-08-18T23:57:48.014368+0000","last_unstale":"2024-08-18T23:57:49.008533+0000","last_undegraded":"2024-08-18T23:57:49.008533+0000","last_fullsized":"2024-08-18T23:57:49.008533+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:50.590227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590671+0000","last_change":"2024-08-18T23:57:46.988097+0000","last_active":"2024-08-18T23:57:50.590671+0000","last_peered":"2024-08-18T23:57:50.590671+0000","last_clean":"2024-08-18T23:57:50.590671+0000","last_became_active":"2024-08-18T23:57:46.987806+0000","last_became_peered":"2024-08-18T23:57:46.987806+0000","last_unstale":"2024-08-18T23:57:50.590671+0000","last_undegraded":"2024-08-18T23:57:50.590671+0000","last_fullsized":"2024-08-18T23:57:50.590671+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489820+0000","last_change":"2024-08-18T23:57:48.008888+0000","last_active":"2024-08-18T23:57:49.489820+0000","last_peered":"2024-08-18T23:57:49.489820+0000","last_clean":"2024-08-18T23:57:49.489820+0000","last_became_active":"2024-08-18T23:57:48.008571+0000","last_became_peered":"2024-08-18T23:57:48.008571+0000","last_unstale":"2024-08-18T23:57:49.489820+0000","last_undegraded":"2024-08-18T23:57:49.489820+0000","last_fullsized":"2024-08-18T23:57:49.489820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:45:20.126966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007057+0000","last_change":"2024-08-18T23:57:46.974889+0000","last_active":"2024-08-18T23:57:49.007057+0000","last_peered":"2024-08-18T23:57:49.007057+0000","last_clean":"2024-08-18T23:57:49.007057+0000","last_became_active":"2024-08-18T23:57:46.974493+0000","last_became_peered":"2024-08-18T23:57:46.974493+0000","last_unstale":"2024-08-18T23:57:49.007057+0000","last_undegraded":"2024-08-18T23:57:49.007057+0000","last_fullsized":"2024-08-18T23:57:49.007057+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:45.942020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008715+0000","last_change":"2024-08-18T23:57:48.014638+0000","last_active":"2024-08-18T23:57:49.008715+0000","last_peered":"2024-08-18T23:57:49.008715+0000","last_clean":"2024-08-18T23:57:49.008715+0000","last_became_active":"2024-08-18T23:57:48.014338+0000","last_became_peered":"2024-08-18T23:57:48.014338+0000","last_unstale":"2024-08-18T23:57:49.008715+0000","last_undegraded":"2024-08-18T23:57:49.008715+0000","last_fullsized":"2024-08-18T23:57:49.008715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:44:13.163251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489631+0000","last_change":"2024-08-18T23:57:46.986352+0000","last_active":"2024-08-18T23:57:49.489631+0000","last_peered":"2024-08-18T23:57:49.489631+0000","last_clean":"2024-08-18T23:57:49.489631+0000","last_became_active":"2024-08-18T23:57:46.986080+0000","last_became_peered":"2024-08-18T23:57:46.986080+0000","last_unstale":"2024-08-18T23:57:49.489631+0000","last_undegraded":"2024-08-18T23:57:49.489631+0000","last_fullsized":"2024-08-18T23:57:49.489631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:44:22.014538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008775+0000","last_change":"2024-08-18T23:57:48.016900+0000","last_active":"2024-08-18T23:57:49.008775+0000","last_peered":"2024-08-18T23:57:49.008775+0000","last_clean":"2024-08-18T23:57:49.008775+0000","last_became_active":"2024-08-18T23:57:48.016644+0000","last_became_peered":"2024-08-18T23:57:48.016644+0000","last_unstale":"2024-08-18T23:57:49.008775+0000","last_undegraded":"2024-08-18T23:57:49.008775+0000","last_fullsized":"2024-08-18T23:57:49.008775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:03:35.393674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.799142+0000","last_change":"2024-08-18T23:57:46.986782+0000","last_active":"2024-08-18T23:57:49.799142+0000","last_peered":"2024-08-18T23:57:49.799142+0000","last_clean":"2024-08-18T23:57:49.799142+0000","last_became_active":"2024-08-18T23:57:46.986512+0000","last_became_peered":"2024-08-18T23:57:46.986512+0000","last_unstale":"2024-08-18T23:57:49.799142+0000","last_undegraded":"2024-08-18T23:57:49.799142+0000","last_fullsized":"2024-08-18T23:57:49.799142+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:22:47.456153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798957+0000","last_change":"2024-08-18T23:57:48.022386+0000","last_active":"2024-08-18T23:57:49.798957+0000","last_peered":"2024-08-18T23:57:49.798957+0000","last_clean":"2024-08-18T23:57:49.798957+0000","last_became_active":"2024-08-18T23:57:48.021437+0000","last_became_peered":"2024-08-18T23:57:48.021437+0000","last_unstale":"2024-08-18T23:57:49.798957+0000","last_undegraded":"2024-08-18T23:57:49.798957+0000","last_fullsized":"2024-08-18T23:57:49.798957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:03.131869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590832+0000","last_change":"2024-08-18T23:57:46.980792+0000","last_active":"2024-08-18T23:57:50.590832+0000","last_peered":"2024-08-18T23:57:50.590832+0000","last_clean":"2024-08-18T23:57:50.590832+0000","last_became_active":"2024-08-18T23:57:46.980487+0000","last_became_peered":"2024-08-18T23:57:46.980487+0000","last_unstale":"2024-08-18T23:57:50.590832+0000","last_undegraded":"2024-08-18T23:57:50.590832+0000","last_fullsized":"2024-08-18T23:57:50.590832+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:45.942020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590597+0000","last_change":"2024-08-18T23:57:48.010593+0000","last_active":"2024-08-18T23:57:50.590597+0000","last_peered":"2024-08-18T23:57:50.590597+0000","last_clean":"2024-08-18T23:57:50.590597+0000","last_became_active":"2024-08-18T23:57:48.010321+0000","last_became_peered":"2024-08-18T23:57:48.010321+0000","last_unstale":"2024-08-18T23:57:50.590597+0000","last_undegraded":"2024-08-18T23:57:50.590597+0000","last_fullsized":"2024-08-18T23:57:50.590597+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T02:58:25.997925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007948+0000","last_change":"2024-08-18T23:57:46.980654+0000","last_active":"2024-08-18T23:57:49.007948+0000","last_peered":"2024-08-18T23:57:49.007948+0000","last_clean":"2024-08-18T23:57:49.007948+0000","last_became_active":"2024-08-18T23:57:46.980406+0000","last_became_peered":"2024-08-18T23:57:46.980406+0000","last_unstale":"2024-08-18T23:57:49.007948+0000","last_undegraded":"2024-08-18T23:57:49.007948+0000","last_fullsized":"2024-08-18T23:57:49.007948+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T01:53:41.630548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008106+0000","last_change":"2024-08-18T23:57:48.015532+0000","last_active":"2024-08-18T23:57:49.008106+0000","last_peered":"2024-08-18T23:57:49.008106+0000","last_clean":"2024-08-18T23:57:49.008106+0000","last_became_active":"2024-08-18T23:57:48.015263+0000","last_became_peered":"2024-08-18T23:57:48.015263+0000","last_unstale":"2024-08-18T23:57:49.008106+0000","last_undegraded":"2024-08-18T23:57:49.008106+0000","last_fullsized":"2024-08-18T23:57:49.008106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:18.643677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590704+0000","last_change":"2024-08-18T23:57:46.985787+0000","last_active":"2024-08-18T23:57:50.590704+0000","last_peered":"2024-08-18T23:57:50.590704+0000","last_clean":"2024-08-18T23:57:50.590704+0000","last_became_active":"2024-08-18T23:57:46.985559+0000","last_became_peered":"2024-08-18T23:57:46.985559+0000","last_unstale":"2024-08-18T23:57:50.590704+0000","last_undegraded":"2024-08-18T23:57:50.590704+0000","last_fullsized":"2024-08-18T23:57:50.590704+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:07:17.641660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.490116+0000","last_change":"2024-08-18T23:57:48.011816+0000","last_active":"2024-08-18T23:57:49.490116+0000","last_peered":"2024-08-18T23:57:49.490116+0000","last_clean":"2024-08-18T23:57:49.490116+0000","last_became_active":"2024-08-18T23:57:48.011531+0000","last_became_peered":"2024-08-18T23:57:48.011531+0000","last_unstale":"2024-08-18T23:57:49.490116+0000","last_undegraded":"2024-08-18T23:57:49.490116+0000","last_fullsized":"2024-08-18T23:57:49.490116+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:50.590227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007870+0000","last_change":"2024-08-18T23:57:46.975935+0000","last_active":"2024-08-18T23:57:49.007870+0000","last_peered":"2024-08-18T23:57:49.007870+0000","last_clean":"2024-08-18T23:57:49.007870+0000","last_became_active":"2024-08-18T23:57:46.974922+0000","last_became_peered":"2024-08-18T23:57:46.974922+0000","last_unstale":"2024-08-18T23:57:49.007870+0000","last_undegraded":"2024-08-18T23:57:49.007870+0000","last_fullsized":"2024-08-18T23:57:49.007870+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:36:36.548280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590937+0000","last_change":"2024-08-18T23:57:48.011264+0000","last_active":"2024-08-18T23:57:50.590937+0000","last_peered":"2024-08-18T23:57:50.590937+0000","last_clean":"2024-08-18T23:57:50.590937+0000","last_became_active":"2024-08-18T23:57:48.010995+0000","last_became_peered":"2024-08-18T23:57:48.010995+0000","last_unstale":"2024-08-18T23:57:50.590937+0000","last_undegraded":"2024-08-18T23:57:50.590937+0000","last_fullsized":"2024-08-18T23:57:50.590937+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:21:40.185876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007684+0000","last_change":"2024-08-18T23:57:46.977722+0000","last_active":"2024-08-18T23:57:49.007684+0000","last_peered":"2024-08-18T23:57:49.007684+0000","last_clean":"2024-08-18T23:57:49.007684+0000","last_became_active":"2024-08-18T23:57:46.977358+0000","last_became_peered":"2024-08-18T23:57:46.977358+0000","last_unstale":"2024-08-18T23:57:49.007684+0000","last_undegraded":"2024-08-18T23:57:49.007684+0000","last_fullsized":"2024-08-18T23:57:49.007684+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:19.718813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.798616+0000","last_change":"2024-08-18T23:57:48.019644+0000","last_active":"2024-08-18T23:57:49.798616+0000","last_peered":"2024-08-18T23:57:49.798616+0000","last_clean":"2024-08-18T23:57:49.798616+0000","last_became_active":"2024-08-18T23:57:48.019372+0000","last_became_peered":"2024-08-18T23:57:48.019372+0000","last_unstale":"2024-08-18T23:57:49.798616+0000","last_undegraded":"2024-08-18T23:57:49.798616+0000","last_fullsized":"2024-08-18T23:57:49.798616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:41:50.590227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489865+0000","last_change":"2024-08-18T23:57:46.985675+0000","last_active":"2024-08-18T23:57:49.489865+0000","last_peered":"2024-08-18T23:57:49.489865+0000","last_clean":"2024-08-18T23:57:49.489865+0000","last_became_active":"2024-08-18T23:57:46.985422+0000","last_became_peered":"2024-08-18T23:57:46.985422+0000","last_unstale":"2024-08-18T23:57:49.489865+0000","last_undegraded":"2024-08-18T23:57:49.489865+0000","last_fullsized":"2024-08-18T23:57:49.489865+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T09:17:21.950504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008844+0000","last_change":"2024-08-18T23:57:48.019684+0000","last_active":"2024-08-18T23:57:49.008844+0000","last_peered":"2024-08-18T23:57:49.008844+0000","last_clean":"2024-08-18T23:57:49.008844+0000","last_became_active":"2024-08-18T23:57:48.019037+0000","last_became_peered":"2024-08-18T23:57:48.019037+0000","last_unstale":"2024-08-18T23:57:49.008844+0000","last_undegraded":"2024-08-18T23:57:49.008844+0000","last_fullsized":"2024-08-18T23:57:49.008844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:14:28.888504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007541+0000","last_change":"2024-08-18T23:57:46.972731+0000","last_active":"2024-08-18T23:57:49.007541+0000","last_peered":"2024-08-18T23:57:49.007541+0000","last_clean":"2024-08-18T23:57:49.007541+0000","last_became_active":"2024-08-18T23:57:46.972286+0000","last_became_peered":"2024-08-18T23:57:46.972286+0000","last_unstale":"2024-08-18T23:57:49.007541+0000","last_undegraded":"2024-08-18T23:57:49.007541+0000","last_fullsized":"2024-08-18T23:57:49.007541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:35:15.517246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590626+0000","last_change":"2024-08-18T23:57:48.017517+0000","last_active":"2024-08-18T23:57:50.590626+0000","last_peered":"2024-08-18T23:57:50.590626+0000","last_clean":"2024-08-18T23:57:50.590626+0000","last_became_active":"2024-08-18T23:57:48.017275+0000","last_became_peered":"2024-08-18T23:57:48.017275+0000","last_unstale":"2024-08-18T23:57:50.590626+0000","last_undegraded":"2024-08-18T23:57:50.590626+0000","last_fullsized":"2024-08-18T23:57:50.590626+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:42.669640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.799198+0000","last_change":"2024-08-18T23:57:46.984792+0000","last_active":"2024-08-18T23:57:49.799198+0000","last_peered":"2024-08-18T23:57:49.799198+0000","last_clean":"2024-08-18T23:57:49.799198+0000","last_became_active":"2024-08-18T23:57:46.984390+0000","last_became_peered":"2024-08-18T23:57:46.984390+0000","last_unstale":"2024-08-18T23:57:49.799198+0000","last_undegraded":"2024-08-18T23:57:49.799198+0000","last_fullsized":"2024-08-18T23:57:49.799198+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:24:53.079126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.490048+0000","last_change":"2024-08-18T23:57:48.006463+0000","last_active":"2024-08-18T23:57:49.490048+0000","last_peered":"2024-08-18T23:57:49.490048+0000","last_clean":"2024-08-18T23:57:49.490048+0000","last_became_active":"2024-08-18T23:57:48.006205+0000","last_became_peered":"2024-08-18T23:57:48.006205+0000","last_unstale":"2024-08-18T23:57:49.490048+0000","last_undegraded":"2024-08-18T23:57:49.490048+0000","last_fullsized":"2024-08-18T23:57:49.490048+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T11:09:09.476337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"38'1","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008074+0000","last_change":"2024-08-18T23:57:46.986267+0000","last_active":"2024-08-18T23:57:49.008074+0000","last_peered":"2024-08-18T23:57:49.008074+0000","last_clean":"2024-08-18T23:57:49.008074+0000","last_became_active":"2024-08-18T23:57:46.985949+0000","last_became_peered":"2024-08-18T23:57:46.985949+0000","last_unstale":"2024-08-18T23:57:49.008074+0000","last_undegraded":"2024-08-18T23:57:49.008074+0000","last_fullsized":"2024-08-18T23:57:49.008074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:21:21.073339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008962+0000","last_change":"2024-08-18T23:57:48.019386+0000","last_active":"2024-08-18T23:57:49.008962+0000","last_peered":"2024-08-18T23:57:49.008962+0000","last_clean":"2024-08-18T23:57:49.008962+0000","last_became_active":"2024-08-18T23:57:48.019135+0000","last_became_peered":"2024-08-18T23:57:48.019135+0000","last_unstale":"2024-08-18T23:57:49.008962+0000","last_undegraded":"2024-08-18T23:57:49.008962+0000","last_fullsized":"2024-08-18T23:57:49.008962+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:17:34.813322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590416+0000","last_change":"2024-08-18T23:57:46.980140+0000","last_active":"2024-08-18T23:57:50.590416+0000","last_peered":"2024-08-18T23:57:50.590416+0000","last_clean":"2024-08-18T23:57:50.590416+0000","last_became_active":"2024-08-18T23:57:46.979861+0000","last_became_peered":"2024-08-18T23:57:46.979861+0000","last_unstale":"2024-08-18T23:57:50.590416+0000","last_undegraded":"2024-08-18T23:57:50.590416+0000","last_fullsized":"2024-08-18T23:57:50.590416+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T03:26:39.885891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590514+0000","last_change":"2024-08-18T23:57:48.015887+0000","last_active":"2024-08-18T23:57:50.590514+0000","last_peered":"2024-08-18T23:57:50.590514+0000","last_clean":"2024-08-18T23:57:50.590514+0000","last_became_active":"2024-08-18T23:57:48.015231+0000","last_became_peered":"2024-08-18T23:57:48.015231+0000","last_unstale":"2024-08-18T23:57:50.590514+0000","last_undegraded":"2024-08-18T23:57:50.590514+0000","last_fullsized":"2024-08-18T23:57:50.590514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:42.669640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590854+0000","last_change":"2024-08-18T23:57:46.982236+0000","last_active":"2024-08-18T23:57:50.590854+0000","last_peered":"2024-08-18T23:57:50.590854+0000","last_clean":"2024-08-18T23:57:50.590854+0000","last_became_active":"2024-08-18T23:57:46.981988+0000","last_became_peered":"2024-08-18T23:57:46.981988+0000","last_unstale":"2024-08-18T23:57:50.590854+0000","last_undegraded":"2024-08-18T23:57:50.590854+0000","last_fullsized":"2024-08-18T23:57:50.590854+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:18:45.942020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590261+0000","last_change":"2024-08-18T23:57:48.015923+0000","last_active":"2024-08-18T23:57:50.590261+0000","last_peered":"2024-08-18T23:57:50.590261+0000","last_clean":"2024-08-18T23:57:50.590261+0000","last_became_active":"2024-08-18T23:57:48.015661+0000","last_became_peered":"2024-08-18T23:57:48.015661+0000","last_unstale":"2024-08-18T23:57:50.590261+0000","last_undegraded":"2024-08-18T23:57:50.590261+0000","last_fullsized":"2024-08-18T23:57:50.590261+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:26:52.760705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.007069+0000","last_change":"2024-08-18T23:57:46.979340+0000","last_active":"2024-08-18T23:57:49.007069+0000","last_peered":"2024-08-18T23:57:49.007069+0000","last_clean":"2024-08-18T23:57:49.007069+0000","last_became_active":"2024-08-18T23:57:46.978986+0000","last_became_peered":"2024-08-18T23:57:46.978986+0000","last_unstale":"2024-08-18T23:57:49.007069+0000","last_undegraded":"2024-08-18T23:57:49.007069+0000","last_fullsized":"2024-08-18T23:57:49.007069+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T10:08:39.455036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590595+0000","last_change":"2024-08-18T23:57:48.013430+0000","last_active":"2024-08-18T23:57:50.590595+0000","last_peered":"2024-08-18T23:57:50.590595+0000","last_clean":"2024-08-18T23:57:50.590595+0000","last_became_active":"2024-08-18T23:57:48.012863+0000","last_became_peered":"2024-08-18T23:57:48.012863+0000","last_unstale":"2024-08-18T23:57:50.590595+0000","last_undegraded":"2024-08-18T23:57:50.590595+0000","last_fullsized":"2024-08-18T23:57:50.590595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:42.669640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:50.590264+0000","last_change":"2024-08-18T23:57:46.977443+0000","last_active":"2024-08-18T23:57:50.590264+0000","last_peered":"2024-08-18T23:57:50.590264+0000","last_clean":"2024-08-18T23:57:50.590264+0000","last_became_active":"2024-08-18T23:57:46.977118+0000","last_became_peered":"2024-08-18T23:57:46.977118+0000","last_unstale":"2024-08-18T23:57:50.590264+0000","last_undegraded":"2024-08-18T23:57:50.590264+0000","last_fullsized":"2024-08-18T23:57:50.590264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:00:08.533231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.490262+0000","last_change":"2024-08-18T23:57:48.007103+0000","last_active":"2024-08-18T23:57:49.490262+0000","last_peered":"2024-08-18T23:57:49.490262+0000","last_clean":"2024-08-18T23:57:49.490262+0000","last_became_active":"2024-08-18T23:57:48.006827+0000","last_became_peered":"2024-08-18T23:57:48.006827+0000","last_unstale":"2024-08-18T23:57:49.490262+0000","last_undegraded":"2024-08-18T23:57:49.490262+0000","last_fullsized":"2024-08-18T23:57:49.490262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T05:47:03.150035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.008498+0000","last_change":"2024-08-18T23:57:46.980301+0000","last_active":"2024-08-18T23:57:49.008498+0000","last_peered":"2024-08-18T23:57:49.008498+0000","last_clean":"2024-08-18T23:57:49.008498+0000","last_became_active":"2024-08-18T23:57:46.980039+0000","last_became_peered":"2024-08-18T23:57:46.980039+0000","last_unstale":"2024-08-18T23:57:49.008498+0000","last_undegraded":"2024-08-18T23:57:49.008498+0000","last_fullsized":"2024-08-18T23:57:49.008498+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T08:13:41.667623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.799051+0000","last_change":"2024-08-18T23:57:48.021179+0000","last_active":"2024-08-18T23:57:49.799051+0000","last_peered":"2024-08-18T23:57:49.799051+0000","last_clean":"2024-08-18T23:57:49.799051+0000","last_became_active":"2024-08-18T23:57:48.020900+0000","last_became_peered":"2024-08-18T23:57:48.020900+0000","last_unstale":"2024-08-18T23:57:49.799051+0000","last_undegraded":"2024-08-18T23:57:49.799051+0000","last_fullsized":"2024-08-18T23:57:49.799051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:46.962204+0000","last_clean_scrub_stamp":"2024-08-18T23:57:46.962204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:13:07.088956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.490045+0000","last_change":"2024-08-18T23:57:46.988567+0000","last_active":"2024-08-18T23:57:49.490045+0000","last_peered":"2024-08-18T23:57:49.490045+0000","last_clean":"2024-08-18T23:57:49.490045+0000","last_became_active":"2024-08-18T23:57:46.988285+0000","last_became_peered":"2024-08-18T23:57:46.988285+0000","last_unstale":"2024-08-18T23:57:49.490045+0000","last_undegraded":"2024-08-18T23:57:49.490045+0000","last_fullsized":"2024-08-18T23:57:49.490045+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:57:45.960186+0000","last_clean_scrub_stamp":"2024-08-18T23:57:45.960186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T04:54:49.793571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":202,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-08-18T23:57:49.489980+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:57:49.489980+0000","last_peered":"2024-08-18T23:57:49.489980+0000","last_clean":"2024-08-18T23:57:49.489980+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:57:49.489980+0000","last_undegraded":"2024-08-18T23:57:49.489980+0000","last_fullsized":"2024-08-18T23:57:49.489980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":782248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":191844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":190288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343808,"statfs":{"total":96636764160,"available":96608059392,"internally_reserved":0,"allocated":1036288,"data_stored":780600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:57:55.590 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T23:57:55.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-18T23:57:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.731+0000 7fc9d0ecb640 1 Processor -- start 2024-08-18T23:57:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.731+0000 7fc9d0ecb640 1 -- start start 2024-08-18T23:57:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.732+0000 7fc9d0ecb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc9cc072e70 0x7fc9cc06b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.732+0000 7fc9d0ecb640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc0b6110 con 0x7fc9cc06c850 2024-08-18T23:57:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.732+0000 7fc9d0ecb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9cc0b3fb0 con 0x7fc9cc06d710 2024-08-18T23:57:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.732+0000 7fc9d0ecb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc9cc0b63f0 con 0x7fc9cc072e70 2024-08-18T23:57:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.732+0000 7fc9ca59c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc9cc06c850 0x7fc9cc072760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59084/0 (socket says 172.21.15.103:59084) 2024-08-18T23:57:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.732+0000 7fc9ca59c640 1 -- 172.21.15.103:0/3761483921 learned_addr learned my addr 172.21.15.103:0/3761483921 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.732+0000 7fc9c9d9b640 1 --2- 172.21.15.103:0/3761483921 >> v2:172.21.15.190:3300/0 conn(0x7fc9cc072e70 0x7fc9cc06b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.733+0000 7fc9c959a640 1 -- 172.21.15.103:0/3761483921 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806666964 0 0) 0x7fc9cc0b6110 con 0x7fc9cc06c850 2024-08-18T23:57:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.733+0000 7fc9c959a640 1 -- 172.21.15.103:0/3761483921 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9b4003520 con 0x7fc9cc06c850 2024-08-18T23:57:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.733+0000 7fc9c9d9b640 1 -- 172.21.15.103:0/3761483921 >> v1:172.21.15.190:6789/0 conn(0x7fc9cc06d710 legacy=0x7fc9cc06ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.733+0000 7fc9c9d9b640 1 -- 172.21.15.103:0/3761483921 >> v1:172.21.15.103:6789/0 conn(0x7fc9cc06c850 legacy=0x7fc9cc072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.733+0000 7fc9c9d9b640 1 -- 172.21.15.103:0/3761483921 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc0b4290 con 0x7fc9cc072e70 2024-08-18T23:57:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.733+0000 7fc9c9d9b640 1 --2- 172.21.15.103:0/3761483921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc072e70 0x7fc9cc06b900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00097a0 tx=0x7fc9c002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa278e280d31624b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9c959a640 1 -- 172.21.15.103:0/3761483921 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0037070 con 0x7fc9cc072e70 2024-08-18T23:57:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9c959a640 1 -- 172.21.15.103:0/3761483921 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c0032440 con 0x7fc9cc072e70 2024-08-18T23:57:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9c959a640 1 -- 172.21.15.103:0/3761483921 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00327f0 con 0x7fc9cc072e70 2024-08-18T23:57:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/3761483921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc072e70 msgr2=0x7fc9cc06b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9d0ecb640 1 --2- 172.21.15.103:0/3761483921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc072e70 0x7fc9cc06b900 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00097a0 tx=0x7fc9c002a1a0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/3761483921 shutdown_connections 2024-08-18T23:57:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9d0ecb640 1 --2- 172.21.15.103:0/3761483921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc072e70 0x7fc9cc06b900 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/3761483921 >> 172.21.15.103:0/3761483921 conn(0x7fc9cc0b2b80 msgr2=0x7fc9cc0b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:55.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/3761483921 shutdown_connections 2024-08-18T23:57:55.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.734+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/3761483921 wait complete. 2024-08-18T23:57:55.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9d0ecb640 1 Processor -- start 2024-08-18T23:57:55.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9d0ecb640 1 -- start start 2024-08-18T23:57:55.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9d0ecb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc06c850 0x7fc9cc1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9d0ecb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9cc06d710 0x7fc9cc156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9d0ecb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9cc072e70 0x7fc9cc0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9d0ecb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc06fd20 con 0x7fc9cc072e70 2024-08-18T23:57:55.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9d0ecb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc9cc06fba0 con 0x7fc9cc06c850 2024-08-18T23:57:55.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9d0ecb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc9cc06fea0 con 0x7fc9cc06d710 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9cad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9cc072e70 0x7fc9cc0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9ca59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc06c850 0x7fc9cc1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9cad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9cc072e70 0x7fc9cc0cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48120/0 (socket says 172.21.15.103:48120) 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.736+0000 7fc9cad9d640 1 -- 172.21.15.103:0/4228302445 learned_addr learned my addr 172.21.15.103:0/4228302445 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9c9d9b640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9cc06d710 0x7fc9cc156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9cad9d640 1 -- 172.21.15.103:0/4228302445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9cc06d710 msgr2=0x7fc9cc156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9cad9d640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9cc06d710 0x7fc9cc156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9cad9d640 1 -- 172.21.15.103:0/4228302445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc06c850 msgr2=0x7fc9cc1560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9cad9d640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc06c850 0x7fc9cc1560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9cad9d640 1 -- 172.21.15.103:0/4228302445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9cc160ea0 con 0x7fc9cc072e70 2024-08-18T23:57:55.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9ca59c640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc06c850 0x7fc9cc1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:55.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9cad9d640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9cc072e70 0x7fc9cc0cee20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400c7a0 tx=0x7fc9c400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:55.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9baffd640 1 -- 172.21.15.103:0/4228302445 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4003b70 con 0x7fc9cc072e70 2024-08-18T23:57:55.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9baffd640 1 -- 172.21.15.103:0/4228302445 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9c4003d30 con 0x7fc9cc072e70 2024-08-18T23:57:55.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9baffd640 1 -- 172.21.15.103:0/4228302445 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c400aa90 con 0x7fc9cc072e70 2024-08-18T23:57:55.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9cc161180 con 0x7fc9cc072e70 2024-08-18T23:57:55.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.737+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9cc0ce900 con 0x7fc9cc072e70 2024-08-18T23:57:55.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.738+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9cc0b5c50 con 0x7fc9cc072e70 2024-08-18T23:57:55.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.739+0000 7fc9baffd640 1 -- 172.21.15.103:0/4228302445 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc9c400ac30 con 0x7fc9cc072e70 2024-08-18T23:57:55.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.739+0000 7fc9baffd640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc9ac06be60 0x7fc9ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:55.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.739+0000 7fc9baffd640 1 -- 172.21.15.103:0/4228302445 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fc9c408ad00 con 0x7fc9cc072e70 2024-08-18T23:57:55.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.739+0000 7fc9ca59c640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc9ac06be60 0x7fc9ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:55.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.739+0000 7fc9ca59c640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc9ac06be60 0x7fc9ac06e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0011e0 tx=0x7fc9bc007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:55.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.743+0000 7fc9baffd640 1 -- 172.21.15.103:0/4228302445 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc9c4058f60 con 0x7fc9cc072e70 2024-08-18T23:57:55.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.969+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fc9cc161350 con 0x7fc9cc072e70 2024-08-18T23:57:55.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.971+0000 7fc9baffd640 1 -- 172.21.15.103:0/4228302445 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7fc9c405d260 con 0x7fc9cc072e70 2024-08-18T23:57:55.973 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-08-18T23:57:55.973 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAMisJm8shqORAAhfpG5RVY14+bkkc4GjljTQ== 2024-08-18T23:57:55.973 INFO:teuthology.orchestra.run.smithi103.stdout: caps mds = "allow" 2024-08-18T23:57:55.973 INFO:teuthology.orchestra.run.smithi103.stdout: caps mon = "allow r" 2024-08-18T23:57:55.973 INFO:teuthology.orchestra.run.smithi103.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-08-18T23:57:55.973 INFO:teuthology.orchestra.run.smithi103.stderr:updated caps for client.0 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc9ac06be60 msgr2=0x7fc9ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc9ac06be60 0x7fc9ac06e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0011e0 tx=0x7fc9bc007d30 comp rx=0 tx=0).stop 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9cc072e70 msgr2=0x7fc9cc0cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9cc072e70 0x7fc9cc0cee20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc9c400c7a0 tx=0x7fc9c400cc60 comp rx=0 tx=0).stop 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 shutdown_connections 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc9ac06be60 0x7fc9ac06e320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9cc072e70 0x7fc9cc0cee20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9cc06d710 0x7fc9cc156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 --2- 172.21.15.103:0/4228302445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9cc06c850 0x7fc9cc1560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:55.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 >> 172.21.15.103:0/4228302445 conn(0x7fc9cc0b2b80 msgr2=0x7fc9cc0b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:55.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.973+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 shutdown_connections 2024-08-18T23:57:55.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:55.974+0000 7fc9d0ecb640 1 -- 172.21.15.103:0/4228302445 wait complete. 2024-08-18T23:57:55.986 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:56.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.085+0000 7f9d0bf98640 1 Processor -- start 2024-08-18T23:57:56.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.086+0000 7f9d0bf98640 1 -- start start 2024-08-18T23:57:56.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.086+0000 7f9d0bf98640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d0415ade0 0x7f9d0406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d0bf98640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d0415f6c0 con 0x7f9d040ae9e0 2024-08-18T23:57:56.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d0bf98640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d04072610 con 0x7f9d040b4370 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d0bf98640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9d0406db10 con 0x7f9d0415ade0 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d09d34640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d0415ade0 0x7f9d0406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d09d34640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9d0415ade0 0x7f9d0406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48132/0 (socket says 172.21.15.103:48132) 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d09d34640 1 -- 172.21.15.103:0/3515424565 learned_addr learned my addr 172.21.15.103:0/3515424565 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d0a535640 1 --1- 172.21.15.103:0/3515424565 >> v1:172.21.15.103:6789/0 conn(0x7f9d040ae9e0 0x7f9d0415efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59092/0 (socket says 172.21.15.103:59092) 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d09d34640 1 -- 172.21.15.103:0/3515424565 >> v1:172.21.15.190:6789/0 conn(0x7f9d040b4370 legacy=0x7f9d0415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d09d34640 1 -- 172.21.15.103:0/3515424565 >> v1:172.21.15.103:6789/0 conn(0x7f9d040ae9e0 legacy=0x7f9d0415efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d09d34640 1 -- 172.21.15.103:0/3515424565 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d040728f0 con 0x7f9d0415ade0 2024-08-18T23:57:56.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.087+0000 7f9d08d32640 1 -- 172.21.15.103:0/3515424565 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859823532 0 0) 0x7f9d0415f6c0 con 0x7f9d040ae9e0 2024-08-18T23:57:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d09d34640 1 --2- 172.21.15.103:0/3515424565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0406f060 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009870 tx=0x7f9d0002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0c8de6d241ad01 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d08d32640 1 -- 172.21.15.103:0/3515424565 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00037070 con 0x7f9d0415ade0 2024-08-18T23:57:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d08d32640 1 -- 172.21.15.103:0/3515424565 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d00032440 con 0x7f9d0415ade0 2024-08-18T23:57:56.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d08d32640 1 -- 172.21.15.103:0/3515424565 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00032810 con 0x7f9d0415ade0 2024-08-18T23:57:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d0bf98640 1 -- 172.21.15.103:0/3515424565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 msgr2=0x7f9d0406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d0bf98640 1 --2- 172.21.15.103:0/3515424565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0406f060 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009870 tx=0x7f9d0002a210 comp rx=0 tx=0).stop 2024-08-18T23:57:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d0bf98640 1 -- 172.21.15.103:0/3515424565 shutdown_connections 2024-08-18T23:57:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d0bf98640 1 --2- 172.21.15.103:0/3515424565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0406f060 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d0bf98640 1 -- 172.21.15.103:0/3515424565 >> 172.21.15.103:0/3515424565 conn(0x7f9d040cfc40 msgr2=0x7f9d040d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d0bf98640 1 -- 172.21.15.103:0/3515424565 shutdown_connections 2024-08-18T23:57:56.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.088+0000 7f9d0bf98640 1 -- 172.21.15.103:0/3515424565 wait complete. 2024-08-18T23:57:56.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0bf98640 1 Processor -- start 2024-08-18T23:57:56.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0bf98640 1 -- start start 2024-08-18T23:57:56.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0bf98640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d040ae9e0 0x7f9d04151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0bf98640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d040b4370 0x7f9d0415def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0bf98640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0bf98640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9d04072eb0 con 0x7f9d0415ade0 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0bf98640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0415b1c0 con 0x7f9d040ae9e0 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0bf98640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0406d6c0 con 0x7f9d040b4370 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.090+0000 7f9d0a535640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0a535640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48142/0 (socket says 172.21.15.103:48142) 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0a535640 1 -- 172.21.15.103:0/2194504229 learned_addr learned my addr 172.21.15.103:0/2194504229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d09533640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d040b4370 0x7f9d0415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d09d34640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d040ae9e0 0x7f9d04151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0a535640 1 -- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d040b4370 msgr2=0x7f9d0415def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0a535640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d040b4370 0x7f9d0415def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0a535640 1 -- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d040ae9e0 msgr2=0x7f9d04151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0a535640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d040ae9e0 0x7f9d04151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0a535640 1 -- 172.21.15.103:0/2194504229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d04150460 con 0x7f9d0415ade0 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d09d34640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d040ae9e0 0x7f9d04151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0a535640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0415bd50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00ea10 tx=0x7f9cfc00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9cf67fc640 1 -- 172.21.15.103:0/2194504229 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc004d70 con 0x7f9d0415ade0 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9cf67fc640 1 -- 172.21.15.103:0/2194504229 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cfc016020 con 0x7f9d0415ade0 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d04150740 con 0x7f9d0415ade0 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9cf67fc640 1 -- 172.21.15.103:0/2194504229 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc001da0 con 0x7f9d0415ade0 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.091+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d04150d00 con 0x7f9d0415ade0 2024-08-18T23:57:56.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.092+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d040b47b0 con 0x7f9d0415ade0 2024-08-18T23:57:56.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.093+0000 7f9cf67fc640 1 -- 172.21.15.103:0/2194504229 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9cfc001f40 con 0x7f9d0415ade0 2024-08-18T23:57:56.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.093+0000 7f9cf67fc640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9ce806be30 0x7f9ce806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.093+0000 7f9d09d34640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9ce806be30 0x7f9ce806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.093+0000 7f9cf67fc640 1 -- 172.21.15.103:0/2194504229 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f9cfc08d5d0 con 0x7f9d0415ade0 2024-08-18T23:57:56.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.094+0000 7f9d09d34640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9ce806be30 0x7f9ce806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d00034000 tx=0x7f9d0002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.098+0000 7f9cf67fc640 1 -- 172.21.15.103:0/2194504229 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9cfc020030 con 0x7f9d0415ade0 2024-08-18T23:57:56.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.298+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d0409e0e0 con 0x7f9d0415ade0 2024-08-18T23:57:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.298+0000 7f9cf67fc640 1 -- 172.21.15.103:0/2194504229 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7f9cfc0212b0 con 0x7f9d0415ade0 2024-08-18T23:57:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:56.300 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:57:47.319563+0000","modified":"2024-08-18T23:57:49.334110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/171106802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":171106802},{"type":"v1","addr":"172.21.15.103:6835","nonce":171106802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-08-18T23:57:56.300 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-08-18T23:57:56.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9ce806be30 msgr2=0x7f9ce806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9ce806be30 0x7f9ce806e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9d00034000 tx=0x7f9d0002e000 comp rx=0 tx=0).stop 2024-08-18T23:57:56.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 msgr2=0x7f9d0415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0415bd50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00ea10 tx=0x7f9cfc00eed0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 shutdown_connections 2024-08-18T23:57:56.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9ce806be30 0x7f9ce806e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d0415ade0 0x7f9d0415bd50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d040b4370 0x7f9d0415def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 --2- 172.21.15.103:0/2194504229 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d040ae9e0 0x7f9d04151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 >> 172.21.15.103:0/2194504229 conn(0x7f9d040cfc40 msgr2=0x7f9d040ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 shutdown_connections 2024-08-18T23:57:56.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.300+0000 7f9d0bf98640 1 -- 172.21.15.103:0/2194504229 wait complete. 2024-08-18T23:57:56.716 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-18T23:57:47.319563+0000', 'modified': '2024-08-18T23:57:49.334110+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4917}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4917': {'gid': 4917, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.103:6835/171106802', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6834', 'nonce': 171106802}, {'type': 'v1', 'addr': '172.21.15.103:6835', 'nonce': 171106802}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4917, 'qdb_cluster': [4917]} 2024-08-18T23:57:56.716 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-18T23:57:56.716 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-08-18T23:57:56.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.816+0000 7fec0aa10640 1 Processor -- start 2024-08-18T23:57:56.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.816+0000 7fec0aa10640 1 -- start start 2024-08-18T23:57:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.816+0000 7fec0aa10640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 0x7fec040d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.816+0000 7fec0aa10640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fec040b4a10 0x7fec040d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.816+0000 7fec0aa10640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec040d4e10 con 0x7fec040d21b0 2024-08-18T23:57:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.816+0000 7fec0aa10640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fec040d4bc0 con 0x7fec040b4a10 2024-08-18T23:57:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.816+0000 7fec0aa10640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fec040cf960 con 0x7fec0415e3b0 2024-08-18T23:57:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec037fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fec040d21b0 0x7fec040d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59102/0 (socket says 172.21.15.103:59102) 2024-08-18T23:57:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec037fe640 1 -- 172.21.15.103:0/3214687679 learned_addr learned my addr 172.21.15.103:0/3214687679 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:56.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec03fff640 1 --2- 172.21.15.103:0/3214687679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 0x7fec040d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec08fad640 1 --2- 172.21.15.103:0/3214687679 >> v2:172.21.15.190:3300/0 conn(0x7fec040b4a10 0x7fec040d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec02ffd640 1 -- 172.21.15.103:0/3214687679 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123222621 0 0) 0x7fec040d4e10 con 0x7fec040d21b0 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec02ffd640 1 -- 172.21.15.103:0/3214687679 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febec003520 con 0x7fec040d21b0 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec03fff640 1 -- 172.21.15.103:0/3214687679 >> v2:172.21.15.190:3300/0 conn(0x7fec040b4a10 msgr2=0x7fec040d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec03fff640 1 --2- 172.21.15.103:0/3214687679 >> v2:172.21.15.190:3300/0 conn(0x7fec040b4a10 0x7fec040d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec03fff640 1 -- 172.21.15.103:0/3214687679 >> v1:172.21.15.103:6789/0 conn(0x7fec040d21b0 legacy=0x7fec040d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec03fff640 1 -- 172.21.15.103:0/3214687679 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec040cfbb0 con 0x7fec0415e3b0 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.817+0000 7fec08fad640 1 --2- 172.21.15.103:0/3214687679 >> v2:172.21.15.190:3300/0 conn(0x7fec040b4a10 0x7fec040d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.818+0000 7fec03fff640 1 --2- 172.21.15.103:0/3214687679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 0x7fec040d2700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7febf40097a0 tx=0x7febf402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de2cd91bac138a7b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.818+0000 7fec02ffd640 1 -- 172.21.15.103:0/3214687679 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4037070 con 0x7fec0415e3b0 2024-08-18T23:57:56.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.818+0000 7fec02ffd640 1 -- 172.21.15.103:0/3214687679 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf4032440 con 0x7fec0415e3b0 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.818+0000 7fec02ffd640 1 -- 172.21.15.103:0/3214687679 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf40327f0 con 0x7fec0415e3b0 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.818+0000 7fec0aa10640 1 -- 172.21.15.103:0/3214687679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 msgr2=0x7fec040d2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.818+0000 7fec0aa10640 1 --2- 172.21.15.103:0/3214687679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 0x7fec040d2700 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7febf40097a0 tx=0x7febf402a180 comp rx=0 tx=0).stop 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.819+0000 7fec0aa10640 1 -- 172.21.15.103:0/3214687679 shutdown_connections 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.819+0000 7fec0aa10640 1 --2- 172.21.15.103:0/3214687679 >> v2:172.21.15.190:3300/0 conn(0x7fec040b4a10 0x7fec040d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.819+0000 7fec0aa10640 1 --2- 172.21.15.103:0/3214687679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 0x7fec040d2700 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.819+0000 7fec0aa10640 1 -- 172.21.15.103:0/3214687679 >> 172.21.15.103:0/3214687679 conn(0x7fec040d40a0 msgr2=0x7fec040d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.819+0000 7fec0aa10640 1 -- 172.21.15.103:0/3214687679 shutdown_connections 2024-08-18T23:57:56.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.819+0000 7fec0aa10640 1 -- 172.21.15.103:0/3214687679 wait complete. 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.820+0000 7fec0aa10640 1 Processor -- start 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.820+0000 7fec0aa10640 1 -- start start 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec0aa10640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040b4a10 0x7fec04159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec0aa10640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec040d21b0 0x7fec0409ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec0aa10640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 0x7fec040b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec0aa10640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec0415e790 con 0x7fec040b4a10 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec0aa10640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fec040d0200 con 0x7fec040d21b0 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec0aa10640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fec0415e910 con 0x7fec0415e3b0 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040b4a10 0x7fec04159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040b4a10 0x7fec04159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48144/0 (socket says 172.21.15.103:48144) 2024-08-18T23:57:56.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 -- 172.21.15.103:0/2010018725 learned_addr learned my addr 172.21.15.103:0/2010018725 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 -- 172.21.15.103:0/2010018725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 msgr2=0x7fec040b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 0x7fec040b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 -- 172.21.15.103:0/2010018725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec040d21b0 msgr2=0x7fec0409ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec037fe640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec040d21b0 0x7fec0409ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec040d21b0 0x7fec0409ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 -- 172.21.15.103:0/2010018725 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0406da60 con 0x7fec040b4a10 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec03fff640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040b4a10 0x7fec04159990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7febf402a1c0 tx=0x7febf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec00ff9640 1 -- 172.21.15.103:0/2010018725 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4041020 con 0x7fec040b4a10 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec00ff9640 1 -- 172.21.15.103:0/2010018725 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf403d620 con 0x7fec040b4a10 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec0aa10640 1 -- 172.21.15.103:0/2010018725 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec041f5df0 con 0x7fec040b4a10 2024-08-18T23:57:56.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.821+0000 7fec00ff9640 1 -- 172.21.15.103:0/2010018725 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4037040 con 0x7fec040b4a10 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.822+0000 7fec0aa10640 1 -- 172.21.15.103:0/2010018725 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0415a1c0 con 0x7fec040b4a10 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.823+0000 7fec00ff9640 1 -- 172.21.15.103:0/2010018725 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febf4044020 con 0x7fec040b4a10 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.824+0000 7fec00ff9640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7febf006be30 0x7febf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.824+0000 7fec00ff9640 1 -- 172.21.15.103:0/2010018725 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7febf40ab700 con 0x7fec040b4a10 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.824+0000 7fec037fe640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7febf006be30 0x7febf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.824+0000 7fec037fe640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7febf006be30 0x7febf006e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fec0415af00 tx=0x7febf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec0d7d2740 1 Processor -- start 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec0d7d2740 1 -- start start 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x55606351ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d4d10 0x5560634d7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 0x5560634d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55606343ac90 con 0x5560634d7550 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5560633e2990 con 0x5560634d4d10 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x556063436c50 con 0x5560634d8ce0 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec03fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x55606351ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec03fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x55606351ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48160/0 (socket says 172.21.15.103:48160) 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec03fff640 1 -- 172.21.15.103:0/1085863583 learned_addr learned my addr 172.21.15.103:0/1085863583 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec08fad640 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 0x5560634d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.825+0000 7fec037fe640 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d4d10 0x5560634d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec03fff640 1 -- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 msgr2=0x5560634d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec03fff640 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 0x5560634d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec03fff640 1 -- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d4d10 msgr2=0x5560634d7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec03fff640 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d4d10 0x5560634d7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec03fff640 1 -- 172.21.15.103:0/1085863583 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560633f3440 con 0x5560634d7550 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec037fe640 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d4d10 0x5560634d7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec03fff640 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x55606351ccf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7febf40a9ad0 tx=0x7febf40794a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d91fabe9fbecb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7febe9ffb640 1 -- 172.21.15.103:0/1085863583 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf407dbe0 con 0x5560634d7550 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7febe9ffb640 1 -- 172.21.15.103:0/1085863583 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf4082410 con 0x5560634d7550 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7febe9ffb640 1 -- 172.21.15.103:0/1085863583 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4077b30 con 0x5560634d7550 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec0d7d2740 1 -- 172.21.15.103:0/1085863583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 msgr2=0x55606351ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x55606351ccf0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7febf40a9ad0 tx=0x7febf40794a0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec0d7d2740 1 -- 172.21.15.103:0/1085863583 shutdown_connections 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.826+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 0x5560634d1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.827+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d4d10 0x5560634d7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.827+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/1085863583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x55606351ccf0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.827+0000 7fec0d7d2740 1 -- 172.21.15.103:0/1085863583 >> 172.21.15.103:0/1085863583 conn(0x5560634d3d10 msgr2=0x55606351c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.827+0000 7fec0d7d2740 1 -- 172.21.15.103:0/1085863583 shutdown_connections 2024-08-18T23:57:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.827+0000 7fec0d7d2740 1 -- 172.21.15.103:0/1085863583 wait complete. 2024-08-18T23:57:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.827+0000 7fec0d7d2740 1 -- start start 2024-08-18T23:57:56.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.827+0000 7fec0d7d2740 1 Processor -- start 2024-08-18T23:57:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 0x5560634f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d8ce0 0x5560634d2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d27c0 0x5560634d5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55606343ac90 con 0x5560634d27c0 2024-08-18T23:57:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5560633f6690 con 0x5560634d8ce0 2024-08-18T23:57:56.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5560634d31b0 con 0x5560634d7550 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec0d7d2740 10 client.0 _ll_register_callbacks cb 0x5560633ea080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec08fad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d27c0 0x5560634d5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec08fad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d27c0 0x5560634d5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48164/0 (socket says 172.21.15.103:48164) 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec08fad640 1 -- 172.21.15.103:0/3841037543 learned_addr learned my addr 172.21.15.103:0/3841037543 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec03fff640 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 0x5560634f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec037fe640 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d8ce0 0x5560634d2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec08fad640 1 -- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 msgr2=0x5560634f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec08fad640 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 0x5560634f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec08fad640 1 -- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d8ce0 msgr2=0x5560634d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec08fad640 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d8ce0 0x5560634d2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.828+0000 7fec08fad640 1 -- 172.21.15.103:0/3841037543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55606314e2d0 con 0x5560634d27c0 2024-08-18T23:57:56.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec037fe640 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d8ce0 0x5560634d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec08fad640 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d27c0 0x5560634d5dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7febfc007e40 tx=0x7febfc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4637e9a4ebb6fb server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7febe2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7febe2ffd640 1 -- 172.21.15.103:0/3841037543 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc01a030 con 0x5560634d27c0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7febe2ffd640 1 -- 172.21.15.103:0/3841037543 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7febfc012040 con 0x5560634d27c0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 1 -- 172.21.15.103:0/3841037543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf4082410 con 0x5560634d27c0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7febe2ffd640 1 -- 172.21.15.103:0/3841037543 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7febfc023050 con 0x5560634d27c0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 10 client.5130 fetch_fsmap learned FSMap version 16 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 1 -- 172.21.15.103:0/3841037543 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5560632186b0 con 0x5560634d27c0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7febe2ffd640 1 -- 172.21.15.103:0/3841037543 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf4082410 con 0x5560634d27c0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7febe2ffd640 1 -- 172.21.15.103:0/3841037543 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7febfc026020 con 0x5560634d27c0 2024-08-18T23:57:56.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 10 client.5130 fetch_fsmap finished waiting for FSMap version 16 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 10 client.5130 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 20 client.5130 populate_metadata read hostname 'smithi103' 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] conn(0x5560634d0dd0 0x5560634d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 4 client.5130 mds_command: new command op to 4917 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec0d7d2740 1 -- 172.21.15.103:0/3841037543 --> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560634483c0 con 0x5560634d0dd0 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.829+0000 7fec03fff640 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] conn(0x5560634d0dd0 0x5560634d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.830+0000 7febe2ffd640 10 client.5130 ms_handle_connect on v2:172.21.15.103:6834/171106802 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.830+0000 7fec03fff640 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] conn(0x5560634d0dd0 0x5560634d11b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9c2e0bf4b5a7620 server_cookie=24dcdb7e2c299588 in_seq=0 out_seq=0 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.830+0000 7febe2ffd640 1 -- 172.21.15.103:0/3841037543 <== mds.0 v2:172.21.15.103:6834/171106802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560634483c0 con 0x5560634d0dd0 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.830+0000 7febe2ffd640 10 client.5130 handle_command_reply: tid=0 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.830+0000 7fec0d7d2740 1 client.5130 shutdown 2024-08-18T23:57:56.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.830+0000 7fec0d7d2740 1 -- 172.21.15.103:0/3841037543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d27c0 msgr2=0x5560634d5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.830+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d27c0 0x5560634d5dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7febfc007e40 tx=0x7febfc0115a0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.830+0000 7fec0d7d2740 1 -- 172.21.15.103:0/3841037543 shutdown_connections 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] conn(0x5560634d0dd0 0x5560634d11b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d27c0 0x5560634d5dc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d8ce0 0x5560634d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7febe2ffd640 0 client.5130 ms_handle_reset on v2:172.21.15.103:6834/171106802 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/3841037543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 0x5560634f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7fec0d7d2740 1 -- 172.21.15.103:0/3841037543 >> 172.21.15.103:0/3841037543 conn(0x5560634d4d10 msgr2=0x55606351b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7fec0d7d2740 1 -- 172.21.15.103:0/3841037543 shutdown_connections 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7fec0d7d2740 1 -- 172.21.15.103:0/3841037543 wait complete. 2024-08-18T23:57:56.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.831+0000 7fec0d7d2740 20 client.5130 trim_cache size 0 max 16384 2024-08-18T23:57:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.848+0000 7fec0d7d2740 1 Processor -- start 2024-08-18T23:57:56.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec0d7d2740 1 -- start start 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 0x55606351a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x5560634d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 0x5560634d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec041ffd30 con 0x5560634d7550 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fec041f4940 con 0x5560634d27c0 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fec041ff6e0 con 0x5560634d8ce0 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x5560634d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x5560634d52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48166/0 (socket says 172.21.15.103:48166) 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.849+0000 7fec037fe640 1 -- 172.21.15.103:0/2268301824 learned_addr learned my addr 172.21.15.103:0/2268301824 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec037fe640 1 -- 172.21.15.103:0/2268301824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 msgr2=0x5560634d57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec037fe640 1 --2- 172.21.15.103:0/2268301824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 0x5560634d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec037fe640 1 -- 172.21.15.103:0/2268301824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 msgr2=0x55606351a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec037fe640 1 --2- 172.21.15.103:0/2268301824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 0x55606351a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec037fe640 1 -- 172.21.15.103:0/2268301824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560634f6300 con 0x5560634d7550 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec037fe640 1 --2- 172.21.15.103:0/2268301824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x5560634d52b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7febf8005ca0 tx=0x7febf8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec78d89b31c9b280 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7febe97fa640 1 -- 172.21.15.103:0/2268301824 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8005d90 con 0x5560634d7550 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7febe97fa640 1 -- 172.21.15.103:0/2268301824 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf8007560 con 0x5560634d7550 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7febe97fa640 1 -- 172.21.15.103:0/2268301824 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8012b30 con 0x5560634d7550 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec0d7d2740 1 -- 172.21.15.103:0/2268301824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 msgr2=0x5560634d52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/2268301824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x5560634d52b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7febf8005ca0 tx=0x7febf8011000 comp rx=0 tx=0).stop 2024-08-18T23:57:56.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec0d7d2740 1 -- 172.21.15.103:0/2268301824 shutdown_connections 2024-08-18T23:57:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/2268301824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d8ce0 0x5560634d57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/2268301824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d7550 0x5560634d52b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/2268301824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 0x55606351a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.850+0000 7fec0d7d2740 1 -- 172.21.15.103:0/2268301824 >> 172.21.15.103:0/2268301824 conn(0x5560634d4d10 msgr2=0x5560634ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.851+0000 7fec0d7d2740 1 -- 172.21.15.103:0/2268301824 shutdown_connections 2024-08-18T23:57:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.851+0000 7fec0d7d2740 1 -- 172.21.15.103:0/2268301824 wait complete. 2024-08-18T23:57:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.851+0000 7fec0d7d2740 1 -- start start 2024-08-18T23:57:56.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.851+0000 7fec0d7d2740 1 Processor -- start 2024-08-18T23:57:56.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 0x55606359e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 0x5560634fc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec0d7d2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d8ce0 0x5560634fc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5560634f64d0 con 0x5560634d8ce0 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556063530280 con 0x5560634d27c0 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec0d7d2740 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5560634f6fd0 con 0x5560634d7550 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec0d7d2740 10 client.0 _ll_register_callbacks cb 0x7febfc009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec08fad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d8ce0 0x5560634fc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec08fad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d8ce0 0x5560634fc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48178/0 (socket says 172.21.15.103:48178) 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec08fad640 1 -- 172.21.15.103:0/531379830 learned_addr learned my addr 172.21.15.103:0/531379830 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec037fe640 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 0x5560634fc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec03fff640 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 0x55606359e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec08fad640 1 -- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 msgr2=0x5560634fc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec08fad640 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 0x5560634fc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec08fad640 1 -- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 msgr2=0x55606359e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.852+0000 7fec08fad640 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 0x55606359e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec08fad640 1 -- 172.21.15.103:0/531379830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560634f7e60 con 0x5560634d8ce0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec03fff640 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 0x55606359e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec08fad640 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d8ce0 0x5560634fc6d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7febfc002230 tx=0x7febfc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab81dcf5079dfaef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7febe2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7febe2ffd640 1 -- 172.21.15.103:0/531379830 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc02c060 con 0x5560634d8ce0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7febe2ffd640 1 -- 172.21.15.103:0/531379830 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7febfc004690 con 0x5560634d8ce0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 1 -- 172.21.15.103:0/531379830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febf8007560 con 0x5560634d8ce0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7febe2ffd640 1 -- 172.21.15.103:0/531379830 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7febfc032050 con 0x5560634d8ce0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 10 client.5136 fetch_fsmap learned FSMap version 16 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 1 -- 172.21.15.103:0/531379830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5560634f8120 con 0x5560634d8ce0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7febe2ffd640 1 -- 172.21.15.103:0/531379830 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf8007560 con 0x5560634d8ce0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7febe2ffd640 1 -- 172.21.15.103:0/531379830 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7febfc035020 con 0x5560634d8ce0 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 10 client.5136 fetch_fsmap finished waiting for FSMap version 16 2024-08-18T23:57:56.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 10 client.5136 resolve_mds: resolved name 'a' to daemon mds.a 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 20 client.5136 populate_metadata read hostname 'smithi103' 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] conn(0x556063533290 0x5560634fa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 4 client.5136 mds_command: new command op to 4917 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec0d7d2740 1 -- 172.21.15.103:0/531379830 --> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] -- command(tid 0: {"prefix": "status"}) -- 0x556063442710 con 0x556063533290 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.853+0000 7fec03fff640 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] conn(0x556063533290 0x5560634fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7febe2ffd640 10 client.5136 ms_handle_connect on v2:172.21.15.103:6834/171106802 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec03fff640 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] conn(0x556063533290 0x5560634fa840 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=224da56ba6187a0f server_cookie=c652ecc94326a905 in_seq=0 out_seq=0 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7febe2ffd640 1 -- 172.21.15.103:0/531379830 <== mds.0 v2:172.21.15.103:6834/171106802 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556063442710 con 0x556063533290 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7febe2ffd640 10 client.5136 handle_command_reply: tid=0 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 client.5136 shutdown 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 -- 172.21.15.103:0/531379830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d8ce0 msgr2=0x5560634fc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d8ce0 0x5560634fc6d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7febfc002230 tx=0x7febfc009750 comp rx=0 tx=0).stop 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 -- 172.21.15.103:0/531379830 shutdown_connections 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.103:6834/171106802,v1:172.21.15.103:6835/171106802] conn(0x556063533290 0x5560634fa840 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5560634d8ce0 0x5560634fc6d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5560634d7550 0x5560634fc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7febe2ffd640 0 client.5136 ms_handle_reset on v2:172.21.15.103:6834/171106802 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 --2- 172.21.15.103:0/531379830 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5560634d27c0 0x55606359e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 -- 172.21.15.103:0/531379830 >> 172.21.15.103:0/531379830 conn(0x5560634d4d10 msgr2=0x55606351dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 -- 172.21.15.103:0/531379830 shutdown_connections 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 1 -- 172.21.15.103:0/531379830 wait complete. 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.854+0000 7fec0d7d2740 20 client.5136 trim_cache size 0 max 16384 2024-08-18T23:57:56.863 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "c396ba9f-4334-441d-8e0e-0892ec29262b", 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4917, 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 8.8653306890000003, 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 16, 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 38, 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 38, 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 15.712800425999999 2024-08-18T23:57:56.864 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:57:56.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 -- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7febf006be30 msgr2=0x7febf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7febf006be30 0x7febf006e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fec0415af00 tx=0x7febf8009040 comp rx=0 tx=0).stop 2024-08-18T23:57:56.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 -- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040b4a10 msgr2=0x7fec04159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040b4a10 0x7fec04159990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7febf402a1c0 tx=0x7febf40046c0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 -- 172.21.15.103:0/2010018725 shutdown_connections 2024-08-18T23:57:56.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7febf006be30 0x7febf006e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec0415e3b0 0x7fec040b90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec040d21b0 0x7fec0409ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 --2- 172.21.15.103:0/2010018725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec040b4a10 0x7fec04159990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 -- 172.21.15.103:0/2010018725 >> 172.21.15.103:0/2010018725 conn(0x7fec040d40a0 msgr2=0x7fec040d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 -- 172.21.15.103:0/2010018725 shutdown_connections 2024-08-18T23:57:56.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.855+0000 7fec0aa10640 1 -- 172.21.15.103:0/2010018725 wait complete. 2024-08-18T23:57:56.868 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-18T23:57:56.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.965+0000 7f39dfd78640 1 Processor -- start 2024-08-18T23:57:56.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.965+0000 7f39dfd78640 1 -- start start 2024-08-18T23:57:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39dfd78640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39d80cecc0 0x7f39d80cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39dfd78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d815b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39dfd78640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39d80b3190 con 0x7f39d80b2cb0 2024-08-18T23:57:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39dfd78640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f39d80b46c0 con 0x7f39d80cecc0 2024-08-18T23:57:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39dfd78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39d815b990 con 0x7f39d80724a0 2024-08-18T23:57:56.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39ddb14640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39d80cecc0 0x7f39d80cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39ddb14640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f39d80cecc0 0x7f39d80cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48186/0 (socket says 172.21.15.103:48186) 2024-08-18T23:57:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39ddb14640 1 -- 172.21.15.103:0/1299449240 learned_addr learned my addr 172.21.15.103:0/1299449240 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39de315640 1 --2- 172.21.15.103:0/1299449240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39ddb14640 1 -- 172.21.15.103:0/1299449240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 msgr2=0x7f39d815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39ddb14640 1 --2- 172.21.15.103:0/1299449240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39ddb14640 1 -- 172.21.15.103:0/1299449240 >> v1:172.21.15.190:6789/0 conn(0x7f39d80b2cb0 legacy=0x7f39d8071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39ddb14640 1 -- 172.21.15.103:0/1299449240 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d80b3470 con 0x7f39d80cecc0 2024-08-18T23:57:56.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.966+0000 7f39de315640 1 --2- 172.21.15.103:0/1299449240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.967+0000 7f39ddb14640 1 --2- 172.21.15.103:0/1299449240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80cecc0 0x7f39d80cf0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009870 tx=0x7f39d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b1953aaeb6233d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.967+0000 7f39dcb12640 1 -- 172.21.15.103:0/1299449240 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0037070 con 0x7f39d80cecc0 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.967+0000 7f39dcb12640 1 -- 172.21.15.103:0/1299449240 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d0032440 con 0x7f39d80cecc0 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.967+0000 7f39dcb12640 1 -- 172.21.15.103:0/1299449240 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d0032810 con 0x7f39d80cecc0 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.968+0000 7f39dfd78640 1 -- 172.21.15.103:0/1299449240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80cecc0 msgr2=0x7f39d80cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.968+0000 7f39dfd78640 1 --2- 172.21.15.103:0/1299449240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80cecc0 0x7f39d80cf0a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f39d0009870 tx=0x7f39d002a270 comp rx=0 tx=0).stop 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.968+0000 7f39dfd78640 1 -- 172.21.15.103:0/1299449240 shutdown_connections 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.968+0000 7f39dfd78640 1 --2- 172.21.15.103:0/1299449240 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.968+0000 7f39dfd78640 1 --2- 172.21.15.103:0/1299449240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80cecc0 0x7f39d80cf0a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.968+0000 7f39dfd78640 1 -- 172.21.15.103:0/1299449240 >> 172.21.15.103:0/1299449240 conn(0x7f39d80cfc40 msgr2=0x7f39d80d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.968+0000 7f39dfd78640 1 -- 172.21.15.103:0/1299449240 shutdown_connections 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.968+0000 7f39dfd78640 1 -- 172.21.15.103:0/1299449240 wait complete. 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.969+0000 7f39dfd78640 1 Processor -- start 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.969+0000 7f39dfd78640 1 -- start start 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dfd78640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d809c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dfd78640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80b2cb0 0x7f39d809aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dfd78640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39d80cecc0 0x7f39d809b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dfd78640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39d8150e80 con 0x7f39d80b2cb0 2024-08-18T23:57:56.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dfd78640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80b3a30 con 0x7f39d80cecc0 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dfd78640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39d8151000 con 0x7f39d80724a0 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80b2cb0 0x7f39d809aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80b2cb0 0x7f39d809aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48198/0 (socket says 172.21.15.103:48198) 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 -- 172.21.15.103:0/809716878 learned_addr learned my addr 172.21.15.103:0/809716878 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39de315640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39d80cecc0 0x7f39d809b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39ddb14640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d809c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 -- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 msgr2=0x7f39d809c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d809c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 -- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39d80cecc0 msgr2=0x7f39d809b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39d80cecc0 0x7f39d809b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 -- 172.21.15.103:0/809716878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d809b870 con 0x7f39d80b2cb0 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39de315640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39d80cecc0 0x7f39d809b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dd313640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80b2cb0 0x7f39d809aad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c3c0 tx=0x7f39cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39d67fc640 1 -- 172.21.15.103:0/809716878 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc017070 con 0x7f39d80b2cb0 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39d67fc640 1 -- 172.21.15.103:0/809716878 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc0052f0 con 0x7f39d80b2cb0 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d809bb50 con 0x7f39d80b2cb0 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.970+0000 7f39d67fc640 1 -- 172.21.15.103:0/809716878 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39cc003850 con 0x7f39d80b2cb0 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.971+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d809c110 con 0x7f39d80b2cb0 2024-08-18T23:57:56.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.971+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d815b450 con 0x7f39d80b2cb0 2024-08-18T23:57:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.972+0000 7f39d67fc640 1 -- 172.21.15.103:0/809716878 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39cc01a070 con 0x7f39d80b2cb0 2024-08-18T23:57:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.972+0000 7f39d67fc640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39c406be30 0x7f39c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.972+0000 7f39d67fc640 1 -- 172.21.15.103:0/809716878 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f39cc08a2f0 con 0x7f39d80b2cb0 2024-08-18T23:57:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.972+0000 7f39ddb14640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39c406be30 0x7f39c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.973+0000 7f39ddb14640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39c406be30 0x7f39c406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f39d0034000 tx=0x7f39d002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:56.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:56.977+0000 7f39d67fc640 1 -- 172.21.15.103:0/809716878 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f39cc0584c0 con 0x7f39d80b2cb0 2024-08-18T23:57:57.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.180+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f39d806e4c0 con 0x7f39d80b2cb0 2024-08-18T23:57:57.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.180+0000 7f39d67fc640 1 -- 172.21.15.103:0/809716878 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f39cc05c7c0 con 0x7f39d80b2cb0 2024-08-18T23:57:57.182 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-18T23:57:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39c406be30 msgr2=0x7f39c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39c406be30 0x7f39c406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f39d0034000 tx=0x7f39d002e000 comp rx=0 tx=0).stop 2024-08-18T23:57:57.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80b2cb0 msgr2=0x7f39d809aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80b2cb0 0x7f39d809aad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00c3c0 tx=0x7f39cc00c880 comp rx=0 tx=0).stop 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 shutdown_connections 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f39c406be30 0x7f39c406e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f39d80cecc0 0x7f39d809b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39d80b2cb0 0x7f39d809aad0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 --2- 172.21.15.103:0/809716878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39d80724a0 0x7f39d809c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 >> 172.21.15.103:0/809716878 conn(0x7f39d80cfc40 msgr2=0x7f39d80aee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 shutdown_connections 2024-08-18T23:57:57.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57.182+0000 7f39dfd78640 1 -- 172.21.15.103:0/809716878 wait complete. 2024-08-18T23:57:57.194 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-18T23:57:57.194 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-18T23:57:57.194 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-08-18T23:57:57.194 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-18T23:57:57.194 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:57.194 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-18T23:57:57.195 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-18T23:57:57.195 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-18T23:57:57.195 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T23:57:57.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:57.195 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-08-18T23:57:57.211 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-18T23:57:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-18T23:57:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-08-18T23:57:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-08-18T23:57:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:57.211 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42814sec preferred_lft 42814sec 2024-08-18T23:57:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:1f:11:da:c6:83 brd ff:ff:ff:ff:ff:ff 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3c73:aaff:fe53:bd/64 scope link 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 62:87:9d:8c:df:85 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::6087:9dff:fe8c:df85/64 scope link 2024-08-18T23:57:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:57.214 INFO:teuthology.orchestra.run.smithi103.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-18T23:57:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 12:1f:11:da:c6:83 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::101f:11ff:feda:c683/64 scope link 2024-08-18T23:57:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-18T23:57:57.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:57.214 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-18T23:57:57.275 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-08-18T23:57:57.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:57.276 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-08-18T23:57:57.332 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-08-18T23:57:57.332 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-18T23:57:57.333 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-18T23:57:57.333 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-18T23:57:57.333 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-18T23:57:57.333 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-18T23:57:57.333 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-18T23:57:57.334 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-18T23:57:57.334 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-18T23:57:57.334 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-18T23:57:57.334 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-18T23:57:57.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-18T23:57:57.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:57.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:57.459 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-18T23:57:57.474 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T23:57:57.475 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T23:57:57.475 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-18T23:57:57.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:57.475 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-08-18T23:57:57.540 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-18T23:57:57.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:57.541 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:57.596 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-18T23:57:57.596 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-18T23:57:57.596 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:57.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-18T23:57:57.716 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:57.772 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-18T23:57:57.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-18T23:57:57.772 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-18T23:57:57.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-18T23:57:57.772 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-18T23:57:57.772 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-18T23:57:57.772 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-18T23:57:57.772 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:57.773 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:57.774 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:57.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:57.775 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-18T23:57:57.827 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-18T23:57:57.828 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-18T23:57:57.870 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-18T23:57:57.894 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-18T23:57:57.950 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-18T23:57:57.951 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysusers.service 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-18T23:57:57.952 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-0 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-1 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-2 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph/osd/ceph-3 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:57.953 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:57:57.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:57.954 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-18T23:57:57.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:2024-08-18T23:57:57.949+0000 7f82b3109480 -1 init, newargv = 0x55a784322f50 newargc=15 2024-08-18T23:57:57.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[37962]: starting ceph client 2024-08-18T23:57:57.955 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[37962]: starting fuse 2024-08-18T23:57:57.969 INFO:teuthology.orchestra.run.smithi103.stdout:44 2024-08-18T23:57:57.969 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-18T23:57:57.970 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-08-18T23:57:57.971 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-18T23:57:57.972 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:57.972 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.0")) 2024-08-18T23:57:57.972 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-08-18T23:57:58.087 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.0.37962.asok 2024-08-18T23:57:58.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:58.098 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37962.asok 2024-08-18T23:57:58.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:58.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37962.asok status 2024-08-18T23:57:58.232 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:57:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-08-18T23:57:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "de09dd018de4baddfa6ca4d43bc8fb784cf75833", 2024-08-18T23:57:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)", 2024-08-18T23:57:58.232 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "0", 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "37962", 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 5151, 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 5151 2024-08-18T23:57:58.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1534351829 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1534351829 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.5151 192.168.0.1:0/1534351829", 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1534351829", 2024-08-18T23:57:58.234 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-08-18T23:57:58.235 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 16, 2024-08-18T23:57:58.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 38, 2024-08-18T23:57:58.235 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-08-18T23:57:58.235 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-08-18T23:57:58.235 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-08-18T23:57:58.235 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:57:58.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:58.241 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-08-18T23:57:58.241 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:58.256 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-08-18T23:57:58.256 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:58.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:58.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-18T23:57:58.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery false 2024-08-18T23:57:58.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.461+0000 7f14ff8c4640 1 Processor -- start 2024-08-18T23:57:58.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.461+0000 7f14ff8c4640 1 -- start start 2024-08-18T23:57:58.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.462+0000 7f14ff8c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f14f806c850 0x7f14f806b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.462+0000 7f14ff8c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14f8072e70 0x7f14f806ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.462+0000 7f14ff8c4640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f80b6110 con 0x7f14f806d710 2024-08-18T23:57:58.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.462+0000 7f14ff8c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f14f80b63f0 con 0x7f14f806c850 2024-08-18T23:57:58.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.462+0000 7f14ff8c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14f80b3fb0 con 0x7f14f8072e70 2024-08-18T23:57:58.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.462+0000 7f14fce5f640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f14f806d710 0x7f14f8072760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59114/0 (socket says 172.21.15.103:59114) 2024-08-18T23:57:58.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.462+0000 7f14fce5f640 1 -- 172.21.15.103:0/3853913564 learned_addr learned my addr 172.21.15.103:0/3853913564 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fde61640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14f8072e70 0x7f14f806ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fd660640 1 --2- 172.21.15.103:0/3853913564 >> v2:172.21.15.190:3300/0 conn(0x7f14f806c850 0x7f14f806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409622820 0 0) 0x7f14f80b6110 con 0x7f14f806d710 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e4003520 con 0x7f14f806d710 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 543771215 0 0) 0x7f14e4003520 con 0x7f14f806d710 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14f8072e70 msgr2=0x7f14f806ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14f8072e70 0x7f14f806ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 >> v2:172.21.15.190:3300/0 conn(0x7f14f806c850 msgr2=0x7f14f806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 --2- 172.21.15.103:0/3853913564 >> v2:172.21.15.190:3300/0 conn(0x7f14f806c850 0x7f14f806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f80b4290 con 0x7f14f806d710 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f14e8001670 con 0x7f14f806d710 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 >> v1:172.21.15.103:6789/0 conn(0x7f14f806d710 legacy=0x7f14f8072760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:58.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14e40039b0 0x7f14e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14f8072e70 0x7f14e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14e4004d40 0x7f14e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80b63f0 con 0x7f14e40039b0 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80b3fb0 con 0x7f14e4004d40 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14e400b9f0 con 0x7f14f8072e70 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fd660640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14e40039b0 0x7f14e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fde61640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14e4004d40 0x7f14e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fce5f640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14f8072e70 0x7f14e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fd660640 1 -- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14f8072e70 msgr2=0x7f14e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fd660640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14f8072e70 0x7f14e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fd660640 1 -- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14e4004d40 msgr2=0x7f14e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fd660640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14e4004d40 0x7f14e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.463+0000 7f14fd660640 1 -- 172.21.15.103:0/3853913564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e4003520 con 0x7f14e40039b0 2024-08-18T23:57:58.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.464+0000 7f14fd660640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14e40039b0 0x7f14e4003dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009ac0 tx=0x7f14e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b5f872dabfb28 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.464+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4036070 con 0x7f14e40039b0 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.464+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f4031400 con 0x7f14e40039b0 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.464+0000 7f14effff640 1 -- 172.21.15.103:0/3853913564 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4009690 con 0x7f14e40039b0 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.465+0000 7f14ff8c4640 1 -- 172.21.15.103:0/3853913564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14e40039b0 msgr2=0x7f14e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.465+0000 7f14ff8c4640 1 --2- 172.21.15.103:0/3853913564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14e40039b0 0x7f14e4003dd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009ac0 tx=0x7f14e4005830 comp rx=0 tx=0).stop 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.465+0000 7f14fde61640 1 -- 172.21.15.103:0/3853913564 reap_dead start 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.465+0000 7f14ff8c4640 1 -- 172.21.15.103:0/3853913564 shutdown_connections 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.465+0000 7f14ff8c4640 1 -- 172.21.15.103:0/3853913564 >> 172.21.15.103:0/3853913564 conn(0x7f14f80b2b80 msgr2=0x7f14f80b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.465+0000 7f14ff8c4640 1 -- 172.21.15.103:0/3853913564 shutdown_connections 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.465+0000 7f14ff8c4640 1 -- 172.21.15.103:0/3853913564 wait complete. 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.466+0000 7f14ff8c4640 1 Processor -- start 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.466+0000 7f14ff8c4640 1 -- start start 2024-08-18T23:57:58.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14ff8c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14e40039b0 0x7f14f8160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14ff8c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14f815ef00 0x7f14f814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14ff8c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14f80cfbd0 0x7f14f80d0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14ff8c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f14f806fd20 con 0x7f14f815ef00 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14ff8c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f14f806fba0 con 0x7f14f80cfbd0 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14ff8c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14f806fea0 con 0x7f14e40039b0 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14f815ef00 0x7f14f814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14f815ef00 0x7f14f814d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48218/0 (socket says 172.21.15.103:48218) 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 -- 172.21.15.103:0/318565578 learned_addr learned my addr 172.21.15.103:0/318565578 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fd660640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14e40039b0 0x7f14f8160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fde61640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14f80cfbd0 0x7f14f80d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 -- 172.21.15.103:0/318565578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14e40039b0 msgr2=0x7f14f8160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14e40039b0 0x7f14f8160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 -- 172.21.15.103:0/318565578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14f80cfbd0 msgr2=0x7f14f80d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14f80cfbd0 0x7f14f80d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 -- 172.21.15.103:0/318565578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f815f470 con 0x7f14f815ef00 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14fce5f640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14f815ef00 0x7f14f814d880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f14e800e7b0 tx=0x7f14e800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14edffb640 1 -- 172.21.15.103:0/318565578 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e800c870 con 0x7f14f815ef00 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14edffb640 1 -- 172.21.15.103:0/318565578 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e8018070 con 0x7f14f815ef00 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f815f750 con 0x7f14f815ef00 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.467+0000 7f14edffb640 1 -- 172.21.15.103:0/318565578 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e800cc10 con 0x7f14f815ef00 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.468+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f815fd10 con 0x7f14f815ef00 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.469+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f80b5b80 con 0x7f14f815ef00 2024-08-18T23:57:58.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.469+0000 7f14edffb640 1 -- 172.21.15.103:0/318565578 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f14e801d460 con 0x7f14f815ef00 2024-08-18T23:57:58.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.469+0000 7f14edffb640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f14dc06be30 0x7f14dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:58.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.469+0000 7f14edffb640 1 -- 172.21.15.103:0/318565578 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f14e808ae60 con 0x7f14f815ef00 2024-08-18T23:57:58.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.469+0000 7f14fd660640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f14dc06be30 0x7f14dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:58.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.470+0000 7f14fd660640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f14dc06be30 0x7f14dc06e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f14f4033000 tx=0x7f14f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:58.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.474+0000 7f14edffb640 1 -- 172.21.15.103:0/318565578 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f14e8059680 con 0x7f14f815ef00 2024-08-18T23:57:58.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.639+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) -- 0x7f14f815d810 con 0x7f14f815ef00 2024-08-18T23:57:58.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.642+0000 7f14edffb640 1 -- 172.21.15.103:0/318565578 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v11)=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f14e8058f80 con 0x7f14f815ef00 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f14dc06be30 msgr2=0x7f14dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f14dc06be30 0x7f14dc06e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f14f4033000 tx=0x7f14f4008030 comp rx=0 tx=0).stop 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14f815ef00 msgr2=0x7f14f814d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14f815ef00 0x7f14f814d880 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f14e800e7b0 tx=0x7f14e800ec70 comp rx=0 tx=0).stop 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 shutdown_connections 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f14dc06be30 0x7f14dc06e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14f80cfbd0 0x7f14f80d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14f815ef00 0x7f14f814d880 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 --2- 172.21.15.103:0/318565578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14e40039b0 0x7f14f8160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 >> 172.21.15.103:0/318565578 conn(0x7f14f80b2b80 msgr2=0x7f14f80b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:58.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 shutdown_connections 2024-08-18T23:57:58.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58.644+0000 7f14ff8c4640 1 -- 172.21.15.103:0/318565578 wait complete. 2024-08-18T23:57:58.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:58.657 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir0) 2024-08-18T23:57:58.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:58.678 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir0/file1) 2024-08-18T23:57:58.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:58.736 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s sym_dir0/file1 sym_dir0/symlink_file1) 2024-08-18T23:57:58.793 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-08-18T23:57:58.793 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-08-18T23:57:58.793 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-08-18T23:57:58.793 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:58.793 DEBUG:teuthology.orchestra.run.smithi103:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir0/symlink_file1").st_ino) 2024-08-18T23:57:58.793 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-08-18T23:57:58.898 INFO:teuthology.orchestra.run.smithi103.stdout:1099511628278 2024-08-18T23:57:58.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:57:58.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:57:59.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.046+0000 7fbcf47da640 1 Processor -- start 2024-08-18T23:57:59.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.046+0000 7fbcf47da640 1 -- start start 2024-08-18T23:57:59.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.047+0000 7fbcf47da640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbcec15e380 0x7fbcec0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.047+0000 7fbcf47da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 0x7fbcec0b7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.047+0000 7fbcf47da640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcec06daa0 con 0x7fbcec06d650 2024-08-18T23:57:59.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.047+0000 7fbcf47da640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbcec0b3500 con 0x7fbcec15e380 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.047+0000 7fbcf47da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbcec0b6a50 con 0x7fbcec0d1750 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.047+0000 7fbcf1d75640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbcec06d650 0x7fbcec0d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59126/0 (socket says 172.21.15.103:59126) 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.047+0000 7fbcf1d75640 1 -- 172.21.15.103:0/2750029355 learned_addr learned my addr 172.21.15.103:0/2750029355 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2d77640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 0x7fbcec0b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2576640 1 --2- 172.21.15.103:0/2750029355 >> v2:172.21.15.190:3300/0 conn(0x7fbcec15e380 0x7fbcec0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399439732 0 0) 0x7fbce8001110 con 0x7fbcec06d650 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd8003520 con 0x7fbcec06d650 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2974180357 0 0) 0x7fbcd8003520 con 0x7fbcec06d650 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 msgr2=0x7fbcec0b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 0x7fbcec0b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 >> v2:172.21.15.190:3300/0 conn(0x7fbcec15e380 msgr2=0x7fbcec0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 --2- 172.21.15.103:0/2750029355 >> v2:172.21.15.190:3300/0 conn(0x7fbcec15e380 0x7fbcec0cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec0b5e40 con 0x7fbcec06d650 2024-08-18T23:57:59.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fbce8001840 con 0x7fbcec06d650 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 >> v1:172.21.15.103:6789/0 conn(0x7fbcec06d650 legacy=0x7fbcec0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd80039b0 0x7fbcd8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 0x7fbcd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0b6a50 con 0x7fbcd8004d40 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd800b9c0 con 0x7fbcd80039b0 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbcd800bb40 con 0x7fbcec0d1750 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2576640 1 --2- 172.21.15.103:0/2750029355 >> v2:172.21.15.190:3300/0 conn(0x7fbcec15e380 0x7fbcec0cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2d77640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1d75640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 0x7fbcd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2576640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd80039b0 0x7fbcd8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2d77640 1 -- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 msgr2=0x7fbcd8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2d77640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 0x7fbcd8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2d77640 1 -- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd80039b0 msgr2=0x7fbcd8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2d77640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcd80039b0 0x7fbcd8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf2d77640 1 -- 172.21.15.103:0/2750029355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd8003520 con 0x7fbcd8004d40 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.048+0000 7fbcf1d75640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0d1750 0x7fbcd8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.049+0000 7fbcf2d77640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcd80051c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009fc0 tx=0x7fbcd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220fa07ed7a5c64d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.049+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4009c10 con 0x7fbcd8004d40 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.049+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce4036070 con 0x7fbcd8004d40 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.049+0000 7fbcf1574640 1 -- 172.21.15.103:0/2750029355 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4031880 con 0x7fbcd8004d40 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.050+0000 7fbcf47da640 1 -- 172.21.15.103:0/2750029355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 msgr2=0x7fbcd80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.050+0000 7fbcf47da640 1 --2- 172.21.15.103:0/2750029355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcd80051c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009fc0 tx=0x7fbcd8005830 comp rx=0 tx=0).stop 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.050+0000 7fbcf2d77640 1 -- 172.21.15.103:0/2750029355 reap_dead start 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.050+0000 7fbcf47da640 1 -- 172.21.15.103:0/2750029355 shutdown_connections 2024-08-18T23:57:59.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.050+0000 7fbcf47da640 1 -- 172.21.15.103:0/2750029355 >> 172.21.15.103:0/2750029355 conn(0x7fbcec073210 msgr2=0x7fbcec0735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:59.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.050+0000 7fbcf47da640 1 -- 172.21.15.103:0/2750029355 shutdown_connections 2024-08-18T23:57:59.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.050+0000 7fbcf47da640 1 -- 172.21.15.103:0/2750029355 wait complete. 2024-08-18T23:57:59.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.051+0000 7fbcf47da640 1 Processor -- start 2024-08-18T23:57:59.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.051+0000 7fbcf47da640 1 -- start start 2024-08-18T23:57:59.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf47da640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcec156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf47da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcec0c95a0 0x7fbcec0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf47da640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0cda70 0x7fbcec0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf47da640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0b66e0 con 0x7fbcd8004d40 2024-08-18T23:57:59.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf47da640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbcec0b6400 con 0x7fbcec0c95a0 2024-08-18T23:57:59.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf47da640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbcec0b7450 con 0x7fbcec0cda70 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcec156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcec156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48230/0 (socket says 172.21.15.103:48230) 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 -- 172.21.15.103:0/3017815791 learned_addr learned my addr 172.21.15.103:0/3017815791 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2d77640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0cda70 0x7fbcec0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf1d75640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcec0c95a0 0x7fbcec0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 -- 172.21.15.103:0/3017815791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0cda70 msgr2=0x7fbcec0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0cda70 0x7fbcec0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 -- 172.21.15.103:0/3017815791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcec0c95a0 msgr2=0x7fbcec0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcec0c95a0 0x7fbcec0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 -- 172.21.15.103:0/3017815791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec15e900 con 0x7fbcd8004d40 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf2576640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcec156fc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbce0011900 tx=0x7fbce0011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcdeffd640 1 -- 172.21.15.103:0/3017815791 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce000fbd0 con 0x7fbcd8004d40 2024-08-18T23:57:59.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcdeffd640 1 -- 172.21.15.103:0/3017815791 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce000fd70 con 0x7fbcd8004d40 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcec15b060 con 0x7fbcd8004d40 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcdeffd640 1 -- 172.21.15.103:0/3017815791 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0015660 con 0x7fbcd8004d40 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.052+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcec15eba0 con 0x7fbcd8004d40 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.053+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcec0cf500 con 0x7fbcd8004d40 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.054+0000 7fbcdeffd640 1 -- 172.21.15.103:0/3017815791 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbce0015800 con 0x7fbcd8004d40 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.054+0000 7fbcdeffd640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbcd006be30 0x7fbcd006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.054+0000 7fbcdeffd640 1 -- 172.21.15.103:0/3017815791 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fbce008bc10 con 0x7fbcd8004d40 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.054+0000 7fbcf1d75640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbcd006be30 0x7fbcd006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.055+0000 7fbcf1d75640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbcd006be30 0x7fbcd006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbce8000ff0 tx=0x7fbce8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.059+0000 7fbcdeffd640 1 -- 172.21.15.103:0/3017815791 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbce0019030 con 0x7fbcd8004d40 2024-08-18T23:57:59.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.258+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcec15b580 con 0x7fbcd8004d40 2024-08-18T23:57:59.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.258+0000 7fbcdeffd640 1 -- 172.21.15.103:0/3017815791 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7fbce005a430 con 0x7fbcd8004d40 2024-08-18T23:57:59.260 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:57:59.260 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:57:47.319563+0000","modified":"2024-08-18T23:57:49.334110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/171106802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":171106802},{"type":"v1","addr":"172.21.15.103:6835","nonce":171106802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-08-18T23:57:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbcd006be30 msgr2=0x7fbcd006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbcd006be30 0x7fbcd006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbce8000ff0 tx=0x7fbce8009040 comp rx=0 tx=0).stop 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 msgr2=0x7fbcec156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcec156fc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbce0011900 tx=0x7fbce0011dc0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 shutdown_connections 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbcd006be30 0x7fbcd006e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbcec0cda70 0x7fbcec0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbcec0c95a0 0x7fbcec0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 --2- 172.21.15.103:0/3017815791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcd8004d40 0x7fbcec156fc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 >> 172.21.15.103:0/3017815791 conn(0x7fbcec073210 msgr2=0x7fbcec0b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 shutdown_connections 2024-08-18T23:57:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.260+0000 7fbcf47da640 1 -- 172.21.15.103:0/3017815791 wait complete. 2024-08-18T23:57:59.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-08-18T23:57:59.396 INFO:teuthology.orchestra.run.smithi103.stdout:{"message":"","return_code":0} 2024-08-18T23:57:59.396 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-08-18T23:57:59.397 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.438+0000 7f7a6a279f40 1 Processor -- start 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.438+0000 7f7a6a279f40 1 -- start start 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a6a279f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a60fc0 0x5561d6b07a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a6a279f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a77e20 0x5561d6b007f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a6a279f40 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a79d40 0x5561d6a750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a6a279f40 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5561d6a7a120 con 0x5561d6a79d40 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a6a279f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5561d6982c10 con 0x5561d6a77e20 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a6a279f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5561d6a61410 con 0x5561d6a60fc0 2024-08-18T23:57:59.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a79d40 0x5561d6a750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a79d40 0x5561d6a750c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48244/0 (socket says 172.21.15.103:48244) 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 -- 172.21.15.103:0/3985319076 learned_addr learned my addr 172.21.15.103:0/3985319076 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a67572640 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a77e20 0x5561d6b007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a67d73640 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a60fc0 0x5561d6b07a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 -- 172.21.15.103:0/3985319076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a60fc0 msgr2=0x5561d6b07a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a60fc0 0x5561d6b07a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 -- 172.21.15.103:0/3985319076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a77e20 msgr2=0x5561d6b007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a77e20 0x5561d6b007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 -- 172.21.15.103:0/3985319076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d69664c0 con 0x5561d6a79d40 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.439+0000 7f7a68574640 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a79d40 0x5561d6a750c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7a58025d20 tx=0x7f7a58051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce18574607b57020 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a66570640 1 -- 172.21.15.103:0/3985319076 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58051760 con 0x5561d6a79d40 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a66570640 1 -- 172.21.15.103:0/3985319076 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a58051900 con 0x5561d6a79d40 2024-08-18T23:57:59.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a66570640 1 -- 172.21.15.103:0/3985319076 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58051cb0 con 0x5561d6a79d40 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 -- 172.21.15.103:0/3985319076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a79d40 msgr2=0x5561d6a750c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a79d40 0x5561d6a750c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7a58025d20 tx=0x7f7a58051000 comp rx=0 tx=0).stop 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 -- 172.21.15.103:0/3985319076 shutdown_connections 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a79d40 0x5561d6a750c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a77e20 0x5561d6b007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 --2- 172.21.15.103:0/3985319076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a60fc0 0x5561d6b07a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 -- 172.21.15.103:0/3985319076 >> 172.21.15.103:0/3985319076 conn(0x5561d6a30640 msgr2=0x5561d6a5f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 -- 172.21.15.103:0/3985319076 shutdown_connections 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.440+0000 7f7a6a279f40 1 -- 172.21.15.103:0/3985319076 wait complete. 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a6a279f40 1 Processor -- start 2024-08-18T23:57:59.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a6a279f40 1 -- start start 2024-08-18T23:57:59.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a6a279f40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a60fc0 0x5561d6afa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a6a279f40 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a77e20 0x5561d6b96960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a6a279f40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a79d40 0x5561d6b98940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a6a279f40 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5561d6b076d0 con 0x5561d6a77e20 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a6a279f40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5561d6a5c1c0 con 0x5561d6a60fc0 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a6a279f40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5561d6b01250 con 0x5561d6a79d40 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.441+0000 7f7a67572640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a77e20 0x5561d6b96960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67572640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a77e20 0x5561d6b96960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48256/0 (socket says 172.21.15.103:48256) 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67572640 1 -- 172.21.15.103:0/2012965667 learned_addr learned my addr 172.21.15.103:0/2012965667 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67d73640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a60fc0 0x5561d6afa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a68574640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a79d40 0x5561d6b98940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67572640 1 -- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a79d40 msgr2=0x5561d6b98940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67572640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5561d6a79d40 0x5561d6b98940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67572640 1 -- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a60fc0 msgr2=0x5561d6afa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67572640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5561d6a60fc0 0x5561d6afa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67572640 1 -- 172.21.15.103:0/2012965667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561d695ccb0 con 0x5561d6a77e20 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a67572640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a77e20 0x5561d6b96960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a50007e20 tx=0x7f7a50006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a6556e640 1 -- 172.21.15.103:0/2012965667 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50018070 con 0x5561d6a77e20 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a6556e640 1 -- 172.21.15.103:0/2012965667 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a50011700 con 0x5561d6a77e20 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561d6b01760 con 0x5561d6a77e20 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a6556e640 1 -- 172.21.15.103:0/2012965667 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50011ad0 con 0x5561d6a77e20 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.442+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561d6b0af90 con 0x5561d6a77e20 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.443+0000 7f7a6556e640 1 -- 172.21.15.103:0/2012965667 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a5001b070 con 0x5561d6a77e20 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.444+0000 7f7a6556e640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7a4806a840 0x7f7a4806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.444+0000 7f7a67d73640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7a4806a840 0x7f7a4806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.444+0000 7f7a6556e640 1 -- 172.21.15.103:0/2012965667 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f7a50088f80 con 0x5561d6a77e20 2024-08-18T23:57:59.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.444+0000 7f7a6a279f40 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x5561d6b96ea0 0x5561d6b08640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.444+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 --> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] -- osd_op(unknown.0.0:1 6.2a 6:57fe7535:::100000001f6.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x5561d6b99390 con 0x5561d6b96ea0 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.444+0000 7f7a67d73640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7a4806a840 0x7f7a4806cd00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5561d6a30c80 tx=0x7f7a60007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.444+0000 7f7a68574640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x5561d6b96ea0 0x5561d6b08640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a68574640 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x5561d6b96ea0 0x5561d6b08640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a68574640 1 -- 172.21.15.103:0/2012965667 <== osd.4 v2:172.21.15.190:6816/491823420 1 ==== osd_op_reply(1 100000001f6.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) ==== 164+0+0 (crc 0 0 0) 0x7f7a58057030 con 0x5561d6b96ea0 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:error getting xattr cephfs_data/100000001f6.00000000/symlink: (61) No data available 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x5561d6b96ea0 msgr2=0x5561d6b08640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x5561d6b96ea0 0x5561d6b08640 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7a4806a840 msgr2=0x7f7a4806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f7a4806a840 0x7f7a4806cd00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5561d6a30c80 tx=0x7f7a60007040 comp rx=0 tx=0).stop 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a77e20 msgr2=0x5561d6b96960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 --2- 172.21.15.103:0/2012965667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5561d6a77e20 0x5561d6b96960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7a50007e20 tx=0x7f7a50006750 comp rx=0 tx=0).stop 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a68574640 1 -- 172.21.15.103:0/2012965667 reap_dead start 2024-08-18T23:57:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 shutdown_connections 2024-08-18T23:57:59.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 >> 172.21.15.103:0/2012965667 conn(0x5561d6a30640 msgr2=0x5561d6a5f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:59.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 shutdown_connections 2024-08-18T23:57:59.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.445+0000 7f7a6a279f40 1 -- 172.21.15.103:0/2012965667 wait complete. 2024-08-18T23:57:59.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:57:59.453 ERROR:tasks.cephfs.filesystem:Command failed on smithi103 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f6.00000000 symlink' 2024-08-18T23:57:59.453 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_symlink_recovery true 2024-08-18T23:57:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.593+0000 7f66ee7bf640 1 Processor -- start 2024-08-18T23:57:59.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.593+0000 7f66ee7bf640 1 -- start start 2024-08-18T23:57:59.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.594+0000 7f66ee7bf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 0x7f66e8070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.594+0000 7f66ee7bf640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e8071000 con 0x7f66e806db30 2024-08-18T23:57:59.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.594+0000 7f66ee7bf640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e80cc690 con 0x7f66e806cc20 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.594+0000 7f66ee7bf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f66e806c760 con 0x7f66e80d1770 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.594+0000 7f66ecd5c640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f66e806db30 0x7f66e80cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59134/0 (socket says 172.21.15.103:59134) 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.594+0000 7f66ecd5c640 1 -- 172.21.15.103:0/3971546371 learned_addr learned my addr 172.21.15.103:0/3971546371 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e7fff640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 0x7f66e8070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406365176 0 0) 0x7f66e8071000 con 0x7f66e806db30 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66d0003520 con 0x7f66e806db30 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3335834886 0 0) 0x7f66d0003520 con 0x7f66e806db30 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 msgr2=0x7f66e8070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 0x7f66e8070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 >> v1:172.21.15.190:6789/0 conn(0x7f66e806cc20 legacy=0x7f66e806d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e80cc970 con 0x7f66e806db30 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f66e00019f0 con 0x7f66e806db30 2024-08-18T23:57:59.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 >> v1:172.21.15.103:6789/0 conn(0x7f66e806db30 legacy=0x7f66e80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 0x7f66d00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66d0003f60 0x7f66d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d0004d40 0x7f66d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66e806c760 con 0x7f66d0004d40 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f66d000bb50 con 0x7f66d0003f60 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f66d000bd50 con 0x7f66e80d1770 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66ecd5c640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d0004d40 0x7f66d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e7fff640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 0x7f66d00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e77fe640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66d0003f60 0x7f66d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66ecd5c640 1 -- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 msgr2=0x7f66d00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66ecd5c640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 0x7f66d00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66ecd5c640 1 -- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66d0003f60 msgr2=0x7f66d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:57:59.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66ecd5c640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66d0003f60 0x7f66d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66ecd5c640 1 -- 172.21.15.103:0/3971546371 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d0003520 con 0x7f66d0004d40 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.595+0000 7f66e7fff640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80d1770 0x7f66d00039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.596+0000 7f66ecd5c640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d0004d40 0x7f66d00051c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f66e80b3960 tx=0x7f66d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5aa63643420f6ae server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.596+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e000a4a0 con 0x7f66d0004d40 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.596+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e002f070 con 0x7f66d0004d40 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.596+0000 7f66e6ffd640 1 -- 172.21.15.103:0/3971546371 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e002bc70 con 0x7f66d0004d40 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.597+0000 7f66ee7bf640 1 -- 172.21.15.103:0/3971546371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d0004d40 msgr2=0x7f66d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.597+0000 7f66ee7bf640 1 --2- 172.21.15.103:0/3971546371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66d0004d40 0x7f66d00051c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f66e80b3960 tx=0x7f66d0005830 comp rx=0 tx=0).stop 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.597+0000 7f66ecd5c640 1 -- 172.21.15.103:0/3971546371 reap_dead start 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.597+0000 7f66ee7bf640 1 -- 172.21.15.103:0/3971546371 shutdown_connections 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.597+0000 7f66ee7bf640 1 -- 172.21.15.103:0/3971546371 >> 172.21.15.103:0/3971546371 conn(0x7f66e80d1ec0 msgr2=0x7f66e80d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.597+0000 7f66ee7bf640 1 -- 172.21.15.103:0/3971546371 shutdown_connections 2024-08-18T23:57:59.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.597+0000 7f66ee7bf640 1 -- 172.21.15.103:0/3971546371 wait complete. 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.598+0000 7f66ee7bf640 1 Processor -- start 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.598+0000 7f66ee7bf640 1 -- start start 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66ee7bf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e815e9e0 0x7f66e809e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66ee7bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e80b3240 0x7f66e80ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66ee7bf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80cabd0 0x7f66e80c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66ee7bf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66e8070920 con 0x7f66e80b3240 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66ee7bf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f66e80ccce0 con 0x7f66e815e9e0 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66ee7bf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f66e8070aa0 con 0x7f66e80cabd0 2024-08-18T23:57:59.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e80b3240 0x7f66e80ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e80b3240 0x7f66e80ca690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48268/0 (socket says 172.21.15.103:48268) 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 -- 172.21.15.103:0/391453663 learned_addr learned my addr 172.21.15.103:0/391453663 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66ecd5c640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80cabd0 0x7f66e80c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e7fff640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e815e9e0 0x7f66e809e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 -- 172.21.15.103:0/391453663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80cabd0 msgr2=0x7f66e80c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80cabd0 0x7f66e80c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 -- 172.21.15.103:0/391453663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e815e9e0 msgr2=0x7f66e809e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e815e9e0 0x7f66e809e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 -- 172.21.15.103:0/391453663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e809ece0 con 0x7f66e80b3240 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e77fe640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e80b3240 0x7f66e80ca690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e500 tx=0x7f66dc00e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e4ff9640 1 -- 172.21.15.103:0/391453663 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0052e0 con 0x7f66e80b3240 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e4ff9640 1 -- 172.21.15.103:0/391453663 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc018070 con 0x7f66e80b3240 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e809efc0 con 0x7f66e80b3240 2024-08-18T23:57:59.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.599+0000 7f66e4ff9640 1 -- 172.21.15.103:0/391453663 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc003810 con 0x7f66e80b3240 2024-08-18T23:57:59.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.600+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e809f580 con 0x7f66e80b3240 2024-08-18T23:57:59.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.601+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e8071000 con 0x7f66e80b3240 2024-08-18T23:57:59.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.601+0000 7f66e4ff9640 1 -- 172.21.15.103:0/391453663 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66dc0039b0 con 0x7f66e80b3240 2024-08-18T23:57:59.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.601+0000 7f66e4ff9640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66d406be30 0x7f66d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:57:59.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.602+0000 7f66e7fff640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66d406be30 0x7f66d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:57:59.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.602+0000 7f66e4ff9640 1 -- 172.21.15.103:0/391453663 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f66dc08ab00 con 0x7f66e80b3240 2024-08-18T23:57:59.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.602+0000 7f66e7fff640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66d406be30 0x7f66d406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f66e80cb340 tx=0x7f66d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:57:59.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.606+0000 7f66e4ff9640 1 -- 172.21.15.103:0/391453663 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f66dc058ce0 con 0x7f66e80b3240 2024-08-18T23:57:59.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.770+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mds_symlink_recovery}] v 0) -- 0x7f66e80d0820 con 0x7f66e80b3240 2024-08-18T23:57:59.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.775+0000 7f66e4ff9640 1 -- 172.21.15.103:0/391453663 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_symlink_recovery}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f66dc05cfe0 con 0x7f66e80b3240 2024-08-18T23:57:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.777+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66d406be30 msgr2=0x7f66d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.777+0000 7f66ee7bf640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66d406be30 0x7f66d406e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f66e80cb340 tx=0x7f66d8008040 comp rx=0 tx=0).stop 2024-08-18T23:57:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.777+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e80b3240 msgr2=0x7f66e80ca690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:57:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.777+0000 7f66ee7bf640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e80b3240 0x7f66e80ca690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e500 tx=0x7f66dc00e9c0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.778+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 shutdown_connections 2024-08-18T23:57:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.778+0000 7f66ee7bf640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f66d406be30 0x7f66d406e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.778+0000 7f66ee7bf640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66e80cabd0 0x7f66e80c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.779 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.778+0000 7f66ee7bf640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e80b3240 0x7f66e80ca690 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.778+0000 7f66ee7bf640 1 --2- 172.21.15.103:0/391453663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66e815e9e0 0x7f66e809e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:57:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.778+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 >> 172.21.15.103:0/391453663 conn(0x7f66e80d1ec0 msgr2=0x7f66e806df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:57:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.778+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 shutdown_connections 2024-08-18T23:57:59.780 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:57:59.778+0000 7f66ee7bf640 1 -- 172.21.15.103:0/391453663 wait complete. 2024-08-18T23:57:59.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:59.790 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir sym_dir) 2024-08-18T23:57:59.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:59.807 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch sym_dir/file1) 2024-08-18T23:57:59.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:57:59.867 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln -s ./file1 sym_dir/symlink_file1) 2024-08-18T23:57:59.924 DEBUG:teuthology.orchestra.run.smithi103:> stdin-killer -- python3 -c ' 2024-08-18T23:57:59.924 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-08-18T23:57:59.924 DEBUG:teuthology.orchestra.run.smithi103:> import stat 2024-08-18T23:57:59.924 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-18T23:57:59.924 DEBUG:teuthology.orchestra.run.smithi103:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/sym_dir/symlink_file1").st_ino) 2024-08-18T23:57:59.925 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-08-18T23:58:00.029 INFO:teuthology.orchestra.run.smithi103.stdout:1099511628281 2024-08-18T23:58:00.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-18T23:58:00.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:58:00.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.176+0000 7f41ae0ef640 1 Processor -- start 2024-08-18T23:58:00.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.176+0000 7f41ae0ef640 1 -- start start 2024-08-18T23:58:00.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.177+0000 7f41ae0ef640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a815ade0 0x7f41a806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.177+0000 7f41ae0ef640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a815f6c0 con 0x7f41a80ae9e0 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.177+0000 7f41ae0ef640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a8072610 con 0x7f41a80b4370 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.177+0000 7f41ae0ef640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f41a806db10 con 0x7f41a815ade0 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.177+0000 7f41a7fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f41a80ae9e0 0x7f41a815efb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59150/0 (socket says 172.21.15.103:59150) 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.177+0000 7f41a7fff640 1 -- 172.21.15.103:0/475489652 learned_addr learned my addr 172.21.15.103:0/475489652 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.178+0000 7f41a77fe640 1 --2- 172.21.15.103:0/475489652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a815ade0 0x7f41a806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.178+0000 7f41a67fc640 1 -- 172.21.15.103:0/475489652 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252223792 0 0) 0x7f41a815f6c0 con 0x7f41a80ae9e0 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.178+0000 7f41a67fc640 1 -- 172.21.15.103:0/475489652 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4190003520 con 0x7f41a80ae9e0 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.178+0000 7f41a67fc640 1 -- 172.21.15.103:0/475489652 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392033334 0 0) 0x7f41a8072610 con 0x7f41a80b4370 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.178+0000 7f41a67fc640 1 -- 172.21.15.103:0/475489652 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a815f6c0 con 0x7f41a80b4370 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.178+0000 7f41a77fe640 1 -- 172.21.15.103:0/475489652 >> v1:172.21.15.190:6789/0 conn(0x7f41a80b4370 legacy=0x7f41a815e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.178+0000 7f41a77fe640 1 -- 172.21.15.103:0/475489652 >> v1:172.21.15.103:6789/0 conn(0x7f41a80ae9e0 legacy=0x7f41a815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.178+0000 7f41a77fe640 1 -- 172.21.15.103:0/475489652 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a80728f0 con 0x7f41a815ade0 2024-08-18T23:58:00.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41a77fe640 1 --2- 172.21.15.103:0/475489652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a815ade0 0x7f41a806f060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4198009dc0 tx=0x7f419802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f4904dfe89c77ae server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41a67fc640 1 -- 172.21.15.103:0/475489652 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419802ae60 con 0x7f41a815ade0 2024-08-18T23:58:00.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41a67fc640 1 -- 172.21.15.103:0/475489652 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198007740 con 0x7f41a815ade0 2024-08-18T23:58:00.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41a67fc640 1 -- 172.21.15.103:0/475489652 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4198007af0 con 0x7f41a815ade0 2024-08-18T23:58:00.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41ae0ef640 1 -- 172.21.15.103:0/475489652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a815ade0 msgr2=0x7f41a806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41ae0ef640 1 --2- 172.21.15.103:0/475489652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a815ade0 0x7f41a806f060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4198009dc0 tx=0x7f419802a640 comp rx=0 tx=0).stop 2024-08-18T23:58:00.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41ae0ef640 1 -- 172.21.15.103:0/475489652 shutdown_connections 2024-08-18T23:58:00.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41ae0ef640 1 --2- 172.21.15.103:0/475489652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a815ade0 0x7f41a806f060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.179+0000 7f41ae0ef640 1 -- 172.21.15.103:0/475489652 >> 172.21.15.103:0/475489652 conn(0x7f41a80cfc40 msgr2=0x7f41a80d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:00.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.180+0000 7f41ae0ef640 1 -- 172.21.15.103:0/475489652 shutdown_connections 2024-08-18T23:58:00.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.180+0000 7f41ae0ef640 1 -- 172.21.15.103:0/475489652 wait complete. 2024-08-18T23:58:00.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.181+0000 7f41ae0ef640 1 Processor -- start 2024-08-18T23:58:00.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.181+0000 7f41ae0ef640 1 -- start start 2024-08-18T23:58:00.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.181+0000 7f41ae0ef640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a80ae9e0 0x7f41a81523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41ae0ef640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41a80b4370 0x7f41a815d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41ae0ef640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41a815ade0 0x7f41a815dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41ae0ef640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8072eb0 con 0x7f41a815ade0 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41ae0ef640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f41a815b1c0 con 0x7f41a80b4370 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41ae0ef640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f41a806d6c0 con 0x7f41a80ae9e0 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41a815ade0 0x7f41a815dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41a815ade0 0x7f41a815dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48282/0 (socket says 172.21.15.103:48282) 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 -- 172.21.15.103:0/833523533 learned_addr learned my addr 172.21.15.103:0/833523533 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a77fe640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a80ae9e0 0x7f41a81523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a6ffd640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41a80b4370 0x7f41a815d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 -- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a80ae9e0 msgr2=0x7f41a81523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a80ae9e0 0x7f41a81523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 -- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41a80b4370 msgr2=0x7f41a815d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41a80b4370 0x7f41a815d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 -- 172.21.15.103:0/833523533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a8152920 con 0x7f41a815ade0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a6ffd640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41a80b4370 0x7f41a815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41a7fff640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41a815ade0 0x7f41a815dac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c430 tx=0x7f41a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f418ffff640 1 -- 172.21.15.103:0/833523533 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0017070 con 0x7f41a815ade0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f418ffff640 1 -- 172.21.15.103:0/833523533 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a0005ce0 con 0x7f41a815ade0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.182+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a81f5140 con 0x7f41a815ade0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.183+0000 7f418ffff640 1 -- 172.21.15.103:0/833523533 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00072f0 con 0x7f41a815ade0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.183+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81f5700 con 0x7f41a815ade0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.184+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a80b47b0 con 0x7f41a815ade0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.184+0000 7f418ffff640 1 -- 172.21.15.103:0/833523533 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41a001a070 con 0x7f41a815ade0 2024-08-18T23:58:00.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.184+0000 7f418ffff640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f419406be30 0x7f419406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.184+0000 7f418ffff640 1 -- 172.21.15.103:0/833523533 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f41a008a330 con 0x7f41a815ade0 2024-08-18T23:58:00.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.184+0000 7f41a77fe640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f419406be30 0x7f419406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.185+0000 7f41a77fe640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f419406be30 0x7f419406e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4198034000 tx=0x7f419802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.189+0000 7f418ffff640 1 -- 172.21.15.103:0/833523533 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f41a0058500 con 0x7f41a815ade0 2024-08-18T23:58:00.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.388+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41a81567b0 con 0x7f41a815ade0 2024-08-18T23:58:00.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.389+0000 7f418ffff640 1 -- 172.21.15.103:0/833523533 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7f41a005c800 con 0x7f41a815ade0 2024-08-18T23:58:00.390 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:00.390 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:57:47.319563+0000","modified":"2024-08-18T23:57:49.334110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/171106802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":171106802},{"type":"v1","addr":"172.21.15.103:6835","nonce":171106802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-08-18T23:58:00.390 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-08-18T23:58:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.390+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f419406be30 msgr2=0x7f419406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.390+0000 7f41ae0ef640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f419406be30 0x7f419406e2f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4198034000 tx=0x7f419802f000 comp rx=0 tx=0).stop 2024-08-18T23:58:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.390+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41a815ade0 msgr2=0x7f41a815dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.390+0000 7f41ae0ef640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41a815ade0 0x7f41a815dac0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c430 tx=0x7f41a000c8f0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.391+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 shutdown_connections 2024-08-18T23:58:00.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.391+0000 7f41ae0ef640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f419406be30 0x7f419406e2f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.391+0000 7f41ae0ef640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f41a815ade0 0x7f41a815dac0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.391+0000 7f41ae0ef640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41a80b4370 0x7f41a815d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.391+0000 7f41ae0ef640 1 --2- 172.21.15.103:0/833523533 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41a80ae9e0 0x7f41a81523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.391+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 >> 172.21.15.103:0/833523533 conn(0x7f41a80cfc40 msgr2=0x7f41a80d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.391+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 shutdown_connections 2024-08-18T23:58:00.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.391+0000 7f41ae0ef640 1 -- 172.21.15.103:0/833523533 wait complete. 2024-08-18T23:58:00.403 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-08-18T23:58:00.525 INFO:teuthology.orchestra.run.smithi103.stdout:{"message":"","return_code":0} 2024-08-18T23:58:00.526 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-08-18T23:58:00.526 DEBUG:teuthology.orchestra.run.smithi103:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f9.00000000 symlink 2024-08-18T23:58:00.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.568+0000 7f8033aebf40 1 Processor -- start 2024-08-18T23:58:00.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.568+0000 7f8033aebf40 1 -- start start 2024-08-18T23:58:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f8033aebf40 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8020003970 0x5623f32b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f8033aebf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bc240 0x5623f32bb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f8033aebf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623f32bba70 0x5623f32b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f8033aebf40 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5623f3190e80 con 0x7f8020003970 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f8033aebf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5623f3194ec0 con 0x5623f32bc240 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f8033aebf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5623f313bc10 con 0x5623f32bba70 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f80315e5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8020003970 0x5623f32b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f80315e5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8020003970 0x5623f32b19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48286/0 (socket says 172.21.15.103:48286) 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f80315e5640 1 -- 172.21.15.103:0/976442059 learned_addr learned my addr 172.21.15.103:0/976442059 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f8028de4640 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bc240 0x5623f32bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.569+0000 7f8031de6640 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623f32bba70 0x5623f32b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f80315e5640 1 -- 172.21.15.103:0/976442059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623f32bba70 msgr2=0x5623f32b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f80315e5640 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623f32bba70 0x5623f32b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f80315e5640 1 -- 172.21.15.103:0/976442059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bc240 msgr2=0x5623f32bb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f80315e5640 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bc240 0x5623f32bb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f80315e5640 1 -- 172.21.15.103:0/976442059 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623f31e8250 con 0x7f8020003970 2024-08-18T23:58:00.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f80315e5640 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8020003970 0x5623f32b19d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f80240089e0 tx=0x7f8024008ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c634ac9c3f9114e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f802bfff640 1 -- 172.21.15.103:0/976442059 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80240098c0 con 0x7f8020003970 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f802bfff640 1 -- 172.21.15.103:0/976442059 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802401b070 con 0x7f8020003970 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f802bfff640 1 -- 172.21.15.103:0/976442059 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024009c60 con 0x7f8020003970 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 -- 172.21.15.103:0/976442059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8020003970 msgr2=0x5623f32b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8020003970 0x5623f32b19d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f80240089e0 tx=0x7f8024008ad0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 -- 172.21.15.103:0/976442059 shutdown_connections 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5623f32bba70 0x5623f32b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bc240 0x5623f32bb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 --2- 172.21.15.103:0/976442059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8020003970 0x5623f32b19d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 -- 172.21.15.103:0/976442059 >> 172.21.15.103:0/976442059 conn(0x5623f3213ac0 msgr2=0x5623f3219360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 -- 172.21.15.103:0/976442059 shutdown_connections 2024-08-18T23:58:00.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.570+0000 7f8033aebf40 1 -- 172.21.15.103:0/976442059 wait complete. 2024-08-18T23:58:00.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.571+0000 7f8033aebf40 1 Processor -- start 2024-08-18T23:58:00.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.571+0000 7f8033aebf40 1 -- start start 2024-08-18T23:58:00.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8033aebf40 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bba70 0x5623f31eb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8033aebf40 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623f32bc240 0x5623f32aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8033aebf40 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8020003970 0x5623f32aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8033aebf40 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5623f31e7f90 con 0x5623f32bc240 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8033aebf40 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5623f32bac80 con 0x5623f32bba70 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8033aebf40 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5623f32b1f10 con 0x7f8020003970 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623f32bc240 0x5623f32aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623f32bc240 0x5623f32aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48300/0 (socket says 172.21.15.103:48300) 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 -- 172.21.15.103:0/2280294163 learned_addr learned my addr 172.21.15.103:0/2280294163 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f80315e5640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bba70 0x5623f31eb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8031de6640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8020003970 0x5623f32aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 -- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8020003970 msgr2=0x5623f32aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8020003970 0x5623f32aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 -- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bba70 msgr2=0x5623f31eb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5623f32bba70 0x5623f31eb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 -- 172.21.15.103:0/2280294163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623f32b41a0 con 0x5623f32bc240 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8028de4640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623f32bc240 0x5623f32aeab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f801c0106b0 tx=0x7f801c010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f802affd640 1 -- 172.21.15.103:0/2280294163 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c00e8b0 con 0x5623f32bc240 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f802affd640 1 -- 172.21.15.103:0/2280294163 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801c00ea50 con 0x5623f32bc240 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623f32b1100 con 0x5623f32bc240 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.572+0000 7f802affd640 1 -- 172.21.15.103:0/2280294163 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801c00ee40 con 0x5623f32bc240 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.573+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623f3218060 con 0x5623f32bc240 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.574+0000 7f802affd640 1 -- 172.21.15.103:0/2280294163 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f801c012430 con 0x5623f32bc240 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.574+0000 7f802affd640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f801406a810 0x7f801406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.574+0000 7f802affd640 1 -- 172.21.15.103:0/2280294163 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f801c08a630 con 0x5623f32bc240 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.574+0000 7f80315e5640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f801406a810 0x7f801406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.574+0000 7f8033aebf40 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x5623f31eba80 0x5623f335e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.574+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 --> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] -- osd_op(unknown.0.0:1 6.36 6:6ee5e2c4:::100000001f9.00000000:head [getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38) -- 0x5623f3213430 con 0x5623f31eba80 2024-08-18T23:58:00.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f80315e5640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f801406a810 0x7f801406ccd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8024000c00 tx=0x7f802400c070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8031de6640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x5623f31eba80 0x5623f335e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8031de6640 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x5623f31eba80 0x5623f335e970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8031de6640 1 -- 172.21.15.103:0/2280294163 <== osd.5 v2:172.21.15.190:6800/1802306472 1 ==== osd_op_reply(1 100000001f9.00000000 [getxattr (11) out=11b] v0'0 uv1 ondisk = 0) ==== 164+0+11 (crc 0 0 0) 0x7f802c001730 con 0x5623f31eba80 2024-08-18T23:58:00.580 INFO:teuthology.orchestra.run.smithi103.stdout:./file1 2024-08-18T23:58:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x5623f31eba80 msgr2=0x5623f335e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8033aebf40 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x5623f31eba80 0x5623f335e970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f801406a810 msgr2=0x7f801406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8033aebf40 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f801406a810 0x7f801406ccd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8024000c00 tx=0x7f802400c070 comp rx=0 tx=0).stop 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623f32bc240 msgr2=0x5623f32aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8033aebf40 1 --2- 172.21.15.103:0/2280294163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5623f32bc240 0x5623f32aeab0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f801c0106b0 tx=0x7f801c010b70 comp rx=0 tx=0).stop 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.575+0000 7f8031de6640 1 -- 172.21.15.103:0/2280294163 reap_dead start 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.576+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 shutdown_connections 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.576+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 >> 172.21.15.103:0/2280294163 conn(0x5623f3213ac0 msgr2=0x5623f31ea2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.576+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 shutdown_connections 2024-08-18T23:58:00.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.576+0000 7f8033aebf40 1 -- 172.21.15.103:0/2280294163 wait complete. 2024-08-18T23:58:00.582 DEBUG:teuthology.orchestra.run.smithi103:> ceph-dencoder type string_wrapper import - decode dump_json 2024-08-18T23:58:00.662 INFO:teuthology.orchestra.run.smithi103.stderr:error: stray data at end of buffer, offset 11 2024-08-18T23:58:00.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:00.681 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-18T23:58:00.681 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T23:58:00.758 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-18T23:58:00.808 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-18T23:58:00.808 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T23:58:00.809 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:58:00.809 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:58:00.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-08-18T23:58:00.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.964+0000 7f4402d1a640 1 Processor -- start 2024-08-18T23:58:00.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.964+0000 7f4402d1a640 1 -- start start 2024-08-18T23:58:00.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f4402d1a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f43fc0708c0 0x7f43fc166d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f4402d1a640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc0cd870 con 0x7f43fc0d2b30 2024-08-18T23:58:00.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f4402d1a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc0cdb50 con 0x7f43fc15c2d0 2024-08-18T23:58:00.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f4402d1a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f43fc15c6b0 con 0x7f43fc0708c0 2024-08-18T23:58:00.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f3fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f43fc0d2b30 0x7f43fc0701b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59180/0 (socket says 172.21.15.103:59180) 2024-08-18T23:58:00.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f3fff640 1 -- 172.21.15.103:0/1548963701 learned_addr learned my addr 172.21.15.103:0/1548963701 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:00.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f44012b7640 1 --2- 172.21.15.103:0/1548963701 >> v2:172.21.15.190:3300/0 conn(0x7f43fc0708c0 0x7f43fc166d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819366254 0 0) 0x7f43fc0cd870 con 0x7f43fc0d2b30 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e4003520 con 0x7f43fc0d2b30 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781359363 0 0) 0x7f43e4003520 con 0x7f43fc0d2b30 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 >> v2:172.21.15.190:3300/0 conn(0x7f43fc0708c0 msgr2=0x7f43fc166d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 --2- 172.21.15.103:0/1548963701 >> v2:172.21.15.190:3300/0 conn(0x7f43fc0708c0 0x7f43fc166d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 >> v1:172.21.15.190:6789/0 conn(0x7f43fc15c2d0 legacy=0x7f43fc06f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc0cde30 con 0x7f43fc0d2b30 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f43ec001670 con 0x7f43fc0d2b30 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 >> v1:172.21.15.103:6789/0 conn(0x7f43fc0d2b30 legacy=0x7f43fc0701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43e40039b0 0x7f43e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43e4004800 0x7f43e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc15c6b0 con 0x7f43e40051c0 2024-08-18T23:58:00.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43e400c010 con 0x7f43e4004800 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43e400c210 con 0x7f43e40039b0 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.965+0000 7f44012b7640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f43f3fff640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43e4004800 0x7f43e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f4400ab6640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43e40039b0 0x7f43e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f44012b7640 1 -- 172.21.15.103:0/1548963701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43e40039b0 msgr2=0x7f43e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f44012b7640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43e40039b0 0x7f43e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f44012b7640 1 -- 172.21.15.103:0/1548963701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43e4004800 msgr2=0x7f43e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f44012b7640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43e4004800 0x7f43e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f44012b7640 1 -- 172.21.15.103:0/1548963701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc0cde30 con 0x7f43e40051c0 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f44012b7640 1 -- 172.21.15.103:0/1548963701 reap_dead start 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.966+0000 7f44012b7640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43e400b9c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f43fc072a10 tx=0x7f43e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca17dadf1fe8c13f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4009c10 con 0x7f43e40051c0 2024-08-18T23:58:00.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f4031410 con 0x7f43e40051c0 2024-08-18T23:58:00.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f43f37fe640 1 -- 172.21.15.103:0/1548963701 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f40317e0 con 0x7f43e40051c0 2024-08-18T23:58:00.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f4402d1a640 1 -- 172.21.15.103:0/1548963701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 msgr2=0x7f43e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f4402d1a640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43e400b9c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f43fc072a10 tx=0x7f43e4005830 comp rx=0 tx=0).stop 2024-08-18T23:58:00.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f4402d1a640 1 -- 172.21.15.103:0/1548963701 shutdown_connections 2024-08-18T23:58:00.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f4402d1a640 1 --2- 172.21.15.103:0/1548963701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43e400b9c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f4402d1a640 1 -- 172.21.15.103:0/1548963701 >> 172.21.15.103:0/1548963701 conn(0x7f43fc0d1ec0 msgr2=0x7f43fc0d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:00.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f4402d1a640 1 -- 172.21.15.103:0/1548963701 shutdown_connections 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.967+0000 7f4402d1a640 1 -- 172.21.15.103:0/1548963701 wait complete. 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.968+0000 7f4402d1a640 1 Processor -- start 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.968+0000 7f4402d1a640 1 -- start start 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4402d1a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43fc0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4402d1a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43fc155d20 0x7f43fc0c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4402d1a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43fc0cb680 0x7f43fc0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4402d1a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc070540 con 0x7f43e40051c0 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4402d1a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc0703c0 con 0x7f43fc155d20 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4402d1a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43fc0706c0 con 0x7f43fc0cb680 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4400ab6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43fc0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4400ab6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43fc0c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48314/0 (socket says 172.21.15.103:48314) 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.969+0000 7f4400ab6640 1 -- 172.21.15.103:0/3927498881 learned_addr learned my addr 172.21.15.103:0/3927498881 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:00.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f44012b7640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43fc0cb680 0x7f43fc0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f43f3fff640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43fc155d20 0x7f43fc0c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f4400ab6640 1 -- 172.21.15.103:0/3927498881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43fc0cb680 msgr2=0x7f43fc0cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f4400ab6640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43fc0cb680 0x7f43fc0cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f4400ab6640 1 -- 172.21.15.103:0/3927498881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43fc155d20 msgr2=0x7f43fc0c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f4400ab6640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43fc155d20 0x7f43fc0c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f4400ab6640 1 -- 172.21.15.103:0/3927498881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc0ca140 con 0x7f43e40051c0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f4400ab6640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43fc0c9c00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43f800f620 tx=0x7f43f800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f43f17fa640 1 -- 172.21.15.103:0/3927498881 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f80052e0 con 0x7f43e40051c0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f43f17fa640 1 -- 172.21.15.103:0/3927498881 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f8018070 con 0x7f43e40051c0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc0b4810 con 0x7f43e40051c0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f43f17fa640 1 -- 172.21.15.103:0/3927498881 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f8003810 con 0x7f43e40051c0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.970+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc0b4530 con 0x7f43e40051c0 2024-08-18T23:58:00.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.971+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc0cd870 con 0x7f43e40051c0 2024-08-18T23:58:00.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.972+0000 7f43f17fa640 1 -- 172.21.15.103:0/3927498881 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f43f80039b0 con 0x7f43e40051c0 2024-08-18T23:58:00.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.972+0000 7f43f17fa640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f43e806be60 0x7f43e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:00.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.972+0000 7f43f17fa640 1 -- 172.21.15.103:0/3927498881 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f43f808ac60 con 0x7f43e40051c0 2024-08-18T23:58:00.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.972+0000 7f43f3fff640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f43e806be60 0x7f43e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:00.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.973+0000 7f43f3fff640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f43e806be60 0x7f43e806e320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0b7850 tx=0x7f43ec0011c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:00.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:00.976+0000 7f43f17fa640 1 -- 172.21.15.103:0/3927498881 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f43fc0ca140 con 0x7f43e40051c0 2024-08-18T23:58:01.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.155+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f43fc0aff50 con 0x7f43e40051c0 2024-08-18T23:58:01.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.155+0000 7f43f17fa640 1 -- 172.21.15.103:0/3927498881 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) ==== 80+0+0 (secure 0 0 0) 0x7f43f8058e40 con 0x7f43e40051c0 2024-08-18T23:58:01.156 INFO:teuthology.orchestra.run.smithi103.stderr:listed 0 entries 2024-08-18T23:58:01.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f43e806be60 msgr2=0x7f43e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f43e806be60 0x7f43e806e320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f43fc0b7850 tx=0x7f43ec0011c0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 msgr2=0x7f43fc0c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43fc0c9c00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f43f800f620 tx=0x7f43f800fae0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 shutdown_connections 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f43e806be60 0x7f43e806e320 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43fc0cb680 0x7f43fc0cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43fc155d20 0x7f43fc0c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 --2- 172.21.15.103:0/3927498881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43e40051c0 0x7f43fc0c9c00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 >> 172.21.15.103:0/3927498881 conn(0x7f43fc0d1ec0 msgr2=0x7f43fc0c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 shutdown_connections 2024-08-18T23:58:01.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.157+0000 7f4402d1a640 1 -- 172.21.15.103:0/3927498881 wait complete. 2024-08-18T23:58:01.169 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-08-18T23:58:01.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:01.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-18T23:58:01.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi103.stderr:ceph-fuse[37962]: fuse finished with error 0 and tester_r 0 2024-08-18T23:58:01.195 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:58:01.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:01.195 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-18T23:58:01.343 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T23:58:01.343 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:58:01.343 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:58:01.361 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055813,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497488k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=896 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497488k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T23:58:01.361 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:58:01.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:01.361 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-18T23:58:01.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:01.417 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-08-18T23:58:01.418 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T23:58:01.418 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:58:01.418 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:58:01.434 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055810,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20818 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T23:58:01.434 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:58:01.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:01.434 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-18T23:58:01.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:01.490 INFO:teuthology.orchestra.run.smithi103.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-08-18T23:58:01.490 INFO:tasks.cephfs.mount:Terminating background process 2024-08-18T23:58:01.490 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:58:01.490 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:58:01.507 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055813,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497488k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=896 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497488k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T23:58:01.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:58:01.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:01.507 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-18T23:58:01.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:01.563 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-08-18T23:58:01.564 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:58:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.661+0000 7f12ea725640 1 Processor -- start 2024-08-18T23:58:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.661+0000 7f12ea725640 1 -- start start 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.661+0000 7f12ea725640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 0x7f12e40ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.661+0000 7f12ea725640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e4072610 con 0x7f12e415ade0 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.661+0000 7f12ea725640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12e40728f0 con 0x7f12e40b4370 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.661+0000 7f12ea725640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f12e406db10 con 0x7f12e406f770 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e3fff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f12e415ade0 0x7f12e406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59192/0 (socket says 172.21.15.103:59192) 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e3fff640 1 -- 172.21.15.103:0/3186748688 learned_addr learned my addr 172.21.15.103:0/3186748688 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 0x7f12e40ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382014077 0 0) 0x7f12e4072610 con 0x7f12e415ade0 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12cc003520 con 0x7f12e415ade0 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1409334660 0 0) 0x7f12cc003520 con 0x7f12e415ade0 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 msgr2=0x7f12e40ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:01.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 0x7f12e40ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 >> v1:172.21.15.190:6789/0 conn(0x7f12e40b4370 legacy=0x7f12e40adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e4072bd0 con 0x7f12e415ade0 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f12d4001670 con 0x7f12e415ade0 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 >> v1:172.21.15.103:6789/0 conn(0x7f12e415ade0 legacy=0x7f12e406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12cc0039e0 0x7f12cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 0x7f12cc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12e406db10 con 0x7f12cc004800 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f12cc00baf0 con 0x7f12cc0039e0 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f12cc00df00 con 0x7f12e406f770 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e3fff640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12cc0039e0 0x7f12cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.662+0000 7f12e8cc2640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 0x7f12cc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.663+0000 7f12e37fe640 1 -- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 msgr2=0x7f12cc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.663+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 0x7f12cc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.663+0000 7f12e37fe640 1 -- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12cc0039e0 msgr2=0x7f12cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.663+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12cc0039e0 0x7f12cc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.663+0000 7f12e37fe640 1 -- 172.21.15.103:0/3186748688 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12cc003520 con 0x7f12cc004800 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.663+0000 7f12e8cc2640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e406f770 0x7f12cc005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.663+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12cc004c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009ac0 tx=0x7f12cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2da9ba590e2f00 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.663+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8036070 con 0x7f12cc004800 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d8031400 con 0x7f12cc004800 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12e2ffd640 1 -- 172.21.15.103:0/3186748688 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d8009690 con 0x7f12cc004800 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12ea725640 1 -- 172.21.15.103:0/3186748688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 msgr2=0x7f12cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12ea725640 1 --2- 172.21.15.103:0/3186748688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12cc004c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f12d8009ac0 tx=0x7f12cc005830 comp rx=0 tx=0).stop 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12e8cc2640 1 -- 172.21.15.103:0/3186748688 reap_dead start 2024-08-18T23:58:01.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12ea725640 1 -- 172.21.15.103:0/3186748688 shutdown_connections 2024-08-18T23:58:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12ea725640 1 -- 172.21.15.103:0/3186748688 >> 172.21.15.103:0/3186748688 conn(0x7f12e40cfc40 msgr2=0x7f12e40d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12ea725640 1 -- 172.21.15.103:0/3186748688 shutdown_connections 2024-08-18T23:58:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.664+0000 7f12ea725640 1 -- 172.21.15.103:0/3186748688 wait complete. 2024-08-18T23:58:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.665+0000 7f12ea725640 1 Processor -- start 2024-08-18T23:58:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.665+0000 7f12ea725640 1 -- start start 2024-08-18T23:58:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12ea725640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12e414f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12ea725640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e409d690 0x7f12e409db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12ea725640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e4152a10 0x7f12e4152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12ea725640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12e406d6c0 con 0x7f12cc004800 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12ea725640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f12e415b1c0 con 0x7f12e409d690 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12ea725640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f12e406d840 con 0x7f12e4152a10 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12e3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12e414f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12e3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12e414f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48342/0 (socket says 172.21.15.103:48342) 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.666+0000 7f12e3fff640 1 -- 172.21.15.103:0/3585578026 learned_addr learned my addr 172.21.15.103:0/3585578026 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e8cc2640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e4152a10 0x7f12e4152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e3fff640 1 -- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e4152a10 msgr2=0x7f12e4152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e409d690 0x7f12e409db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e3fff640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e4152a10 0x7f12e4152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e3fff640 1 -- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e409d690 msgr2=0x7f12e409db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e3fff640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e409d690 0x7f12e409db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e3fff640 1 -- 172.21.15.103:0/3585578026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e40cd8c0 con 0x7f12cc004800 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e409d690 0x7f12e409db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e3fff640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12e414f620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f12d40072c0 tx=0x7f12d4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e0ff9640 1 -- 172.21.15.103:0/3585578026 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d400f9c0 con 0x7f12cc004800 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e0ff9640 1 -- 172.21.15.103:0/3585578026 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d4018070 con 0x7f12cc004800 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e4150bd0 con 0x7f12cc004800 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12e0ff9640 1 -- 172.21.15.103:0/3585578026 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d400fdc0 con 0x7f12cc004800 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.667+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12e4151190 con 0x7f12cc004800 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.668+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e40b47b0 con 0x7f12cc004800 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.668+0000 7f12e0ff9640 1 -- 172.21.15.103:0/3585578026 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12d401d460 con 0x7f12cc004800 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.669+0000 7f12e0ff9640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f12d006be60 0x7f12d006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.669+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f12d006be60 0x7f12d006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.669+0000 7f12e0ff9640 1 -- 172.21.15.103:0/3585578026 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f12d408afd0 con 0x7f12cc004800 2024-08-18T23:58:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.669+0000 7f12e37fe640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f12d006be60 0x7f12d006e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12d8033000 tx=0x7f12d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.673+0000 7f12e0ff9640 1 -- 172.21.15.103:0/3585578026 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f12d4059880 con 0x7f12cc004800 2024-08-18T23:58:01.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.874+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12e40b0010 con 0x7f12cc004800 2024-08-18T23:58:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.874+0000 7f12e0ff9640 1 -- 172.21.15.103:0/3585578026 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7f12d4059180 con 0x7f12cc004800 2024-08-18T23:58:01.876 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:01.876 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:57:47.319563+0000","modified":"2024-08-18T23:57:49.334110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/171106802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":171106802},{"type":"v1","addr":"172.21.15.103:6835","nonce":171106802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-08-18T23:58:01.876 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f12d006be60 msgr2=0x7f12d006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f12d006be60 0x7f12d006e320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f12d8033000 tx=0x7f12d8008030 comp rx=0 tx=0).stop 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 msgr2=0x7f12e414f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12e414f620 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f12d40072c0 tx=0x7f12d4007780 comp rx=0 tx=0).stop 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 shutdown_connections 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f12d006be60 0x7f12d006e320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f12e4152a10 0x7f12e4152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f12e409d690 0x7f12e409db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 --2- 172.21.15.103:0/3585578026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12cc004800 0x7f12e414f620 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 >> 172.21.15.103:0/3585578026 conn(0x7f12e40cfc40 msgr2=0x7f12e40b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 shutdown_connections 2024-08-18T23:58:01.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.876+0000 7f12ea725640 1 -- 172.21.15.103:0/3585578026 wait complete. 2024-08-18T23:58:01.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:58:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.986+0000 7f561b230640 1 Processor -- start 2024-08-18T23:58:01.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.987+0000 7f561b230640 1 -- start start 2024-08-18T23:58:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.987+0000 7f561b230640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56140d1d10 0x7f56140d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.987+0000 7f561b230640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56140cfd40 0x7f56140d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.987+0000 7f561b230640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f561415e730 con 0x7f561415e350 2024-08-18T23:58:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.987+0000 7f561b230640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f56140d4ed0 con 0x7f56140d1d10 2024-08-18T23:58:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.987+0000 7f561b230640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f56140cef80 con 0x7f56140cfd40 2024-08-18T23:58:01.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.987+0000 7f5613fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56140d1d10 0x7f56140d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.988+0000 7f5613fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f56140d1d10 0x7f56140d2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48346/0 (socket says 172.21.15.103:48346) 2024-08-18T23:58:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.988+0000 7f5613fff640 1 -- 172.21.15.103:0/1591220545 learned_addr learned my addr 172.21.15.103:0/1591220545 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.988+0000 7f56197cd640 1 --2- 172.21.15.103:0/1591220545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56140cfd40 0x7f56140d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.988+0000 7f5613fff640 1 -- 172.21.15.103:0/1591220545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56140cfd40 msgr2=0x7f56140d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.988+0000 7f5613fff640 1 --2- 172.21.15.103:0/1591220545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56140cfd40 0x7f56140d2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.988+0000 7f5613fff640 1 -- 172.21.15.103:0/1591220545 >> v1:172.21.15.190:6789/0 conn(0x7f561415e350 legacy=0x7f56140d47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:01.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.988+0000 7f5613fff640 1 -- 172.21.15.103:0/1591220545 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56140cf260 con 0x7f56140d1d10 2024-08-18T23:58:01.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.988+0000 7f5613fff640 1 --2- 172.21.15.103:0/1591220545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f56140d2670 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5608009870 tx=0x7f560802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f1b728769ab95e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:01.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f56137fe640 1 -- 172.21.15.103:0/1591220545 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608037070 con 0x7f56140d1d10 2024-08-18T23:58:01.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f56137fe640 1 -- 172.21.15.103:0/1591220545 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5608032440 con 0x7f56140d1d10 2024-08-18T23:58:01.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f56137fe640 1 -- 172.21.15.103:0/1591220545 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608032810 con 0x7f56140d1d10 2024-08-18T23:58:01.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f561b230640 1 -- 172.21.15.103:0/1591220545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 msgr2=0x7f56140d2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f561b230640 1 --2- 172.21.15.103:0/1591220545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f56140d2670 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5608009870 tx=0x7f560802a210 comp rx=0 tx=0).stop 2024-08-18T23:58:01.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f561b230640 1 -- 172.21.15.103:0/1591220545 shutdown_connections 2024-08-18T23:58:01.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f561b230640 1 --2- 172.21.15.103:0/1591220545 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f56140cfd40 0x7f56140d2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f561b230640 1 --2- 172.21.15.103:0/1591220545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f56140d2670 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f561b230640 1 -- 172.21.15.103:0/1591220545 >> 172.21.15.103:0/1591220545 conn(0x7f561409d3f0 msgr2=0x7f56140d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:01.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f561b230640 1 -- 172.21.15.103:0/1591220545 shutdown_connections 2024-08-18T23:58:01.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.989+0000 7f561b230640 1 -- 172.21.15.103:0/1591220545 wait complete. 2024-08-18T23:58:01.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.990+0000 7f561b230640 1 Processor -- start 2024-08-18T23:58:01.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.990+0000 7f561b230640 1 -- start start 2024-08-18T23:58:01.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f561b230640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56140cfd40 0x7f561415b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f561b230640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f5614162050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f561b230640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f561415e350 0x7f56140b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f561b230640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f56140cec30 con 0x7f56140d1d10 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f561b230640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f56140cf820 con 0x7f56140cfd40 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f561b230640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f56140b6ee0 con 0x7f561415e350 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f5613fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f5614162050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f5613fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f5614162050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48348/0 (socket says 172.21.15.103:48348) 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f5613fff640 1 -- 172.21.15.103:0/3270227054 learned_addr learned my addr 172.21.15.103:0/3270227054 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f5618fcc640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56140cfd40 0x7f561415b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.991+0000 7f56197cd640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f561415e350 0x7f56140b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f5613fff640 1 -- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f561415e350 msgr2=0x7f56140b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f5613fff640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f561415e350 0x7f56140b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f5613fff640 1 -- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56140cfd40 msgr2=0x7f561415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f5613fff640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56140cfd40 0x7f561415b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f5613fff640 1 -- 172.21.15.103:0/3270227054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56140b4bf0 con 0x7f56140d1d10 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f56197cd640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f561415e350 0x7f56140b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f5613fff640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f5614162050 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5608009870 tx=0x7f56080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f56117fa640 1 -- 172.21.15.103:0/3270227054 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608041020 con 0x7f56140d1d10 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f56117fa640 1 -- 172.21.15.103:0/3270227054 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5608030970 con 0x7f56140d1d10 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56141f7fc0 con 0x7f56140d1d10 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f56117fa640 1 -- 172.21.15.103:0/3270227054 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5608037040 con 0x7f56140d1d10 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.992+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56141f8580 con 0x7f56140d1d10 2024-08-18T23:58:01.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.993+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56140d47c0 con 0x7f56140d1d10 2024-08-18T23:58:01.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.994+0000 7f56117fa640 1 -- 172.21.15.103:0/3270227054 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5608044020 con 0x7f56140d1d10 2024-08-18T23:58:01.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.994+0000 7f56117fa640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f560006be60 0x7f560006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:01.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.994+0000 7f56117fa640 1 -- 172.21.15.103:0/3270227054 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f56080ab870 con 0x7f56140d1d10 2024-08-18T23:58:01.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.994+0000 7f5618fcc640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f560006be60 0x7f560006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:01.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.995+0000 7f5618fcc640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f560006be60 0x7f560006e320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f561415d670 tx=0x7f5604009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:01.999+0000 7f56117fa640 1 -- 172.21.15.103:0/3270227054 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f560804b030 con 0x7f56140d1d10 2024-08-18T23:58:02.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.199+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56140d4a60 con 0x7f56140d1d10 2024-08-18T23:58:02.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.200+0000 7f56117fa640 1 -- 172.21.15.103:0/3270227054 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7f560807a120 con 0x7f56140d1d10 2024-08-18T23:58:02.201 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:02.202 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:57:47.319563+0000","modified":"2024-08-18T23:57:49.334110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/171106802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":171106802},{"type":"v1","addr":"172.21.15.103:6835","nonce":171106802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-08-18T23:58:02.202 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-08-18T23:58:02.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f560006be60 msgr2=0x7f560006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f560006be60 0x7f560006e320 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f561415d670 tx=0x7f5604009060 comp rx=0 tx=0).stop 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 msgr2=0x7f5614162050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f5614162050 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5608009870 tx=0x7f56080046c0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 shutdown_connections 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f560006be60 0x7f560006e320 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f561415e350 0x7f56140b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56140d1d10 0x7f5614162050 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 --2- 172.21.15.103:0/3270227054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f56140cfd40 0x7f561415b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 >> 172.21.15.103:0/3270227054 conn(0x7f561409d3f0 msgr2=0x7f56140b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 shutdown_connections 2024-08-18T23:58:02.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.202+0000 7f561b230640 1 -- 172.21.15.103:0/3270227054 wait complete. 2024-08-18T23:58:02.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:58:02.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.313+0000 7f58b7f8f640 1 Processor -- start 2024-08-18T23:58:02.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.313+0000 7f58b7f8f640 1 -- start start 2024-08-18T23:58:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b7f8f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f58b00d4bc0 0x7f58b00d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b7f8f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b0160090 0x7f58b0160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b7f8f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b00d0860 con 0x7f58b015f8a0 2024-08-18T23:58:02.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b7f8f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f58b00cfc00 con 0x7f58b00d4bc0 2024-08-18T23:58:02.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b7f8f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f58b00b32c0 con 0x7f58b0160090 2024-08-18T23:58:02.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b5d2b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f58b015f8a0 0x7f58b00d0ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:59200/0 (socket says 172.21.15.103:59200) 2024-08-18T23:58:02.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b5d2b640 1 -- 172.21.15.103:0/4248605166 learned_addr learned my addr 172.21.15.103:0/4248605166 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b652c640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b0160090 0x7f58b0160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b552a640 1 --2- 172.21.15.103:0/4248605166 >> v2:172.21.15.190:3300/0 conn(0x7f58b00d4bc0 0x7f58b00d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2454890316 0 0) 0x7f58b00d0860 con 0x7f58b015f8a0 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f589c003520 con 0x7f58b015f8a0 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1842379920 0 0) 0x7f589c003520 con 0x7f58b015f8a0 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b0160090 msgr2=0x7f58b0160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b0160090 0x7f58b0160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 >> v2:172.21.15.190:3300/0 conn(0x7f58b00d4bc0 msgr2=0x7f58b00d11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 --2- 172.21.15.103:0/4248605166 >> v2:172.21.15.190:3300/0 conn(0x7f58b00d4bc0 0x7f58b00d11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b00d0090 con 0x7f58b015f8a0 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f58ac001670 con 0x7f58b015f8a0 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 >> v1:172.21.15.103:6789/0 conn(0x7f58b015f8a0 legacy=0x7f58b00d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c0039b0 0x7f589c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b0160090 0x7f589c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.314+0000 7f58b4d29640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f589c004d40 0x7f589c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00cfc00 con 0x7f589c004d40 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00b32c0 con 0x7f589c0039b0 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f589c00b9c0 con 0x7f58b0160090 2024-08-18T23:58:02.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b652c640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f589c004d40 0x7f589c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b552a640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b0160090 0x7f589c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b5d2b640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c0039b0 0x7f589c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b652c640 1 -- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b0160090 msgr2=0x7f589c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b652c640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b0160090 0x7f589c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b652c640 1 -- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c0039b0 msgr2=0x7f589c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b652c640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c0039b0 0x7f589c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.315+0000 7f58b652c640 1 -- 172.21.15.103:0/4248605166 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589c003520 con 0x7f589c004d40 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b652c640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f589c004d40 0x7f589c0051c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f58a800e170 tx=0x7f589c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367a739ce88f7d90 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8034020 con 0x7f589c004d40 2024-08-18T23:58:02.327 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a80305f0 con 0x7f589c004d40 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b4d29640 1 -- 172.21.15.103:0/4248605166 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8009c10 con 0x7f589c004d40 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b7f8f640 1 -- 172.21.15.103:0/4248605166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f589c004d40 msgr2=0x7f589c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b7f8f640 1 --2- 172.21.15.103:0/4248605166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f589c004d40 0x7f589c0051c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f58a800e170 tx=0x7f589c005830 comp rx=0 tx=0).stop 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b652c640 1 -- 172.21.15.103:0/4248605166 reap_dead start 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b7f8f640 1 -- 172.21.15.103:0/4248605166 shutdown_connections 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b7f8f640 1 -- 172.21.15.103:0/4248605166 >> 172.21.15.103:0/4248605166 conn(0x7f58b00d40a0 msgr2=0x7f58b00d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b7f8f640 1 -- 172.21.15.103:0/4248605166 shutdown_connections 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.316+0000 7f58b7f8f640 1 -- 172.21.15.103:0/4248605166 wait complete. 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b7f8f640 1 Processor -- start 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b7f8f640 1 -- start start 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b7f8f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c004d40 0x7f58b00cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b7f8f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b01566f0 0x7f58b00b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b7f8f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58b00b56e0 0x7f58b01f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b7f8f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00b2fb0 con 0x7f58b00b56e0 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b7f8f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f58b00cf890 con 0x7f589c004d40 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b7f8f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f58b015fc80 con 0x7f58b01566f0 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.318+0000 7f58b652c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58b00b56e0 0x7f58b01f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b652c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58b00b56e0 0x7f58b01f7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48358/0 (socket says 172.21.15.103:48358) 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b652c640 1 -- 172.21.15.103:0/2770404345 learned_addr learned my addr 172.21.15.103:0/2770404345 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b5d2b640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c004d40 0x7f58b00cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b552a640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b01566f0 0x7f58b00b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b652c640 1 -- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b01566f0 msgr2=0x7f58b00b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b652c640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b01566f0 0x7f58b00b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b652c640 1 -- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c004d40 msgr2=0x7f58b00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b652c640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c004d40 0x7f58b00cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b652c640 1 -- 172.21.15.103:0/2770404345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b01f80a0 con 0x7f58b00b56e0 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b5d2b640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c004d40 0x7f58b00cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b652c640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58b00b56e0 0x7f58b01f7350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f58a800e170 tx=0x7f58a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58a67fc640 1 -- 172.21.15.103:0/2770404345 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8034070 con 0x7f58b00b56e0 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58a67fc640 1 -- 172.21.15.103:0/2770404345 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a8003990 con 0x7f58b00b56e0 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b00b6ed0 con 0x7f58b00b56e0 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58a67fc640 1 -- 172.21.15.103:0/2770404345 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8009c10 con 0x7f58b00b56e0 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.319+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b00b7490 con 0x7f58b00b56e0 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.320+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b0160520 con 0x7f58b00b56e0 2024-08-18T23:58:02.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.321+0000 7f58a67fc640 1 -- 172.21.15.103:0/2770404345 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58a8037020 con 0x7f58b00b56e0 2024-08-18T23:58:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.321+0000 7f58a67fc640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f589406be60 0x7f589406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.321+0000 7f58a67fc640 1 -- 172.21.15.103:0/2770404345 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f58a80ab100 con 0x7f58b00b56e0 2024-08-18T23:58:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.321+0000 7f58b5d2b640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f589406be60 0x7f589406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.322+0000 7f58b5d2b640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f589406be60 0x7f589406e320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58ac007fd0 tx=0x7f58ac007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.325+0000 7f58a67fc640 1 -- 172.21.15.103:0/2770404345 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f58a8079930 con 0x7f58b00b56e0 2024-08-18T23:58:02.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.492+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f58b01617e0 con 0x7f58b00b56e0 2024-08-18T23:58:02.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.493+0000 7f58a67fc640 1 -- 172.21.15.103:0/2770404345 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16978 (secure 0 0 0) 0x7f58a8079230 con 0x7f58b00b56e0 2024-08-18T23:58:02.495 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:02.495 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":38,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:57:48.998109+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:57:45.173057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T23:57:46.287913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f589406be60 msgr2=0x7f589406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f589406be60 0x7f589406e320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f58ac007fd0 tx=0x7f58ac007970 comp rx=0 tx=0).stop 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58b00b56e0 msgr2=0x7f58b01f7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58b00b56e0 0x7f58b01f7350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f58a800e170 tx=0x7f58a8009750 comp rx=0 tx=0).stop 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 shutdown_connections 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f589406be60 0x7f589406e320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58b00b56e0 0x7f58b01f7350 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b01566f0 0x7f58b00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 --2- 172.21.15.103:0/2770404345 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f589c004d40 0x7f58b00cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 >> 172.21.15.103:0/2770404345 conn(0x7f58b00d40a0 msgr2=0x7f58b015e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:02.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 shutdown_connections 2024-08-18T23:58:02.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.495+0000 7f58b7f8f640 1 -- 172.21.15.103:0/2770404345 wait complete. 2024-08-18T23:58:02.508 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T23:58:02.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:58:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.605+0000 7fc67eeb7640 1 Processor -- start 2024-08-18T23:58:02.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.605+0000 7fc67eeb7640 1 -- start start 2024-08-18T23:58:02.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.606+0000 7fc67eeb7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.606+0000 7fc67eeb7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc6780724a0 0x7fc67815b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.606+0000 7fc67eeb7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6780b3190 con 0x7fc6780b2cb0 2024-08-18T23:58:02.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.606+0000 7fc67eeb7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc6780b46c0 con 0x7fc6780724a0 2024-08-18T23:58:02.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.606+0000 7fc67eeb7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc67815b990 con 0x7fc6780cecc0 2024-08-18T23:58:02.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.606+0000 7fc67cc53640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.606+0000 7fc67d454640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc6780724a0 0x7fc67815b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.607+0000 7fc67cc53640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:58770/0 (socket says 172.21.15.103:58770) 2024-08-18T23:58:02.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.607+0000 7fc67cc53640 1 -- 172.21.15.103:0/3766035379 learned_addr learned my addr 172.21.15.103:0/3766035379 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:02.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.607+0000 7fc67cc53640 1 -- 172.21.15.103:0/3766035379 >> v2:172.21.15.190:3300/0 conn(0x7fc6780724a0 msgr2=0x7fc67815b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:02.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.607+0000 7fc67cc53640 1 --2- 172.21.15.103:0/3766035379 >> v2:172.21.15.190:3300/0 conn(0x7fc6780724a0 0x7fc67815b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.607+0000 7fc67cc53640 1 -- 172.21.15.103:0/3766035379 >> v1:172.21.15.190:6789/0 conn(0x7fc6780b2cb0 legacy=0x7fc678071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.607+0000 7fc67cc53640 1 -- 172.21.15.103:0/3766035379 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6780b3470 con 0x7fc6780cecc0 2024-08-18T23:58:02.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc67cc53640 1 --2- 172.21.15.103:0/3766035379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780cf0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc66800aa10 tx=0x7fc66802b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e85344c14444633b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc6777fe640 1 -- 172.21.15.103:0/3766035379 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66800b040 con 0x7fc6780cecc0 2024-08-18T23:58:02.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc6777fe640 1 -- 172.21.15.103:0/3766035379 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc668030710 con 0x7fc6780cecc0 2024-08-18T23:58:02.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc6777fe640 1 -- 172.21.15.103:0/3766035379 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668030ae0 con 0x7fc6780cecc0 2024-08-18T23:58:02.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc67eeb7640 1 -- 172.21.15.103:0/3766035379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 msgr2=0x7fc6780cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/3766035379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780cf0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc66800aa10 tx=0x7fc66802b610 comp rx=0 tx=0).stop 2024-08-18T23:58:02.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc67eeb7640 1 -- 172.21.15.103:0/3766035379 shutdown_connections 2024-08-18T23:58:02.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/3766035379 >> v2:172.21.15.190:3300/0 conn(0x7fc6780724a0 0x7fc67815b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/3766035379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780cf0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc67eeb7640 1 -- 172.21.15.103:0/3766035379 >> 172.21.15.103:0/3766035379 conn(0x7fc6780cfc40 msgr2=0x7fc6780d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:02.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.608+0000 7fc67eeb7640 1 -- 172.21.15.103:0/3766035379 shutdown_connections 2024-08-18T23:58:02.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.609+0000 7fc67eeb7640 1 -- 172.21.15.103:0/3766035379 wait complete. 2024-08-18T23:58:02.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.610+0000 7fc67eeb7640 1 Processor -- start 2024-08-18T23:58:02.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.610+0000 7fc67eeb7640 1 -- start start 2024-08-18T23:58:02.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67eeb7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6780724a0 0x7fc67814c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67eeb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6780b2cb0 0x7fc67806ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67eeb7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67eeb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc67806d6c0 con 0x7fc6780b2cb0 2024-08-18T23:58:02.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67eeb7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc6780b3a30 con 0x7fc6780724a0 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67eeb7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc67806d840 con 0x7fc6780cecc0 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6780b2cb0 0x7fc67806ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6780b2cb0 0x7fc67806ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48370/0 (socket says 172.21.15.103:48370) 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 -- 172.21.15.103:0/875272172 learned_addr learned my addr 172.21.15.103:0/875272172 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67cc53640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6780724a0 0x7fc67814c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67d454640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 -- 172.21.15.103:0/875272172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 msgr2=0x7fc6780aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780aec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 -- 172.21.15.103:0/875272172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6780724a0 msgr2=0x7fc67814c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6780724a0 0x7fc67814c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 -- 172.21.15.103:0/875272172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6781efe60 con 0x7fc6780b2cb0 2024-08-18T23:58:02.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc677fff640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6780b2cb0 0x7fc67806ebd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00c440 tx=0x7fc66c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc6757fa640 1 -- 172.21.15.103:0/875272172 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0052d0 con 0x7fc6780b2cb0 2024-08-18T23:58:02.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc6757fa640 1 -- 172.21.15.103:0/875272172 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc66c005470 con 0x7fc6780b2cb0 2024-08-18T23:58:02.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6781f0140 con 0x7fc6780b2cb0 2024-08-18T23:58:02.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc6757fa640 1 -- 172.21.15.103:0/875272172 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66c007260 con 0x7fc6780b2cb0 2024-08-18T23:58:02.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.611+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc67814cb10 con 0x7fc6780b2cb0 2024-08-18T23:58:02.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.613+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67806dc20 con 0x7fc6780b2cb0 2024-08-18T23:58:02.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.613+0000 7fc6757fa640 1 -- 172.21.15.103:0/875272172 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc66c007400 con 0x7fc6780b2cb0 2024-08-18T23:58:02.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.613+0000 7fc6757fa640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc66406be30 0x7fc66406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.613+0000 7fc6757fa640 1 -- 172.21.15.103:0/875272172 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fc66c08a3d0 con 0x7fc6780b2cb0 2024-08-18T23:58:02.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.613+0000 7fc67cc53640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc66406be30 0x7fc66406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.614+0000 7fc67cc53640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc66406be30 0x7fc66406e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc668035000 tx=0x7fc66800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.618+0000 7fc6757fa640 1 -- 172.21.15.103:0/875272172 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fc66c058630 con 0x7fc6780b2cb0 2024-08-18T23:58:02.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.818+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6781f04d0 con 0x7fc6780b2cb0 2024-08-18T23:58:02.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.819+0000 7fc6757fa640 1 -- 172.21.15.103:0/875272172 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7fc66c05c930 con 0x7fc6780b2cb0 2024-08-18T23:58:02.821 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:02.822 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:57:47.319563+0000","modified":"2024-08-18T23:57:49.334110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/171106802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":171106802},{"type":"v1","addr":"172.21.15.103:6835","nonce":171106802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-08-18T23:58:02.823 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc66406be30 msgr2=0x7fc66406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc66406be30 0x7fc66406e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc668035000 tx=0x7fc66800c040 comp rx=0 tx=0).stop 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6780b2cb0 msgr2=0x7fc67806ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6780b2cb0 0x7fc67806ebd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc66c00c440 tx=0x7fc66c001e70 comp rx=0 tx=0).stop 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 shutdown_connections 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc66406be30 0x7fc66406e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc6780cecc0 0x7fc6780aec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6780b2cb0 0x7fc67806ebd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 --2- 172.21.15.103:0/875272172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc6780724a0 0x7fc67814c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 >> 172.21.15.103:0/875272172 conn(0x7fc6780cfc40 msgr2=0x7fc6780718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 shutdown_connections 2024-08-18T23:58:02.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.821+0000 7fc67eeb7640 1 -- 172.21.15.103:0/875272172 wait complete. 2024-08-18T23:58:02.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:58:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.930+0000 7f239fd0c640 1 Processor -- start 2024-08-18T23:58:02.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.931+0000 7f239fd0c640 1 -- start start 2024-08-18T23:58:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.931+0000 7f239fd0c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f239815c000 0x7f23980cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.931+0000 7f239fd0c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f23980d29a0 0x7f239806f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.931+0000 7f239fd0c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f23980cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.931+0000 7f239fd0c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f23980cfa50 con 0x7f239815c000 2024-08-18T23:58:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.931+0000 7f239fd0c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f23980cfca0 con 0x7f23980d29a0 2024-08-18T23:58:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.931+0000 7f239fd0c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f23980cff80 con 0x7f239806fcc0 2024-08-18T23:58:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239daa8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f239815c000 0x7f23980cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239daa8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f239815c000 0x7f23980cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48386/0 (socket says 172.21.15.103:48386) 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239daa8640 1 -- 172.21.15.103:0/965913365 learned_addr learned my addr 172.21.15.103:0/965913365 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239e2a9640 1 --2- 172.21.15.103:0/965913365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f23980cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239d2a7640 1 --2- 172.21.15.103:0/965913365 >> v2:172.21.15.190:3300/0 conn(0x7f23980d29a0 0x7f239806f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239daa8640 1 -- 172.21.15.103:0/965913365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 msgr2=0x7f23980cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239daa8640 1 --2- 172.21.15.103:0/965913365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f23980cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239daa8640 1 -- 172.21.15.103:0/965913365 >> v2:172.21.15.190:3300/0 conn(0x7f23980d29a0 msgr2=0x7f239806f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239daa8640 1 --2- 172.21.15.103:0/965913365 >> v2:172.21.15.190:3300/0 conn(0x7f23980d29a0 0x7f239806f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239daa8640 1 -- 172.21.15.103:0/965913365 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23980ccce0 con 0x7f239815c000 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239d2a7640 1 --2- 172.21.15.103:0/965913365 >> v2:172.21.15.190:3300/0 conn(0x7f23980d29a0 0x7f239806f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:02.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.932+0000 7f239e2a9640 1 --2- 172.21.15.103:0/965913365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f23980cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239daa8640 1 --2- 172.21.15.103:0/965913365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f239815c000 0x7f23980cef40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f239806c8c0 tx=0x7f238c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aadbdc1be538d82 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239caa6640 1 -- 172.21.15.103:0/965913365 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c037070 con 0x7f239815c000 2024-08-18T23:58:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239caa6640 1 -- 172.21.15.103:0/965913365 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f238c032440 con 0x7f239815c000 2024-08-18T23:58:02.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239caa6640 1 -- 172.21.15.103:0/965913365 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238c032810 con 0x7f239815c000 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 -- 172.21.15.103:0/965913365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f239815c000 msgr2=0x7f23980cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 --2- 172.21.15.103:0/965913365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f239815c000 0x7f23980cef40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f239806c8c0 tx=0x7f238c02a1e0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 -- 172.21.15.103:0/965913365 shutdown_connections 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 --2- 172.21.15.103:0/965913365 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f23980cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 --2- 172.21.15.103:0/965913365 >> v2:172.21.15.190:3300/0 conn(0x7f23980d29a0 0x7f239806f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 --2- 172.21.15.103:0/965913365 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f239815c000 0x7f23980cef40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 -- 172.21.15.103:0/965913365 >> 172.21.15.103:0/965913365 conn(0x7f23980d1e80 msgr2=0x7f23980d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 -- 172.21.15.103:0/965913365 shutdown_connections 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.933+0000 7f239fd0c640 1 -- 172.21.15.103:0/965913365 wait complete. 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.934+0000 7f239fd0c640 1 Processor -- start 2024-08-18T23:58:02.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239fd0c640 1 -- start start 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239fd0c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f239814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239fd0c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23980d29a0 0x7f23980cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239fd0c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f239815c000 0x7f23980b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239fd0c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f23980cc990 con 0x7f23980d29a0 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239fd0c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f239815c3e0 con 0x7f239815c000 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239fd0c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f23980cda20 con 0x7f239806fcc0 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239d2a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23980d29a0 0x7f23980cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239d2a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23980d29a0 0x7f23980cb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48388/0 (socket says 172.21.15.103:48388) 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239d2a7640 1 -- 172.21.15.103:0/2115288126 learned_addr learned my addr 172.21.15.103:0/2115288126 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.935+0000 7f239daa8640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f239814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239e2a9640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f239815c000 0x7f23980b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239d2a7640 1 -- 172.21.15.103:0/2115288126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 msgr2=0x7f239814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239d2a7640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f239814e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239d2a7640 1 -- 172.21.15.103:0/2115288126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f239815c000 msgr2=0x7f23980b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239d2a7640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f239815c000 0x7f23980b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239d2a7640 1 -- 172.21.15.103:0/2115288126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23980b2c10 con 0x7f23980d29a0 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239d2a7640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23980d29a0 0x7f23980cb950 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f239400c820 tx=0x7f239400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f238a7fc640 1 -- 172.21.15.103:0/2115288126 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394015070 con 0x7f23980d29a0 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f238a7fc640 1 -- 172.21.15.103:0/2115288126 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2394007a30 con 0x7f23980d29a0 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f238a7fc640 1 -- 172.21.15.103:0/2115288126 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394007e00 con 0x7f23980d29a0 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239814e6f0 con 0x7f23980d29a0 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.936+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23980c9a90 con 0x7f23980d29a0 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.937+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23980cd4e0 con 0x7f23980d29a0 2024-08-18T23:58:02.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.937+0000 7f238a7fc640 1 -- 172.21.15.103:0/2115288126 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2394018070 con 0x7f23980d29a0 2024-08-18T23:58:02.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.938+0000 7f238a7fc640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f237c06be30 0x7f237c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:02.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.938+0000 7f238a7fc640 1 -- 172.21.15.103:0/2115288126 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f239408aeb0 con 0x7f23980d29a0 2024-08-18T23:58:02.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.938+0000 7f239daa8640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f237c06be30 0x7f237c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:02.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.938+0000 7f239daa8640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f237c06be30 0x7f237c06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f238c034000 tx=0x7f238c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:02.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:02.942+0000 7f238a7fc640 1 -- 172.21.15.103:0/2115288126 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2394059760 con 0x7f23980d29a0 2024-08-18T23:58:03.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.143+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23980cf1c0 con 0x7f23980d29a0 2024-08-18T23:58:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.144+0000 7f238a7fc640 1 -- 172.21.15.103:0/2115288126 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5232 (secure 0 0 0) 0x7f2394059060 con 0x7f23980d29a0 2024-08-18T23:58:03.146 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:03.146 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":16,"btime":"2024-08-18T23:57:50:004328+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-18T23:57:47.319563+0000","modified":"2024-08-18T23:57:49.334110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4917":{"gid":4917,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.103:6835/171106802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":171106802},{"type":"v1","addr":"172.21.15.103:6835","nonce":171106802}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4917,"qdb_cluster":[4917]},"id":2}]} 2024-08-18T23:58:03.146 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 16 2024-08-18T23:58:03.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f237c06be30 msgr2=0x7f237c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f237c06be30 0x7f237c06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f238c034000 tx=0x7f238c02e000 comp rx=0 tx=0).stop 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23980d29a0 msgr2=0x7f23980cb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23980d29a0 0x7f23980cb950 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f239400c820 tx=0x7f239400cc20 comp rx=0 tx=0).stop 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 shutdown_connections 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f237c06be30 0x7f237c06e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f239815c000 0x7f23980b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f23980d29a0 0x7f23980cb950 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 --2- 172.21.15.103:0/2115288126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f239806fcc0 0x7f239814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 >> 172.21.15.103:0/2115288126 conn(0x7f23980d1e80 msgr2=0x7f23981e6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 shutdown_connections 2024-08-18T23:58:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.146+0000 7f239fd0c640 1 -- 172.21.15.103:0/2115288126 wait complete. 2024-08-18T23:58:03.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:58:03.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.258+0000 7f968eb6f640 1 Processor -- start 2024-08-18T23:58:03.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.258+0000 7f968eb6f640 1 -- start start 2024-08-18T23:58:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.258+0000 7f968eb6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96880d1600 0x7f96880d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.258+0000 7f968eb6f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96880d4b30 con 0x7f968815e1a0 2024-08-18T23:58:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f968eb6f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9688162be0 con 0x7f96880d11a0 2024-08-18T23:58:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f968eb6f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f96880b5020 con 0x7f96880d1600 2024-08-18T23:58:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f968c90b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f968815e1a0 0x7f96880d0a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57892/0 (socket says 172.21.15.103:57892) 2024-08-18T23:58:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f968c90b640 1 -- 172.21.15.103:0/241907107 learned_addr learned my addr 172.21.15.103:0/241907107 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236816471 0 0) 0x7f96880d4b30 con 0x7f968815e1a0 2024-08-18T23:58:03.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9678003520 con 0x7f968815e1a0 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f968d10c640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96880d1600 0x7f96880d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1537744547 0 0) 0x7f9678003520 con 0x7f968815e1a0 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96880d1600 msgr2=0x7f96880d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96880d1600 0x7f96880d2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 >> v1:172.21.15.190:6789/0 conn(0x7f96880d11a0 legacy=0x7f96880d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688162060 con 0x7f968815e1a0 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f967c001670 con 0x7f968815e1a0 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 >> v1:172.21.15.103:6789/0 conn(0x7f968815e1a0 legacy=0x7f96880d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96880d1600 0x7f96780039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9678004010 0x7f9678004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9678004d40 0x7f96780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f96880b5020 con 0x7f9678004010 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f967800bb80 con 0x7f9678004d40 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f967800bd80 con 0x7f96880d1600 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f9687fff640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9678004010 0x7f9678004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.259+0000 7f968d10c640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9678004d40 0x7f96780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f968c90b640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96880d1600 0x7f96780039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f9687fff640 1 -- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96880d1600 msgr2=0x7f96780039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f9687fff640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f96880d1600 0x7f96780039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f9687fff640 1 -- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9678004d40 msgr2=0x7f96780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f9687fff640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9678004d40 0x7f96780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f9687fff640 1 -- 172.21.15.103:0/241907107 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9678003520 con 0x7f9678004010 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f9687fff640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9678004010 0x7f9678004800 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9674001750 tx=0x7f9678005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a6fe32185c584 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674001370 con 0x7f9678004010 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96740052d0 con 0x7f9678004010 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.260+0000 7f96877fe640 1 -- 172.21.15.103:0/241907107 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967402abe0 con 0x7f9678004010 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.261+0000 7f968eb6f640 1 -- 172.21.15.103:0/241907107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9678004010 msgr2=0x7f9678004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.261+0000 7f968eb6f640 1 --2- 172.21.15.103:0/241907107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9678004010 0x7f9678004800 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9674001750 tx=0x7f9678005830 comp rx=0 tx=0).stop 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.261+0000 7f968d10c640 1 -- 172.21.15.103:0/241907107 reap_dead start 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.261+0000 7f968eb6f640 1 -- 172.21.15.103:0/241907107 shutdown_connections 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.261+0000 7f968eb6f640 1 -- 172.21.15.103:0/241907107 >> 172.21.15.103:0/241907107 conn(0x7f968808bfd0 msgr2=0x7f968809d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.261+0000 7f968eb6f640 1 -- 172.21.15.103:0/241907107 shutdown_connections 2024-08-18T23:58:03.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.261+0000 7f968eb6f640 1 -- 172.21.15.103:0/241907107 wait complete. 2024-08-18T23:58:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.262+0000 7f968eb6f640 1 Processor -- start 2024-08-18T23:58:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.262+0000 7f968eb6f640 1 -- start start 2024-08-18T23:58:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968eb6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9678004010 0x7f96881f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968eb6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96880b1fc0 0x7f96880b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968eb6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9688160500 0x7f9688160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968eb6f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9688162900 con 0x7f9688160500 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968eb6f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9688162620 con 0x7f96880b1fc0 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968eb6f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f968815e580 con 0x7f9678004010 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968d10c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9688160500 0x7f9688160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968d10c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9688160500 0x7f9688160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36990/0 (socket says 172.21.15.103:36990) 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968d10c640 1 -- 172.21.15.103:0/4278585104 learned_addr learned my addr 172.21.15.103:0/4278585104 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f968c90b640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9678004010 0x7f96881f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.263+0000 7f9687fff640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96880b1fc0 0x7f96880b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f968d10c640 1 -- 172.21.15.103:0/4278585104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9678004010 msgr2=0x7f96881f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f968d10c640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9678004010 0x7f96881f47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f968d10c640 1 -- 172.21.15.103:0/4278585104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96880b1fc0 msgr2=0x7f96880b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f968d10c640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96880b1fc0 0x7f96880b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f968d10c640 1 -- 172.21.15.103:0/4278585104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688161280 con 0x7f9688160500 2024-08-18T23:58:03.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f968d10c640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9688160500 0x7f9688160980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f96880d4d70 tx=0x7f9680007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f96857fa640 1 -- 172.21.15.103:0/4278585104 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96800046a0 con 0x7f9688160500 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f96857fa640 1 -- 172.21.15.103:0/4278585104 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968001a070 con 0x7f9688160500 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f96857fa640 1 -- 172.21.15.103:0/4278585104 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680015640 con 0x7f9688160500 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9688161560 con 0x7f9688160500 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.264+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9688160ec0 con 0x7f9688160500 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.265+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9688161d10 con 0x7f9688160500 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.265+0000 7f96857fa640 1 -- 172.21.15.103:0/4278585104 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96800157e0 con 0x7f9688160500 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.266+0000 7f96857fa640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f966c06be30 0x7f966c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.266+0000 7f96857fa640 1 -- 172.21.15.103:0/4278585104 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f968008b5f0 con 0x7f9688160500 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.266+0000 7f968c90b640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f966c06be30 0x7f966c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.266+0000 7f968c90b640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f966c06be30 0x7f966c06e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f967c000fb0 tx=0x7f967c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.270+0000 7f96857fa640 1 -- 172.21.15.103:0/4278585104 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9680024020 con 0x7f9688160500 2024-08-18T23:58:03.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.436+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96880b3b10 con 0x7f9688160500 2024-08-18T23:58:03.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.437+0000 7f96857fa640 1 -- 172.21.15.103:0/4278585104 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16978 (secure 0 0 0) 0x7f9680059850 con 0x7f9688160500 2024-08-18T23:58:03.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:03.438 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":38,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:57:48.998109+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-08-18T23:57:45.173057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-08-18T23:57:46.287913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:58:03.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f966c06be30 msgr2=0x7f966c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f966c06be30 0x7f966c06e2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f967c000fb0 tx=0x7f967c007040 comp rx=0 tx=0).stop 2024-08-18T23:58:03.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9688160500 msgr2=0x7f9688160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9688160500 0x7f9688160980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f96880d4d70 tx=0x7f9680007700 comp rx=0 tx=0).stop 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 shutdown_connections 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f966c06be30 0x7f966c06e2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9688160500 0x7f9688160980 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f96880b1fc0 0x7f96880b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 --2- 172.21.15.103:0/4278585104 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9678004010 0x7f96881f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 >> 172.21.15.103:0/4278585104 conn(0x7f968808bfd0 msgr2=0x7f96880cf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 shutdown_connections 2024-08-18T23:58:03.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.439+0000 7f968eb6f640 1 -- 172.21.15.103:0/4278585104 wait complete. 2024-08-18T23:58:03.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-18T23:58:03.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.549+0000 7f780b3f1640 1 Processor -- start 2024-08-18T23:58:03.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.550+0000 7f780b3f1640 1 -- start start 2024-08-18T23:58:03.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780b3f1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f78040d2e10 0x7f78040b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780b3f1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 0x7f78040b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780b3f1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78040d4e10 con 0x7f780415e3b0 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780b3f1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f78040d4bc0 con 0x7f78040d2e10 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780b3f1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f78040cf960 con 0x7f78040d21b0 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780918d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f780415e3b0 0x7f78040d2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57904/0 (socket says 172.21.15.103:57904) 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780918d640 1 -- 172.21.15.103:0/3179743765 learned_addr learned my addr 172.21.15.103:0/3179743765 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780898c640 1 --2- 172.21.15.103:0/3179743765 >> v2:172.21.15.190:3300/0 conn(0x7f78040d2e10 0x7f78040b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780998e640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 0x7f78040b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354044183 0 0) 0x7f78040d4e10 con 0x7f780415e3b0 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77f0003520 con 0x7f780415e3b0 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1053816856 0 0) 0x7f77f0003520 con 0x7f780415e3b0 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 msgr2=0x7f78040b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 0x7f78040b3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 >> v2:172.21.15.190:3300/0 conn(0x7f78040d2e10 msgr2=0x7f78040b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 --2- 172.21.15.103:0/3179743765 >> v2:172.21.15.190:3300/0 conn(0x7f78040d2e10 0x7f78040b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78040cfbb0 con 0x7f780415e3b0 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f7800001670 con 0x7f780415e3b0 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780998e640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 0x7f78040b3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 >> v1:172.21.15.103:6789/0 conn(0x7f780415e3b0 legacy=0x7f78040d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 0x7f77f00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f77f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f0004d40 0x7f77f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78040d4bc0 con 0x7f77f0003ef0 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f78040cf960 con 0x7f77f0004d40 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77f000b9c0 con 0x7f78040d21b0 2024-08-18T23:58:03.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780898c640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f77f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780918d640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 0x7f77f00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.551+0000 7f780998e640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f0004d40 0x7f77f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f780898c640 1 -- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 msgr2=0x7f77f00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f780898c640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 0x7f77f00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f780898c640 1 -- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f0004d40 msgr2=0x7f77f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f780898c640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f0004d40 0x7f77f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f780898c640 1 -- 172.21.15.103:0/3179743765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f0003520 con 0x7f77f0003ef0 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f780918d640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040d21b0 0x7f77f00039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f780998e640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f0004d40 0x7f77f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f780898c640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f77f0004800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009ac0 tx=0x7f77f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd07d31e4572270 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4036070 con 0x7f77f0003ef0 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f4031400 con 0x7f77f0003ef0 2024-08-18T23:58:03.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.552+0000 7f77fbfff640 1 -- 172.21.15.103:0/3179743765 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f4009690 con 0x7f77f0003ef0 2024-08-18T23:58:03.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.553+0000 7f780b3f1640 1 -- 172.21.15.103:0/3179743765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 msgr2=0x7f77f0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.553+0000 7f780b3f1640 1 --2- 172.21.15.103:0/3179743765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f77f0004800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f77f4009ac0 tx=0x7f77f0005830 comp rx=0 tx=0).stop 2024-08-18T23:58:03.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.553+0000 7f780998e640 1 -- 172.21.15.103:0/3179743765 reap_dead start 2024-08-18T23:58:03.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.553+0000 7f780b3f1640 1 -- 172.21.15.103:0/3179743765 shutdown_connections 2024-08-18T23:58:03.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.553+0000 7f780b3f1640 1 -- 172.21.15.103:0/3179743765 >> 172.21.15.103:0/3179743765 conn(0x7f78040d40a0 msgr2=0x7f78040d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:03.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.553+0000 7f780b3f1640 1 -- 172.21.15.103:0/3179743765 shutdown_connections 2024-08-18T23:58:03.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.553+0000 7f780b3f1640 1 -- 172.21.15.103:0/3179743765 wait complete. 2024-08-18T23:58:03.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.554+0000 7f780b3f1640 1 Processor -- start 2024-08-18T23:58:03.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.554+0000 7f780b3f1640 1 -- start start 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780b3f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f780415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780b3f1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040cbca0 0x7f780415a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780b3f1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78041f7810 0x7f78041f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780b3f1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f780415e790 con 0x7f77f0003ef0 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780b3f1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f78040d0200 con 0x7f78041f7810 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780b3f1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f780415e910 con 0x7f78040cbca0 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780918d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f780415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780918d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f780415a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37002/0 (socket says 172.21.15.103:37002) 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780918d640 1 -- 172.21.15.103:0/3734075659 learned_addr learned my addr 172.21.15.103:0/3734075659 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780898c640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040cbca0 0x7f780415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780998e640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78041f7810 0x7f78041f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780918d640 1 -- 172.21.15.103:0/3734075659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040cbca0 msgr2=0x7f780415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780918d640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040cbca0 0x7f780415a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780918d640 1 -- 172.21.15.103:0/3734075659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78041f7810 msgr2=0x7f78041f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780918d640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78041f7810 0x7f78041f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.555+0000 7f780918d640 1 -- 172.21.15.103:0/3734075659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780409de40 con 0x7f77f0003ef0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.556+0000 7f780918d640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f780415a430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f780000e840 tx=0x7f780000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.556+0000 7f77f9ffb640 1 -- 172.21.15.103:0/3734075659 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780000c870 con 0x7f77f0003ef0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.556+0000 7f77f9ffb640 1 -- 172.21.15.103:0/3734075659 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7800018070 con 0x7f77f0003ef0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.556+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780409e120 con 0x7f77f0003ef0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.556+0000 7f77f9ffb640 1 -- 172.21.15.103:0/3734075659 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780000cc10 con 0x7f77f0003ef0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.556+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78040ce3d0 con 0x7f77f0003ef0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.557+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78040d4e10 con 0x7f77f0003ef0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.557+0000 7f77f9ffb640 1 -- 172.21.15.103:0/3734075659 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f780001d460 con 0x7f77f0003ef0 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.558+0000 7f77f9ffb640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f77e806be60 0x7f77e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.558+0000 7f77f9ffb640 1 -- 172.21.15.103:0/3734075659 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f780008aea0 con 0x7f77f0003ef0 2024-08-18T23:58:03.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.558+0000 7f780898c640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f77e806be60 0x7f77e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.558+0000 7f780898c640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f77e806be60 0x7f77e806e320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77f4033000 tx=0x7f77f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.562+0000 7f77f9ffb640 1 -- 172.21.15.103:0/3734075659 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f7800059100 con 0x7f77f0003ef0 2024-08-18T23:58:03.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.762+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7804068df0 con 0x7f77f0003ef0 2024-08-18T23:58:03.764 INFO:tasks.ceph.mon.a.smithi103.stderr:2024-08-18T23:58:03.763+0000 7f4856028640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-18T23:58:03.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.764+0000 7f77f9ffb640 1 -- 172.21.15.103:0/3734075659 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f780005d400 con 0x7f77f0003ef0 2024-08-18T23:58:03.765 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f77e806be60 msgr2=0x7f77e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f77e806be60 0x7f77e806e320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f77f4033000 tx=0x7f77f4008030 comp rx=0 tx=0).stop 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 msgr2=0x7f780415a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f780415a430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f780000e840 tx=0x7f780000ed00 comp rx=0 tx=0).stop 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 shutdown_connections 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f77e806be60 0x7f77e806e320 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f78041f7810 0x7f78041f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f78040cbca0 0x7f780415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 --2- 172.21.15.103:0/3734075659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77f0003ef0 0x7f780415a430 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 >> 172.21.15.103:0/3734075659 conn(0x7f78040d40a0 msgr2=0x7f780406d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 shutdown_connections 2024-08-18T23:58:03.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.766+0000 7f780b3f1640 1 -- 172.21.15.103:0/3734075659 wait complete. 2024-08-18T23:58:03.771 INFO:tasks.ceph.mds.a.smithi103.stderr: -4580> 2024-08-18T23:57:51.945+0000 7fcf56ced640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-18T23:58:03.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-18T23:58:03.802 INFO:tasks.ceph.mds.a.smithi103.stdout:starting mds.a at 2024-08-18T23:58:03.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.881+0000 7feaa1ba1640 1 Processor -- start 2024-08-18T23:58:03.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.881+0000 7feaa1ba1640 1 -- start start 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7feaa1ba1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c15ae70 0x7fea9c15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7feaa1ba1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fea9c15ea60 0x7fea9c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7feaa1ba1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea9c0721d0 con 0x7fea9c0c6170 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7feaa1ba1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fea9c0c65e0 con 0x7fea9c15ea60 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7feaa1ba1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fea9c15b250 con 0x7fea9c15ae70 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9bfff640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fea9c0c6170 0x7fea9c06b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57916/0 (socket says 172.21.15.103:57916) 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9bfff640 1 -- 172.21.15.103:0/1030541676 learned_addr learned my addr 172.21.15.103:0/1030541676 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9b7fe640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c15ae70 0x7fea9c15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642676694 0 0) 0x7fea94001490 con 0x7fea9c0c6170 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea84003520 con 0x7fea9c0c6170 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9affd640 1 --2- 172.21.15.103:0/1030541676 >> v2:172.21.15.190:3300/0 conn(0x7fea9c15ea60 0x7fea9c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2379912924 0 0) 0x7fea84003520 con 0x7fea9c0c6170 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c15ae70 msgr2=0x7fea9c15f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c15ae70 0x7fea9c15f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 >> v2:172.21.15.190:3300/0 conn(0x7fea9c15ea60 msgr2=0x7fea9c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 --2- 172.21.15.103:0/1030541676 >> v2:172.21.15.190:3300/0 conn(0x7fea9c15ea60 0x7fea9c0c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c0cf0d0 con 0x7fea9c0c6170 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7fea94001bc0 con 0x7fea9c0c6170 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9affd640 1 --2- 172.21.15.103:0/1030541676 >> v2:172.21.15.190:3300/0 conn(0x7fea9c15ea60 0x7fea9c0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 >> v1:172.21.15.103:6789/0 conn(0x7fea9c0c6170 legacy=0x7fea9c06b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c15ae70 0x7fea840039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea84003f60 0x7fea84004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea84004d40 0x7fea840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c0c65e0 con 0x7fea84004d40 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea8400ba70 con 0x7fea84003f60 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fea8400bc70 con 0x7fea9c15ae70 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.882+0000 7fea9bfff640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea84004d40 0x7fea840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.883+0000 7fea9affd640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea84003f60 0x7fea84004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.883+0000 7fea9b7fe640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c15ae70 0x7fea840039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.883+0000 7fea9bfff640 1 -- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c15ae70 msgr2=0x7fea840039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.883+0000 7fea9bfff640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c15ae70 0x7fea840039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.883+0000 7fea9bfff640 1 -- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea84003f60 msgr2=0x7fea84004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.883+0000 7fea9bfff640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea84003f60 0x7fea84004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.883+0000 7fea9bfff640 1 -- 172.21.15.103:0/1030541676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea84003520 con 0x7fea84004d40 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.883+0000 7fea9bfff640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea84004d40 0x7fea840051c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea9400aa50 tx=0x7fea84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7256ef290984da61 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9400a670 con 0x7fea84004d40 2024-08-18T23:58:03.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9402f070 con 0x7fea84004d40 2024-08-18T23:58:03.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7fea9a7fc640 1 -- 172.21.15.103:0/1030541676 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea94034470 con 0x7fea84004d40 2024-08-18T23:58:03.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7feaa1ba1640 1 -- 172.21.15.103:0/1030541676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea84004d40 msgr2=0x7fea840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7feaa1ba1640 1 --2- 172.21.15.103:0/1030541676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea84004d40 0x7fea840051c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fea9400aa50 tx=0x7fea84005830 comp rx=0 tx=0).stop 2024-08-18T23:58:03.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7fea9bfff640 1 -- 172.21.15.103:0/1030541676 reap_dead start 2024-08-18T23:58:03.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7feaa1ba1640 1 -- 172.21.15.103:0/1030541676 shutdown_connections 2024-08-18T23:58:03.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7feaa1ba1640 1 -- 172.21.15.103:0/1030541676 >> 172.21.15.103:0/1030541676 conn(0x7fea9c0cc6e0 msgr2=0x7fea9c0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:03.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7feaa1ba1640 1 -- 172.21.15.103:0/1030541676 shutdown_connections 2024-08-18T23:58:03.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.884+0000 7feaa1ba1640 1 -- 172.21.15.103:0/1030541676 wait complete. 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.885+0000 7feaa1ba1640 1 Processor -- start 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7feaa1ba1640 1 -- start start 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7feaa1ba1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c1562c0 0x7fea9c1f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7feaa1ba1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea9c1566a0 0x7fea9c1f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7feaa1ba1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c0c84a0 0x7fea9c0c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7feaa1ba1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c072a10 con 0x7fea9c1566a0 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7feaa1ba1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c072730 con 0x7fea9c1562c0 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7feaa1ba1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fea9c072cf0 con 0x7fea9c0c84a0 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7fea9affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea9c1566a0 0x7fea9c1f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7fea9affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea9c1566a0 0x7fea9c1f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37046/0 (socket says 172.21.15.103:37046) 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7fea9affd640 1 -- 172.21.15.103:0/3999846308 learned_addr learned my addr 172.21.15.103:0/3999846308 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.886+0000 7fea9bfff640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c0c84a0 0x7fea9c0c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea9b7fe640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c1562c0 0x7fea9c1f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea9affd640 1 -- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c0c84a0 msgr2=0x7fea9c0c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea9affd640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c0c84a0 0x7fea9c0c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea9affd640 1 -- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c1562c0 msgr2=0x7fea9c1f7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea9affd640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c1562c0 0x7fea9c1f7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea9affd640 1 -- 172.21.15.103:0/3999846308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c1f8000 con 0x7fea9c1566a0 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea9b7fe640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c1562c0 0x7fea9c1f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea9affd640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea9c1566a0 0x7fea9c1f4eb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fea900115b0 tx=0x7fea90011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea83fff640 1 -- 172.21.15.103:0/3999846308 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9000f040 con 0x7fea9c1566a0 2024-08-18T23:58:03.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea83fff640 1 -- 172.21.15.103:0/3999846308 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea90004230 con 0x7fea9c1566a0 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9c1f82e0 con 0x7fea9c1566a0 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7fea83fff640 1 -- 172.21.15.103:0/3999846308 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90015730 con 0x7fea9c1566a0 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.887+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9c1f88a0 con 0x7fea9c1566a0 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.888+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9c072fd0 con 0x7fea9c1566a0 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.889+0000 7fea83fff640 1 -- 172.21.15.103:0/3999846308 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea900158d0 con 0x7fea9c1566a0 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.889+0000 7fea83fff640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fea8806be60 0x7fea8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.889+0000 7fea83fff640 1 -- 172.21.15.103:0/3999846308 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6187+0+0 (secure 0 0 0) 0x7fea9008b240 con 0x7fea9c1566a0 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.889+0000 7fea9b7fe640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fea8806be60 0x7fea8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:03.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.890+0000 7fea9b7fe640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fea8806be60 0x7fea8806e320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009b40 tx=0x7fea8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:03.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:03.893+0000 7fea83fff640 1 -- 172.21.15.103:0/3999846308 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fea90019020 con 0x7fea9c1566a0 2024-08-18T23:58:04.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.097+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fea9c0af500 con 0x7fea9c1566a0 2024-08-18T23:58:04.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.794+0000 7fea83fff640 1 -- 172.21.15.103:0/3999846308 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fea90059450 con 0x7fea9c1566a0 2024-08-18T23:58:04.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fea8806be60 msgr2=0x7fea8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:04.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fea8806be60 0x7fea8806e320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009b40 tx=0x7fea8c008040 comp rx=0 tx=0).stop 2024-08-18T23:58:04.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea9c1566a0 msgr2=0x7fea9c1f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:04.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea9c1566a0 0x7fea9c1f4eb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fea900115b0 tx=0x7fea90011a70 comp rx=0 tx=0).stop 2024-08-18T23:58:04.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 shutdown_connections 2024-08-18T23:58:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fea8806be60 0x7fea8806e320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea9c0c84a0 0x7fea9c0c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fea9c1566a0 0x7fea9c1f4eb0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 --2- 172.21.15.103:0/3999846308 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea9c1562c0 0x7fea9c1f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 >> 172.21.15.103:0/3999846308 conn(0x7fea9c0cc6e0 msgr2=0x7fea9c158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 shutdown_connections 2024-08-18T23:58:04.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.797+0000 7feaa1ba1640 1 -- 172.21.15.103:0/3999846308 wait complete. 2024-08-18T23:58:04.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-18T23:58:04.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.957+0000 7fb1ab18f640 1 Processor -- start 2024-08-18T23:58:04.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.957+0000 7fb1ab18f640 1 -- start start 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1ab18f640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1a415e330 0x7fb1a40ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1ab18f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a40b3f80 0x7fb1a406c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1ab18f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1a406b900 con 0x7fb1a406f8d0 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1ab18f640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fb1a406f080 con 0x7fb1a415e330 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1ab18f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a406bba0 con 0x7fb1a40b3f80 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1a8f2b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1a415e330 0x7fb1a40ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1a8f2b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1a415e330 0x7fb1a40ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37052/0 (socket says 172.21.15.103:37052) 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1a8f2b640 1 -- 172.21.15.103:0/3706864233 learned_addr learned my addr 172.21.15.103:0/3706864233 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:04.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1a8f2b640 1 -- 172.21.15.103:0/3706864233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a40b3f80 msgr2=0x7fb1a406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:04.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1a8f2b640 1 --2- 172.21.15.103:0/3706864233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a40b3f80 0x7fb1a406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1a8f2b640 1 -- 172.21.15.103:0/3706864233 >> v1:172.21.15.190:6789/0 conn(0x7fb1a406f8d0 legacy=0x7fb1a40b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:04.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.958+0000 7fb1a8f2b640 1 -- 172.21.15.103:0/3706864233 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a406be80 con 0x7fb1a415e330 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.959+0000 7fb1a8f2b640 1 --2- 172.21.15.103:0/3706864233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a40ad8b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40b32c0 tx=0x7fb1a002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b70840b021829fa server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.959+0000 7fb19b7fe640 1 -- 172.21.15.103:0/3706864233 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0036070 con 0x7fb1a415e330 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.959+0000 7fb19b7fe640 1 -- 172.21.15.103:0/3706864233 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a0031600 con 0x7fb1a415e330 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.959+0000 7fb19b7fe640 1 -- 172.21.15.103:0/3706864233 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00319d0 con 0x7fb1a415e330 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.960+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3706864233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 msgr2=0x7fb1a40ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.960+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3706864233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a40ad8b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40b32c0 tx=0x7fb1a002a6c0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.960+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3706864233 shutdown_connections 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.960+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3706864233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a40b3f80 0x7fb1a406c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.960+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3706864233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a40ad8b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.960+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3706864233 >> 172.21.15.103:0/3706864233 conn(0x7fb1a40d0650 msgr2=0x7fb1a40d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:04.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.960+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3706864233 shutdown_connections 2024-08-18T23:58:04.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.960+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3706864233 wait complete. 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.961+0000 7fb1ab18f640 1 Processor -- start 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.961+0000 7fb1ab18f640 1 -- start start 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1ab18f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a406f8d0 0x7fb1a414a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1ab18f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1a40b3f80 0x7fb1a414cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1ab18f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1ab18f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a406de80 con 0x7fb1a415e330 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1ab18f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a406ed70 con 0x7fb1a40b3f80 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1ab18f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a406e000 con 0x7fb1a406f8d0 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a972c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:04.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a972c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a414d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37068/0 (socket says 172.21.15.103:37068) 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a972c640 1 -- 172.21.15.103:0/3431676887 learned_addr learned my addr 172.21.15.103:0/3431676887 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb19bfff640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1a40b3f80 0x7fb1a414cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a8f2b640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a406f8d0 0x7fb1a414a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a972c640 1 -- 172.21.15.103:0/3431676887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a406f8d0 msgr2=0x7fb1a414a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a972c640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a406f8d0 0x7fb1a414a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a972c640 1 -- 172.21.15.103:0/3431676887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1a40b3f80 msgr2=0x7fb1a414cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a972c640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1a40b3f80 0x7fb1a414cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.962+0000 7fb1a972c640 1 -- 172.21.15.103:0/3431676887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a414d8f0 con 0x7fb1a415e330 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.963+0000 7fb1a972c640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a414d2e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009fd0 tx=0x7fb19c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.963+0000 7fb1997fa640 1 -- 172.21.15.103:0/3431676887 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c011830 con 0x7fb1a415e330 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.963+0000 7fb1997fa640 1 -- 172.21.15.103:0/3431676887 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19c016070 con 0x7fb1a415e330 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.963+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a414dbd0 con 0x7fb1a415e330 2024-08-18T23:58:04.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.963+0000 7fb1997fa640 1 -- 172.21.15.103:0/3431676887 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19c011bf0 con 0x7fb1a415e330 2024-08-18T23:58:04.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.963+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a40cde20 con 0x7fb1a415e330 2024-08-18T23:58:04.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.964+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a40746c0 con 0x7fb1a415e330 2024-08-18T23:58:04.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.964+0000 7fb1997fa640 1 -- 172.21.15.103:0/3431676887 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb19c01b460 con 0x7fb1a415e330 2024-08-18T23:58:04.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.965+0000 7fb1997fa640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb19006be30 0x7fb19006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:04.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.965+0000 7fb1997fa640 1 -- 172.21.15.103:0/3431676887 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6187+0+0 (secure 0 0 0) 0x7fb19c08abb0 con 0x7fb1a415e330 2024-08-18T23:58:04.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.965+0000 7fb1a8f2b640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb19006be30 0x7fb19006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:04.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.965+0000 7fb1a8f2b640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb19006be30 0x7fb19006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0033000 tx=0x7fb1a0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:04.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:04.969+0000 7fb1997fa640 1 -- 172.21.15.103:0/3431676887 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fb19c058dc0 con 0x7fb1a415e330 2024-08-18T23:58:05.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.136+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb1a40ad8b0 con 0x7fb1a415e330 2024-08-18T23:58:05.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.800+0000 7fb1997fa640 1 -- 172.21.15.103:0/3431676887 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) ==== 181+0+0 (secure 0 0 0) 0x7fb19c05d0c0 con 0x7fb1a415e330 2024-08-18T23:58:05.801 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb19006be30 msgr2=0x7fb19006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb19006be30 0x7fb19006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0033000 tx=0x7fb1a0009000 comp rx=0 tx=0).stop 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 msgr2=0x7fb1a414d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a414d2e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009fd0 tx=0x7fb19c00b8e0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 shutdown_connections 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fb19006be30 0x7fb19006e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a415e330 0x7fb1a414d2e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1a40b3f80 0x7fb1a414cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 --2- 172.21.15.103:0/3431676887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1a406f8d0 0x7fb1a414a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 >> 172.21.15.103:0/3431676887 conn(0x7fb1a40d0650 msgr2=0x7fb1a406c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:05.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.804+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 shutdown_connections 2024-08-18T23:58:05.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.805+0000 7fb1ab18f640 1 -- 172.21.15.103:0/3431676887 wait complete. 2024-08-18T23:58:05.819 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-18T23:58:05.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.922+0000 7f227c32c640 1 Processor -- start 2024-08-18T23:58:05.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.922+0000 7f227c32c640 1 -- start start 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227c32c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2274073560 0x7f22740b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227c32c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f227406de10 0x7f2274071a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227c32c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2274073940 con 0x7f22740b3ac0 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227c32c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f22740b3f20 con 0x7f227406de10 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227c32c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f227406e430 con 0x7f2274073560 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a8c9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f227406de10 0x7f2274071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a8c9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f227406de10 0x7f2274071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37078/0 (socket says 172.21.15.103:37078) 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a8c9640 1 -- 172.21.15.103:0/3476986237 learned_addr learned my addr 172.21.15.103:0/3476986237 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a0c8640 1 --2- 172.21.15.103:0/3476986237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2274073560 0x7f22740b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:05.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a8c9640 1 -- 172.21.15.103:0/3476986237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2274073560 msgr2=0x7f22740b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a8c9640 1 --2- 172.21.15.103:0/3476986237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2274073560 0x7f22740b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a8c9640 1 -- 172.21.15.103:0/3476986237 >> v1:172.21.15.190:6789/0 conn(0x7f22740b3ac0 legacy=0x7f227406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a8c9640 1 -- 172.21.15.103:0/3476986237 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227406e710 con 0x7f227406de10 2024-08-18T23:58:05.926 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.923+0000 7f227a0c8640 1 --2- 172.21.15.103:0/3476986237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2274073560 0x7f22740b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.924+0000 7f227a8c9640 1 --2- 172.21.15.103:0/3476986237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227406de10 0x7f2274071a60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ca3937fbc0757 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.924+0000 7f22790c6640 1 -- 172.21.15.103:0/3476986237 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c036070 con 0x7f227406de10 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.924+0000 7f22790c6640 1 -- 172.21.15.103:0/3476986237 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c031600 con 0x7f227406de10 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.924+0000 7f22790c6640 1 -- 172.21.15.103:0/3476986237 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0319d0 con 0x7f227406de10 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.925+0000 7f227c32c640 1 -- 172.21.15.103:0/3476986237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227406de10 msgr2=0x7f2274071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.925+0000 7f227c32c640 1 --2- 172.21.15.103:0/3476986237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227406de10 0x7f2274071a60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c02a710 comp rx=0 tx=0).stop 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.925+0000 7f227c32c640 1 -- 172.21.15.103:0/3476986237 shutdown_connections 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.925+0000 7f227c32c640 1 --2- 172.21.15.103:0/3476986237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227406de10 0x7f2274071a60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.927 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.925+0000 7f227c32c640 1 --2- 172.21.15.103:0/3476986237 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2274073560 0x7f22740b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.925+0000 7f227c32c640 1 -- 172.21.15.103:0/3476986237 >> 172.21.15.103:0/3476986237 conn(0x7f227406bae0 msgr2=0x7f227406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.925+0000 7f227c32c640 1 -- 172.21.15.103:0/3476986237 shutdown_connections 2024-08-18T23:58:05.928 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.925+0000 7f227c32c640 1 -- 172.21.15.103:0/3476986237 wait complete. 2024-08-18T23:58:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.926+0000 7f227c32c640 1 Processor -- start 2024-08-18T23:58:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.926+0000 7f227c32c640 1 -- start start 2024-08-18T23:58:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227c32c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f227406de10 0x7f2274154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227c32c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2274073560 0x7f22741f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227c32c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22740b3ac0 0x7f227415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227c32c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f227406efb0 con 0x7f22740b3ac0 2024-08-18T23:58:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227c32c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f227406ecd0 con 0x7f2274073560 2024-08-18T23:58:05.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227c32c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2274071fa0 con 0x7f227406de10 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22740b3ac0 0x7f227415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22740b3ac0 0x7f227415cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37086/0 (socket says 172.21.15.103:37086) 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 -- 172.21.15.103:0/3024348831 learned_addr learned my addr 172.21.15.103:0/3024348831 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a0c8640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f227406de10 0x7f2274154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f22798c7640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2274073560 0x7f22741f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 -- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f227406de10 msgr2=0x7f2274154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f227406de10 0x7f2274154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 -- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2274073560 msgr2=0x7f22741f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2274073560 0x7f22741f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 -- 172.21.15.103:0/3024348831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22741e8460 con 0x7f22740b3ac0 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f22798c7640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2274073560 0x7f22741f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f227a8c9640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22740b3ac0 0x7f227415cc30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:05.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.927+0000 7f226affd640 1 -- 172.21.15.103:0/3024348831 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c036050 con 0x7f22740b3ac0 2024-08-18T23:58:05.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.928+0000 7f226affd640 1 -- 172.21.15.103:0/3024348831 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c042070 con 0x7f22740b3ac0 2024-08-18T23:58:05.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.928+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22741e8740 con 0x7f22740b3ac0 2024-08-18T23:58:05.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.928+0000 7f226affd640 1 -- 172.21.15.103:0/3024348831 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c009510 con 0x7f22740b3ac0 2024-08-18T23:58:05.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.928+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22741f5080 con 0x7f22740b3ac0 2024-08-18T23:58:05.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.928+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22741f4150 con 0x7f22740b3ac0 2024-08-18T23:58:05.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.929+0000 7f226affd640 1 -- 172.21.15.103:0/3024348831 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f226c007bd0 con 0x7f22740b3ac0 2024-08-18T23:58:05.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.929+0000 7f226affd640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f225806be60 0x7f225806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:05.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.929+0000 7f226affd640 1 -- 172.21.15.103:0/3024348831 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5749+0+0 (secure 0 0 0) 0x7f226c0abc80 con 0x7f22740b3ac0 2024-08-18T23:58:05.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.929+0000 7f227a0c8640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f225806be60 0x7f225806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:05.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.930+0000 7f227a0c8640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f225806be60 0x7f225806e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2270006fd0 tx=0x7f2270008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:05.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:05.933+0000 7f226affd640 1 -- 172.21.15.103:0/3024348831 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f226c07a600 con 0x7f22740b3ac0 2024-08-18T23:58:06.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.098+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2274071a60 con 0x7f22740b3ac0 2024-08-18T23:58:06.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.804+0000 7f226affd640 1 -- 172.21.15.103:0/3024348831 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) ==== 169+0+0 (secure 0 0 0) 0x7f226c079f00 con 0x7f22740b3ac0 2024-08-18T23:58:06.806 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-08-18T23:58:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.808+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f225806be60 msgr2=0x7f225806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.808+0000 7f227c32c640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f225806be60 0x7f225806e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2270006fd0 tx=0x7f2270008040 comp rx=0 tx=0).stop 2024-08-18T23:58:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.808+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22740b3ac0 msgr2=0x7f227415cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:06.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.808+0000 7f227c32c640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22740b3ac0 0x7f227415cc30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f226c009e50 tx=0x7f226c004a40 comp rx=0 tx=0).stop 2024-08-18T23:58:06.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.810+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 shutdown_connections 2024-08-18T23:58:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.810+0000 7f227c32c640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f225806be60 0x7f225806e320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.810+0000 7f227c32c640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22740b3ac0 0x7f227415cc30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.810+0000 7f227c32c640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2274073560 0x7f22741f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.810+0000 7f227c32c640 1 --2- 172.21.15.103:0/3024348831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f227406de10 0x7f2274154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.810+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 >> 172.21.15.103:0/3024348831 conn(0x7f227406bae0 msgr2=0x7f22740b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.810+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 shutdown_connections 2024-08-18T23:58:06.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.810+0000 7f227c32c640 1 -- 172.21.15.103:0/3024348831 wait complete. 2024-08-18T23:58:06.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_symlink_recovery 2024-08-18T23:58:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.930+0000 7fbb553b1640 1 Processor -- start 2024-08-18T23:58:06.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.930+0000 7fbb553b1640 1 -- start start 2024-08-18T23:58:06.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.931+0000 7fbb553b1640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb50161770 0x7fbb500ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:06.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.931+0000 7fbb553b1640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb500b33f0 con 0x7fbb500cc710 2024-08-18T23:58:06.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.931+0000 7fbb553b1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb5006d670 con 0x7fbb500b2e80 2024-08-18T23:58:06.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.931+0000 7fbb553b1640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fbb5006d420 con 0x7fbb50161770 2024-08-18T23:58:06.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.931+0000 7fbb4effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb50161770 0x7fbb500ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:06.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.931+0000 7fbb4effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbb50161770 0x7fbb500ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37098/0 (socket says 172.21.15.103:37098) 2024-08-18T23:58:06.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.931+0000 7fbb4effd640 1 -- 172.21.15.103:0/3407104348 learned_addr learned my addr 172.21.15.103:0/3407104348 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:06.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.932+0000 7fbb4effd640 1 -- 172.21.15.103:0/3407104348 >> v1:172.21.15.190:6789/0 conn(0x7fbb500b2e80 legacy=0x7fbb500cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:06.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.932+0000 7fbb4effd640 1 -- 172.21.15.103:0/3407104348 >> v1:172.21.15.103:6789/0 conn(0x7fbb500cc710 legacy=0x7fbb500ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:06.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.932+0000 7fbb4e7fc640 1 -- 172.21.15.103:0/3407104348 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220179630 0 0) 0x7fbb500b33f0 con 0x7fbb500cc710 2024-08-18T23:58:06.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.932+0000 7fbb4effd640 1 -- 172.21.15.103:0/3407104348 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5006d950 con 0x7fbb50161770 2024-08-18T23:58:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.932+0000 7fbb4effd640 1 --2- 172.21.15.103:0/3407104348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb50161770 0x7fbb500ce740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eff2ef8eace569b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.932+0000 7fbb4e7fc640 1 -- 172.21.15.103:0/3407104348 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40037070 con 0x7fbb50161770 2024-08-18T23:58:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.932+0000 7fbb4e7fc640 1 -- 172.21.15.103:0/3407104348 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb40032440 con 0x7fbb50161770 2024-08-18T23:58:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.932+0000 7fbb4e7fc640 1 -- 172.21.15.103:0/3407104348 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40032810 con 0x7fbb50161770 2024-08-18T23:58:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.933+0000 7fbb553b1640 1 -- 172.21.15.103:0/3407104348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb50161770 msgr2=0x7fbb500ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:06.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.933+0000 7fbb553b1640 1 --2- 172.21.15.103:0/3407104348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb50161770 0x7fbb500ce740 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb4002a270 comp rx=0 tx=0).stop 2024-08-18T23:58:06.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.933+0000 7fbb553b1640 1 -- 172.21.15.103:0/3407104348 shutdown_connections 2024-08-18T23:58:06.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.933+0000 7fbb553b1640 1 --2- 172.21.15.103:0/3407104348 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb50161770 0x7fbb500ce740 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:06.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.933+0000 7fbb553b1640 1 -- 172.21.15.103:0/3407104348 >> 172.21.15.103:0/3407104348 conn(0x7fbb500d1ec0 msgr2=0x7fbb500d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:06.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.933+0000 7fbb553b1640 1 -- 172.21.15.103:0/3407104348 shutdown_connections 2024-08-18T23:58:06.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.933+0000 7fbb553b1640 1 -- 172.21.15.103:0/3407104348 wait complete. 2024-08-18T23:58:06.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.934+0000 7fbb553b1640 1 Processor -- start 2024-08-18T23:58:06.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.934+0000 7fbb553b1640 1 -- start start 2024-08-18T23:58:06.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb553b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb500b2e80 0x7fbb500c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb553b1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb500cc710 0x7fbb501502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb553b1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb50161770 0x7fbb501f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb553b1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbb500d12f0 con 0x7fbb500b2e80 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb553b1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5006dcc0 con 0x7fbb500cc710 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb553b1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbb500d1470 con 0x7fbb50161770 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb4effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb500b2e80 0x7fbb500c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb4effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb500b2e80 0x7fbb500c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37110/0 (socket says 172.21.15.103:37110) 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb4effd640 1 -- 172.21.15.103:0/2338624049 learned_addr learned my addr 172.21.15.103:0/2338624049 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb467fc640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb500cc710 0x7fbb501502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb4effd640 1 -- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb50161770 msgr2=0x7fbb501f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.935+0000 7fbb4f7fe640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb50161770 0x7fbb501f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:06.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb4effd640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb50161770 0x7fbb501f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb4effd640 1 -- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb500cc710 msgr2=0x7fbb501502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb4effd640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb500cc710 0x7fbb501502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb4effd640 1 -- 172.21.15.103:0/2338624049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb500cbf10 con 0x7fbb500b2e80 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb467fc640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb500cc710 0x7fbb501502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb4f7fe640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb50161770 0x7fbb501f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb4effd640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb500b2e80 0x7fbb500c9970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb47fff640 1 -- 172.21.15.103:0/2338624049 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40041020 con 0x7fbb500b2e80 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb47fff640 1 -- 172.21.15.103:0/2338624049 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb40030970 con 0x7fbb500b2e80 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb500cb1b0 con 0x7fbb500b2e80 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb47fff640 1 -- 172.21.15.103:0/2338624049 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40037040 con 0x7fbb500b2e80 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.936+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb500cb770 con 0x7fbb500b2e80 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.937+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb500ce740 con 0x7fbb500b2e80 2024-08-18T23:58:06.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.937+0000 7fbb47fff640 1 -- 172.21.15.103:0/2338624049 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb40044020 con 0x7fbb500b2e80 2024-08-18T23:58:06.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.938+0000 7fbb47fff640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbb3006be60 0x7fbb3006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:06.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.938+0000 7fbb47fff640 1 -- 172.21.15.103:0/2338624049 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fbb400ab460 con 0x7fbb500b2e80 2024-08-18T23:58:06.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.938+0000 7fbb467fc640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbb3006be60 0x7fbb3006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:06.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.938+0000 7fbb467fc640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbb3006be60 0x7fbb3006e320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbb500a0090 tx=0x7fbb38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:06.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:06.942+0000 7fbb47fff640 1 -- 172.21.15.103:0/2338624049 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fbb4004b070 con 0x7fbb500b2e80 2024-08-18T23:58:07.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.108+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_symlink_recovery"} v 0) -- 0x7fbb500d19e0 con 0x7fbb500b2e80 2024-08-18T23:58:07.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.111+0000 7fbb47fff640 1 -- 172.21.15.103:0/2338624049 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_symlink_recovery"}]=0 v13) ==== 103+0+0 (secure 0 0 0) 0x7fbb40079f80 con 0x7fbb500b2e80 2024-08-18T23:58:07.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbb3006be60 msgr2=0x7fbb3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbb3006be60 0x7fbb3006e320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbb500a0090 tx=0x7fbb38009040 comp rx=0 tx=0).stop 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb500b2e80 msgr2=0x7fbb500c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb500b2e80 0x7fbb500c9970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbb40009870 tx=0x7fbb400046c0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 shutdown_connections 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fbb3006be60 0x7fbb3006e320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb50161770 0x7fbb501f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb500cc710 0x7fbb501502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 --2- 172.21.15.103:0/2338624049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbb500b2e80 0x7fbb500c9970 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 >> 172.21.15.103:0/2338624049 conn(0x7fbb500d1ec0 msgr2=0x7fbb500ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 shutdown_connections 2024-08-18T23:58:07.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.114+0000 7fbb553b1640 1 -- 172.21.15.103:0/2338624049 wait complete. 2024-08-18T23:58:07.127 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-18T23:58:07.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.226+0000 7f17f430c640 1 Processor -- start 2024-08-18T23:58:07.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.226+0000 7f17f430c640 1 -- start start 2024-08-18T23:58:07.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f430c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec0cf4d0 0x7f17ec06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f430c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f17ec15faf0 0x7f17ec15ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f430c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f17ec0cf8b0 0x7f17ec0cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f430c640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f17ec160450 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f430c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f17ec06b900 con 0x7f17ec15faf0 2024-08-18T23:58:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f430c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec06bbe0 con 0x7f17ec0cf4d0 2024-08-18T23:58:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f28a9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f17ec0cf8b0 0x7f17ec0cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f28a9640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f17ec0cf8b0 0x7f17ec0cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37118/0 (socket says 172.21.15.103:37118) 2024-08-18T23:58:07.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f28a9640 1 -- 172.21.15.103:0/2200277416 learned_addr learned my addr 172.21.15.103:0/2200277416 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:07.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f28a9640 1 -- 172.21.15.103:0/2200277416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec0cf4d0 msgr2=0x7f17ec06cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:07.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f28a9640 1 --2- 172.21.15.103:0/2200277416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec0cf4d0 0x7f17ec06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f28a9640 1 -- 172.21.15.103:0/2200277416 >> v2:172.21.15.190:3300/0 conn(0x7f17ec15faf0 msgr2=0x7f17ec15ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:07.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f28a9640 1 --2- 172.21.15.103:0/2200277416 >> v2:172.21.15.190:3300/0 conn(0x7f17ec15faf0 0x7f17ec15ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.227+0000 7f17f28a9640 1 -- 172.21.15.103:0/2200277416 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec06bec0 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.228+0000 7f17f28a9640 1 --2- 172.21.15.103:0/2200277416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0cfd60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06d4f0 tx=0x7f17e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281f5f90a6f93db9 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.228+0000 7f17f10a6640 1 -- 172.21.15.103:0/2200277416 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4036070 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.228+0000 7f17f10a6640 1 -- 172.21.15.103:0/2200277416 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e4031600 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.228+0000 7f17f10a6640 1 -- 172.21.15.103:0/2200277416 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e40319d0 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 -- 172.21.15.103:0/2200277416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 msgr2=0x7f17ec0cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 --2- 172.21.15.103:0/2200277416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0cfd60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f17ec06d4f0 tx=0x7f17e402a6a0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 -- 172.21.15.103:0/2200277416 shutdown_connections 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 --2- 172.21.15.103:0/2200277416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0cfd60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 --2- 172.21.15.103:0/2200277416 >> v2:172.21.15.190:3300/0 conn(0x7f17ec15faf0 0x7f17ec15ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 --2- 172.21.15.103:0/2200277416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec0cf4d0 0x7f17ec06cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 -- 172.21.15.103:0/2200277416 >> 172.21.15.103:0/2200277416 conn(0x7f17ec0d05c0 msgr2=0x7f17ec0d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 -- 172.21.15.103:0/2200277416 shutdown_connections 2024-08-18T23:58:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.229+0000 7f17f430c640 1 -- 172.21.15.103:0/2200277416 wait complete. 2024-08-18T23:58:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.230+0000 7f17f430c640 1 Processor -- start 2024-08-18T23:58:07.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.230+0000 7f17f430c640 1 -- start start 2024-08-18T23:58:07.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f430c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17ec0cf4d0 0x7f17ec1e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f430c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f430c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec15faf0 0x7f17ec144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f430c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec06c760 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f430c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f17ec06c480 con 0x7f17ec0cf4d0 2024-08-18T23:58:07.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f430c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f17ec06d1c0 con 0x7f17ec15faf0 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37120/0 (socket says 172.21.15.103:37120) 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 -- 172.21.15.103:0/1172306832 learned_addr learned my addr 172.21.15.103:0/1172306832 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f20a8640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17ec0cf4d0 0x7f17ec1e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f28a9640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec15faf0 0x7f17ec144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 -- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec15faf0 msgr2=0x7f17ec144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec15faf0 0x7f17ec144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 -- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17ec0cf4d0 msgr2=0x7f17ec1e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17ec0cf4d0 0x7f17ec1e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 -- 172.21.15.103:0/1172306832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ec1e8100 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f28a9640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec15faf0 0x7f17ec144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:07.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f20a8640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17ec0cf4d0 0x7f17ec1e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17f18a7640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0b5130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00b480 tx=0x7f17dc00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.231+0000 7f17e2ffd640 1 -- 172.21.15.103:0/1172306832 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc014070 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.232+0000 7f17e2ffd640 1 -- 172.21.15.103:0/1172306832 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17dc010870 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.232+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ec1e83e0 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.232+0000 7f17e2ffd640 1 -- 172.21.15.103:0/1172306832 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc010c60 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.232+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ec1f4330 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.232+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17ec06cc80 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.233+0000 7f17e2ffd640 1 -- 172.21.15.103:0/1172306832 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f17dc017070 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.233+0000 7f17e2ffd640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f17d006be30 0x7f17d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.234+0000 7f17e2ffd640 1 -- 172.21.15.103:0/1172306832 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f17dc08abc0 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.234+0000 7f17f20a8640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f17d006be30 0x7f17d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.234+0000 7f17f20a8640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f17d006be30 0x7f17d006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009890 tx=0x7f17e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:07.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.238+0000 7f17e2ffd640 1 -- 172.21.15.103:0/1172306832 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f17dc0596e0 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.403+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f17ec075400 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.406+0000 7f17e2ffd640 1 -- 172.21.15.103:0/1172306832 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) ==== 104+0+0 (secure 0 0 0) 0x7f17dc058fe0 con 0x7f17ec0cf8b0 2024-08-18T23:58:07.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f17d006be30 msgr2=0x7f17d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f17d006be30 0x7f17d006e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009890 tx=0x7f17e8008040 comp rx=0 tx=0).stop 2024-08-18T23:58:07.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 msgr2=0x7f17ec0b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0b5130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f17dc00b480 tx=0x7f17dc00b940 comp rx=0 tx=0).stop 2024-08-18T23:58:07.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 shutdown_connections 2024-08-18T23:58:07.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f17d006be30 0x7f17d006e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17ec15faf0 0x7f17ec144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17ec0cf8b0 0x7f17ec0b5130 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 --2- 172.21.15.103:0/1172306832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17ec0cf4d0 0x7f17ec1e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 >> 172.21.15.103:0/1172306832 conn(0x7f17ec0d05c0 msgr2=0x7f17ec15cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:07.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 shutdown_connections 2024-08-18T23:58:07.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.408+0000 7f17f430c640 1 -- 172.21.15.103:0/1172306832 wait complete. 2024-08-18T23:58:07.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace' 2024-08-18T23:58:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.518+0000 7f5b0db54640 1 Processor -- start 2024-08-18T23:58:07.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.518+0000 7f5b0db54640 1 -- start start 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.519+0000 7f5b0db54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 0x7f5b080afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.519+0000 7f5b0db54640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b0806d020 0x7f5b080cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.519+0000 7f5b0db54640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0815c5e0 con 0x7f5b080700c0 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.519+0000 7f5b0db54640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f5b0815d3a0 con 0x7f5b0806d020 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.519+0000 7f5b0db54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0815c8c0 con 0x7f5b0815bdd0 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.519+0000 7f5b07fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b0806d020 0x7f5b080cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.519+0000 7f5b07fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b0806d020 0x7f5b080cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37136/0 (socket says 172.21.15.103:37136) 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.519+0000 7f5b07fff640 1 -- 172.21.15.103:0/18751279 learned_addr learned my addr 172.21.15.103:0/18751279 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:07.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.520+0000 7f5b077fe640 1 --2- 172.21.15.103:0/18751279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 0x7f5b080afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.520+0000 7f5b07fff640 1 -- 172.21.15.103:0/18751279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 msgr2=0x7f5b080afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.520+0000 7f5b07fff640 1 --2- 172.21.15.103:0/18751279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 0x7f5b080afc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.520+0000 7f5b07fff640 1 -- 172.21.15.103:0/18751279 >> v1:172.21.15.190:6789/0 conn(0x7f5b080700c0 legacy=0x7f5b0806c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.520+0000 7f5b07fff640 1 -- 172.21.15.103:0/18751279 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0815cba0 con 0x7f5b0806d020 2024-08-18T23:58:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.520+0000 7f5b07fff640 1 --2- 172.21.15.103:0/18751279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806d020 0x7f5b080cedc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009e50 tx=0x7f5b0002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9701fee9af730f server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.520+0000 7f5b067fc640 1 -- 172.21.15.103:0/18751279 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b00036070 con 0x7f5b0806d020 2024-08-18T23:58:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b067fc640 1 -- 172.21.15.103:0/18751279 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b00031600 con 0x7f5b0806d020 2024-08-18T23:58:07.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b067fc640 1 -- 172.21.15.103:0/18751279 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b000319d0 con 0x7f5b0806d020 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b0db54640 1 -- 172.21.15.103:0/18751279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806d020 msgr2=0x7f5b080cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b0db54640 1 --2- 172.21.15.103:0/18751279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806d020 0x7f5b080cedc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009e50 tx=0x7f5b0002a6c0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b0db54640 1 -- 172.21.15.103:0/18751279 shutdown_connections 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b0db54640 1 --2- 172.21.15.103:0/18751279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b0806d020 0x7f5b080cedc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b0db54640 1 --2- 172.21.15.103:0/18751279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 0x7f5b080afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b0db54640 1 -- 172.21.15.103:0/18751279 >> 172.21.15.103:0/18751279 conn(0x7f5b08071f00 msgr2=0x7f5b08072310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b0db54640 1 -- 172.21.15.103:0/18751279 shutdown_connections 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.521+0000 7f5b0db54640 1 -- 172.21.15.103:0/18751279 wait complete. 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.522+0000 7f5b0db54640 1 Processor -- start 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.522+0000 7f5b0db54640 1 -- start start 2024-08-18T23:58:07.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b0db54640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b0806d020 0x7f5b080b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b0db54640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b080700c0 0x7f5b0815e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b0db54640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 0x7f5b08153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b0db54640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08070680 con 0x7f5b080700c0 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b0db54640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5b08070500 con 0x7f5b0806d020 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b0db54640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0815c1b0 con 0x7f5b0815bdd0 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b06ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b080700c0 0x7f5b0815e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b06ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b080700c0 0x7f5b0815e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37138/0 (socket says 172.21.15.103:37138) 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b06ffd640 1 -- 172.21.15.103:0/1405121614 learned_addr learned my addr 172.21.15.103:0/1405121614 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b07fff640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 0x7f5b08153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.523+0000 7f5b077fe640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b0806d020 0x7f5b080b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5b06ffd640 1 -- 172.21.15.103:0/1405121614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 msgr2=0x7f5b08153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5b06ffd640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 0x7f5b08153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5b06ffd640 1 -- 172.21.15.103:0/1405121614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b0806d020 msgr2=0x7f5b080b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5b06ffd640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b0806d020 0x7f5b080b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5b06ffd640 1 -- 172.21.15.103:0/1405121614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b080b3680 con 0x7f5b080700c0 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5b06ffd640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b080700c0 0x7f5b0815e7e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00c430 tx=0x7f5afc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5aeffff640 1 -- 172.21.15.103:0/1405121614 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc011790 con 0x7f5b080700c0 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5aeffff640 1 -- 172.21.15.103:0/1405121614 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5afc017070 con 0x7f5b080700c0 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5aeffff640 1 -- 172.21.15.103:0/1405121614 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc011bb0 con 0x7f5b080700c0 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b080b3920 con 0x7f5b080700c0 2024-08-18T23:58:07.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.524+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b081e6580 con 0x7f5b080700c0 2024-08-18T23:58:07.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.525+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b080afc60 con 0x7f5b080700c0 2024-08-18T23:58:07.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.526+0000 7f5aeffff640 1 -- 172.21.15.103:0/1405121614 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5afc01c460 con 0x7f5b080700c0 2024-08-18T23:58:07.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.526+0000 7f5aeffff640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5af406be60 0x7f5af406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:07.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.526+0000 7f5aeffff640 1 -- 172.21.15.103:0/1405121614 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f5afc08ab30 con 0x7f5b080700c0 2024-08-18T23:58:07.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.526+0000 7f5b077fe640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5af406be60 0x7f5af406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:07.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.526+0000 7f5b077fe640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5af406be60 0x7f5af406e320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b08154900 tx=0x7f5af8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:07.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.530+0000 7f5aeffff640 1 -- 172.21.15.103:0/1405121614 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f5afc0596e0 con 0x7f5b080700c0 2024-08-18T23:58:07.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.759+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]} v 0) -- 0x7f5b080681f0 con 0x7f5b080700c0 2024-08-18T23:58:07.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.805+0000 7f5aeffff640 1 -- 172.21.15.103:0/1405121614 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_backtrace.TestBacktrace.test_backtrace"]}]=0 v91) ==== 135+0+0 (secure 0 0 0) 0x7f5afc058fe0 con 0x7f5b080700c0 2024-08-18T23:58:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.807+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5af406be60 msgr2=0x7f5af406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.807+0000 7f5b0db54640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5af406be60 0x7f5af406e320 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b08154900 tx=0x7f5af8008040 comp rx=0 tx=0).stop 2024-08-18T23:58:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.807+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b080700c0 msgr2=0x7f5b0815e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.807+0000 7f5b0db54640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b080700c0 0x7f5b0815e7e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00c430 tx=0x7f5afc00c8f0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.808+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 shutdown_connections 2024-08-18T23:58:07.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.808+0000 7f5b0db54640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f5af406be60 0x7f5af406e320 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.808+0000 7f5b0db54640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5b0815bdd0 0x7f5b08153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.808+0000 7f5b0db54640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b080700c0 0x7f5b0815e7e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.808+0000 7f5b0db54640 1 --2- 172.21.15.103:0/1405121614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5b0806d020 0x7f5b080b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:07.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.808+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 >> 172.21.15.103:0/1405121614 conn(0x7f5b08071f00 msgr2=0x7f5b08155260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:07.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.808+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 shutdown_connections 2024-08-18T23:58:07.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:07.808+0000 7f5b0db54640 1 -- 172.21.15.103:0/1405121614 wait complete. 2024-08-18T23:58:07.821 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files ... ERROR 2024-08-18T23:58:07.821 INFO:tasks.cephfs_test_runner: 2024-08-18T23:58:07.821 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_backtrace.py", line 34, in test_backtrace 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner: symlink = self.fs.read_symlink(file_ino) 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1485, in read_symlink 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "symlink", "string_wrapper", pool) 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-08-18T23:58:07.822 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi103 with status 1: 'ceph-dencoder type string_wrapper import - decode dump_json' 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner:Ran 1 test in 39.079s 2024-08-18T23:58:07.823 INFO:tasks.cephfs_test_runner: 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner: 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner:ERROR: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner:That the 'parent' 'layout' and 'symlink' xattrs on the head objects of files 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/test_backtrace.py", line 34, in test_backtrace 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner: symlink = self.fs.read_symlink(file_ino) 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1485, in read_symlink 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "symlink", "string_wrapper", pool) 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-08-18T23:58:07.824 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi103 with status 1: 'ceph-dencoder type string_wrapper import - decode dump_json' 2024-08-18T23:58:07.825 INFO:tasks.cephfs_test_runner: 2024-08-18T23:58:07.826 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-08-18T23:58:09.013 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cdb6ce880d9d45fe91e5b8ec4a3528ea Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace) 2024-08-18T23:58:09.015 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-18T23:58:09.024 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-18T23:58:09.037 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-18T23:58:09.037 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:58:09.037 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:58:09.060 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055810,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20818 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T23:58:09.060 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-18T23:58:09.060 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:58:09.119 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055810,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20818 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-08-18T23:58:09.119 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:58:09.119 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:58:09.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055813,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497488k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=896 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497488k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T23:58:09.139 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-08-18T23:58:09.139 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-18T23:58:09.197 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055813,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497488k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=896 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497488k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-08-18T23:58:09.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:09.198 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2024-08-18T23:58:09.257 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-18T23:58:09.257 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-18T23:58:09.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:09.257 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-18T23:58:09.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:09.326 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-18T23:58:09.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:09.395 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2024-08-18T23:58:09.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:09.499 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-18T23:58:09.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-18T23:58:09.518 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-18T23:58:09.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:09.519 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-18T23:58:09.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:09.589 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-18T23:58:09.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-18T23:58:09.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-08-18T23:58:09.759 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-18T23:58:09.768 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-18T23:58:09.769 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:58:09.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.871+0000 7f6668e77640 1 Processor -- start 2024-08-18T23:58:09.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.871+0000 7f6668e77640 1 -- start start 2024-08-18T23:58:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.872+0000 7f6668e77640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666406f770 0x7f66640ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.872+0000 7f6668e77640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6664072610 con 0x7f66640b4370 2024-08-18T23:58:09.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.872+0000 7f6668e77640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66640728f0 con 0x7f666415ade0 2024-08-18T23:58:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.872+0000 7f6668e77640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f666406db10 con 0x7f666406f770 2024-08-18T23:58:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.872+0000 7f6662d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f66640b4370 0x7f66640adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57948/0 (socket says 172.21.15.103:57948) 2024-08-18T23:58:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.872+0000 7f6662d9d640 1 -- 172.21.15.103:0/1544144109 learned_addr learned my addr 172.21.15.103:0/1544144109 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.872+0000 7f665bfff640 1 --2- 172.21.15.103:0/1544144109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666406f770 0x7f66640ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.873+0000 7f6661d9b640 1 -- 172.21.15.103:0/1544144109 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635746011 0 0) 0x7f6664072610 con 0x7f66640b4370 2024-08-18T23:58:09.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.873+0000 7f6661d9b640 1 -- 172.21.15.103:0/1544144109 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6650003520 con 0x7f66640b4370 2024-08-18T23:58:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.873+0000 7f6661d9b640 1 -- 172.21.15.103:0/1544144109 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294104595 0 0) 0x7f66640728f0 con 0x7f666415ade0 2024-08-18T23:58:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.873+0000 7f6661d9b640 1 -- 172.21.15.103:0/1544144109 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6664072610 con 0x7f666415ade0 2024-08-18T23:58:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.873+0000 7f665bfff640 1 -- 172.21.15.103:0/1544144109 >> v1:172.21.15.190:6789/0 conn(0x7f666415ade0 legacy=0x7f666406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.873+0000 7f6661d9b640 1 -- 172.21.15.103:0/1544144109 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2068687635 0 0) 0x7f6650003520 con 0x7f66640b4370 2024-08-18T23:58:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.873+0000 7f665bfff640 1 -- 172.21.15.103:0/1544144109 >> v1:172.21.15.103:6789/0 conn(0x7f66640b4370 legacy=0x7f66640adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:09.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.873+0000 7f665bfff640 1 -- 172.21.15.103:0/1544144109 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6664072bd0 con 0x7f666406f770 2024-08-18T23:58:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f665bfff640 1 --2- 172.21.15.103:0/1544144109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666406f770 0x7f66640ad9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f664c0097d0 tx=0x7f664c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5394fe5a673b31fe server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6661d9b640 1 -- 172.21.15.103:0/1544144109 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c037070 con 0x7f666406f770 2024-08-18T23:58:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6661d9b640 1 -- 172.21.15.103:0/1544144109 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c02ab90 con 0x7f666406f770 2024-08-18T23:58:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6661d9b640 1 -- 172.21.15.103:0/1544144109 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c0019f0 con 0x7f666406f770 2024-08-18T23:58:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6668e77640 1 -- 172.21.15.103:0/1544144109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666406f770 msgr2=0x7f66640ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6668e77640 1 --2- 172.21.15.103:0/1544144109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666406f770 0x7f66640ad9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f664c0097d0 tx=0x7f664c02a100 comp rx=0 tx=0).stop 2024-08-18T23:58:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6668e77640 1 -- 172.21.15.103:0/1544144109 shutdown_connections 2024-08-18T23:58:09.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6668e77640 1 --2- 172.21.15.103:0/1544144109 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f666406f770 0x7f66640ad9d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6668e77640 1 -- 172.21.15.103:0/1544144109 >> 172.21.15.103:0/1544144109 conn(0x7f66640cfc40 msgr2=0x7f66640d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6668e77640 1 -- 172.21.15.103:0/1544144109 shutdown_connections 2024-08-18T23:58:09.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.874+0000 7f6668e77640 1 -- 172.21.15.103:0/1544144109 wait complete. 2024-08-18T23:58:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.876+0000 7f6668e77640 1 Processor -- start 2024-08-18T23:58:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.876+0000 7f6668e77640 1 -- start start 2024-08-18T23:58:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.876+0000 7f6668e77640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666406f770 0x7f666414ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.876+0000 7f6668e77640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66640b4370 0x7f666415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.876+0000 7f6668e77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f666415ade0 0x7f6664151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:09.883 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6668e77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f666406d6c0 con 0x7f666415ade0 2024-08-18T23:58:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6668e77640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f666415b1c0 con 0x7f666406f770 2024-08-18T23:58:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6668e77640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f666406d840 con 0x7f66640b4370 2024-08-18T23:58:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f666415ade0 0x7f6664151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f666415ade0 0x7f6664151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37148/0 (socket says 172.21.15.103:37148) 2024-08-18T23:58:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 -- 172.21.15.103:0/1470701955 learned_addr learned my addr 172.21.15.103:0/1470701955 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:09.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f665bfff640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66640b4370 0x7f666415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:09.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f666259c640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666406f770 0x7f666414ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:09.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 -- 172.21.15.103:0/1470701955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66640b4370 msgr2=0x7f666415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:09.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66640b4370 0x7f666415ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:09.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 -- 172.21.15.103:0/1470701955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666406f770 msgr2=0x7f666414ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:09.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666406f770 0x7f666414ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:09.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 -- 172.21.15.103:0/1470701955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666415d4c0 con 0x7f666415ade0 2024-08-18T23:58:09.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6662d9d640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f666415ade0 0x7f6664151960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f665c00cc20 tx=0x7f665c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:09.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f665affd640 1 -- 172.21.15.103:0/1470701955 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c017070 con 0x7f666415ade0 2024-08-18T23:58:09.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f665affd640 1 -- 172.21.15.103:0/1470701955 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c00ce30 con 0x7f666415ade0 2024-08-18T23:58:09.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666415d7a0 con 0x7f666415ade0 2024-08-18T23:58:09.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f665affd640 1 -- 172.21.15.103:0/1470701955 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c012620 con 0x7f666415ade0 2024-08-18T23:58:09.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.877+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666415dd60 con 0x7f666415ade0 2024-08-18T23:58:09.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.878+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66640b47b0 con 0x7f666415ade0 2024-08-18T23:58:09.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.879+0000 7f665affd640 1 -- 172.21.15.103:0/1470701955 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f665c01a070 con 0x7f666415ade0 2024-08-18T23:58:09.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.879+0000 7f665affd640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f664406be30 0x7f664406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:09.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.879+0000 7f665affd640 1 -- 172.21.15.103:0/1470701955 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f665c08aaf0 con 0x7f666415ade0 2024-08-18T23:58:09.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.879+0000 7f666259c640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f664406be30 0x7f664406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:09.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.880+0000 7f666259c640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f664406be30 0x7f664406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66540011e0 tx=0x7f6654009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:09.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:09.884+0000 7f665affd640 1 -- 172.21.15.103:0/1470701955 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f665c059050 con 0x7f666415ade0 2024-08-18T23:58:10.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.046+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f666415e2e0 con 0x7f664406be30 2024-08-18T23:58:10.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.047+0000 7f665affd640 1 -- 172.21.15.103:0/1470701955 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13487 (secure 0 0 0) 0x7f666415e2e0 con 0x7f664406be30 2024-08-18T23:58:10.049 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:10.049 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:58:10.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f664406be30 msgr2=0x7f664406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f664406be30 0x7f664406e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66540011e0 tx=0x7f6654009040 comp rx=0 tx=0).stop 2024-08-18T23:58:10.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f666415ade0 msgr2=0x7f6664151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f666415ade0 0x7f6664151960 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f665c00cc20 tx=0x7f665c00a430 comp rx=0 tx=0).stop 2024-08-18T23:58:10.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 shutdown_connections 2024-08-18T23:58:10.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f664406be30 0x7f664406e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f666415ade0 0x7f6664151960 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66640b4370 0x7f666415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 --2- 172.21.15.103:0/1470701955 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f666406f770 0x7f666414ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 >> 172.21.15.103:0/1470701955 conn(0x7f66640cfc40 msgr2=0x7f666406e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:10.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 shutdown_connections 2024-08-18T23:58:10.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.049+0000 7f6668e77640 1 -- 172.21.15.103:0/1470701955 wait complete. 2024-08-18T23:58:10.062 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-08-18T23:58:08.179678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221036,"kb_used_data":4856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753684,"statfs":{"total":773094113280,"available":772867772416,"internally_reserved":0,"allocated":4972544,"data_stored":2823135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2410,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000799"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-18T23:58:06.809961+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:58:06.809961+0000","last_peered":"2024-08-18T23:58:06.809961+0000","last_clean":"2024-08-18T23:58:06.809961+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:58:06.809961+0000","last_undegraded":"2024-08-18T23:58:06.809961+0000","last_fullsized":"2024-08-18T23:58:06.809961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":799391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":793434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:58:10.062 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:58:10.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.160+0000 7f3924d6f640 1 Processor -- start 2024-08-18T23:58:10.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.160+0000 7f3924d6f640 1 -- start start 2024-08-18T23:58:10.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.161+0000 7f3924d6f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f39201479e0 0x7f39200cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.161+0000 7f3924d6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3920073630 0x7f392006b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.161+0000 7f3924d6f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3920147dc0 con 0x7f392006be40 2024-08-18T23:58:10.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.161+0000 7f3924d6f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f392006e6d0 con 0x7f39201479e0 2024-08-18T23:58:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.161+0000 7f3924d6f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f392006c290 con 0x7f3920073630 2024-08-18T23:58:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.162+0000 7f391dd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3920073630 0x7f392006b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.162+0000 7f391e59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f39201479e0 0x7f39200cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.162+0000 7f391dd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3920073630 0x7f392006b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:40624/0 (socket says 172.21.15.103:40624) 2024-08-18T23:58:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.162+0000 7f391dd9b640 1 -- 172.21.15.103:0/3543660629 learned_addr learned my addr 172.21.15.103:0/3543660629 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.162+0000 7f391dd9b640 1 -- 172.21.15.103:0/3543660629 >> v2:172.21.15.190:3300/0 conn(0x7f39201479e0 msgr2=0x7f39200cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.162+0000 7f391dd9b640 1 --2- 172.21.15.103:0/3543660629 >> v2:172.21.15.190:3300/0 conn(0x7f39201479e0 0x7f39200cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.162+0000 7f391dd9b640 1 -- 172.21.15.103:0/3543660629 >> v1:172.21.15.190:6789/0 conn(0x7f392006be40 legacy=0x7f3920161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.162+0000 7f391dd9b640 1 -- 172.21.15.103:0/3543660629 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200cbd50 con 0x7f3920073630 2024-08-18T23:58:10.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f391dd9b640 1 --2- 172.21.15.103:0/3543660629 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3920073630 0x7f392006b900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3914009870 tx=0x7f391402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461ad76f8001a33d server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f391d59a640 1 -- 172.21.15.103:0/3543660629 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914037070 con 0x7f3920073630 2024-08-18T23:58:10.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f391d59a640 1 -- 172.21.15.103:0/3543660629 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3914032440 con 0x7f3920073630 2024-08-18T23:58:10.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f391d59a640 1 -- 172.21.15.103:0/3543660629 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3914032810 con 0x7f3920073630 2024-08-18T23:58:10.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f3924d6f640 1 -- 172.21.15.103:0/3543660629 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3920073630 msgr2=0x7f392006b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f3924d6f640 1 --2- 172.21.15.103:0/3543660629 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3920073630 0x7f392006b900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3914009870 tx=0x7f391402a270 comp rx=0 tx=0).stop 2024-08-18T23:58:10.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f3924d6f640 1 -- 172.21.15.103:0/3543660629 shutdown_connections 2024-08-18T23:58:10.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f3924d6f640 1 --2- 172.21.15.103:0/3543660629 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3920073630 0x7f392006b900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f3924d6f640 1 --2- 172.21.15.103:0/3543660629 >> v2:172.21.15.190:3300/0 conn(0x7f39201479e0 0x7f39200cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f3924d6f640 1 -- 172.21.15.103:0/3543660629 >> 172.21.15.103:0/3543660629 conn(0x7f39200cd7e0 msgr2=0x7f39200cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:10.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f3924d6f640 1 -- 172.21.15.103:0/3543660629 shutdown_connections 2024-08-18T23:58:10.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.163+0000 7f3924d6f640 1 -- 172.21.15.103:0/3543660629 wait complete. 2024-08-18T23:58:10.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.165+0000 7f3924d6f640 1 Processor -- start 2024-08-18T23:58:10.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.165+0000 7f3924d6f640 1 -- start start 2024-08-18T23:58:10.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.165+0000 7f3924d6f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392006be40 0x7f39201f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.165+0000 7f3924d6f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39201479e0 0x7f39200b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.165+0000 7f3924d6f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39200b6b40 0x7f39200b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.165+0000 7f3924d6f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f39200cf220 con 0x7f39200b6b40 2024-08-18T23:58:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.165+0000 7f3924d6f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f39200cef40 con 0x7f392006be40 2024-08-18T23:58:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.165+0000 7f3924d6f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f39200cf500 con 0x7f39201479e0 2024-08-18T23:58:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39200b6b40 0x7f39200b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39200b6b40 0x7f39200b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37158/0 (socket says 172.21.15.103:37158) 2024-08-18T23:58:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 -- 172.21.15.103:0/125806337 learned_addr learned my addr 172.21.15.103:0/125806337 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:10.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391dd9b640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39201479e0 0x7f39200b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391e59c640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392006be40 0x7f39201f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 -- 172.21.15.103:0/125806337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39201479e0 msgr2=0x7f39200b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39201479e0 0x7f39200b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 -- 172.21.15.103:0/125806337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392006be40 msgr2=0x7f39201f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392006be40 0x7f39201f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 -- 172.21.15.103:0/125806337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39200b4a00 con 0x7f39200b6b40 2024-08-18T23:58:10.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f391ed9d640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39200b6b40 0x7f39200b4270 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f391800c7a0 tx=0x7f391800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f390effd640 1 -- 172.21.15.103:0/125806337 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3918003b70 con 0x7f39200b6b40 2024-08-18T23:58:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f390effd640 1 -- 172.21.15.103:0/125806337 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3918003d30 con 0x7f39200b6b40 2024-08-18T23:58:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39200b4ce0 con 0x7f39200b6b40 2024-08-18T23:58:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f390effd640 1 -- 172.21.15.103:0/125806337 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391800aa90 con 0x7f39200b6b40 2024-08-18T23:58:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.166+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39201f4340 con 0x7f39200b6b40 2024-08-18T23:58:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.167+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39201e90b0 con 0x7f39200b6b40 2024-08-18T23:58:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.168+0000 7f390effd640 1 -- 172.21.15.103:0/125806337 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f391800ac30 con 0x7f39200b6b40 2024-08-18T23:58:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.168+0000 7f390effd640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.169+0000 7f391e59c640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.169+0000 7f390effd640 1 -- 172.21.15.103:0/125806337 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f391808ab20 con 0x7f39200b6b40 2024-08-18T23:58:10.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.169+0000 7f391e59c640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f390006be30 0x7f390006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39201e6410 tx=0x7f3910009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.173+0000 7f390effd640 1 -- 172.21.15.103:0/125806337 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f3918058ff0 con 0x7f39200b6b40 2024-08-18T23:58:10.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.336+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f392006c740 con 0x7f390006be30 2024-08-18T23:58:10.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.337+0000 7f390effd640 1 -- 172.21.15.103:0/125806337 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7f392006c740 con 0x7f390006be30 2024-08-18T23:58:10.339 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:10.339 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:58:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f390006be30 msgr2=0x7f390006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f390006be30 0x7f390006e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f39201e6410 tx=0x7f3910009190 comp rx=0 tx=0).stop 2024-08-18T23:58:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39200b6b40 msgr2=0x7f39200b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39200b6b40 0x7f39200b4270 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f391800c7a0 tx=0x7f391800cc60 comp rx=0 tx=0).stop 2024-08-18T23:58:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 shutdown_connections 2024-08-18T23:58:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f390006be30 0x7f390006e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f39200b6b40 0x7f39200b4270 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f39201479e0 0x7f39200b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 --2- 172.21.15.103:0/125806337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f392006be40 0x7f39201f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 >> 172.21.15.103:0/125806337 conn(0x7f39200cd7e0 msgr2=0x7f39200b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 shutdown_connections 2024-08-18T23:58:10.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.339+0000 7f3924d6f640 1 -- 172.21.15.103:0/125806337 wait complete. 2024-08-18T23:58:10.351 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-08-18T23:58:10.179922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221036,"kb_used_data":4856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753684,"statfs":{"total":773094113280,"available":772867772416,"internally_reserved":0,"allocated":4972544,"data_stored":2823135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24260,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-3,"num_read_kb":-1,"num_write":-100,"num_write_kb":-61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.411818"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-18T23:58:06.809961+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:58:06.809961+0000","last_peered":"2024-08-18T23:58:06.809961+0000","last_clean":"2024-08-18T23:58:06.809961+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:58:06.809961+0000","last_undegraded":"2024-08-18T23:58:06.809961+0000","last_fullsized":"2024-08-18T23:58:06.809961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":799391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":793434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:58:10.351 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-18T23:58:10.352 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:58:10.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.449+0000 7fe035c17640 1 Processor -- start 2024-08-18T23:58:10.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.449+0000 7fe035c17640 1 -- start start 2024-08-18T23:58:10.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.449+0000 7fe035c17640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0300d4bc0 0x7fe0300d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.449+0000 7fe035c17640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe030160090 0x7fe030160520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.449+0000 7fe035c17640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0300d0860 con 0x7fe03015f8a0 2024-08-18T23:58:10.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.449+0000 7fe035c17640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe0300cfc00 con 0x7fe0300d4bc0 2024-08-18T23:58:10.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.449+0000 7fe035c17640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe0300b32c0 con 0x7fe030160090 2024-08-18T23:58:10.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.450+0000 7fe02effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0300d4bc0 0x7fe0300d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.450+0000 7fe02effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe0300d4bc0 0x7fe0300d11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37164/0 (socket says 172.21.15.103:37164) 2024-08-18T23:58:10.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.450+0000 7fe02effd640 1 -- 172.21.15.103:0/61635499 learned_addr learned my addr 172.21.15.103:0/61635499 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:10.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.450+0000 7fe02ffff640 1 --2- 172.21.15.103:0/61635499 >> v2:172.21.15.190:3300/0 conn(0x7fe030160090 0x7fe030160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.450+0000 7fe02effd640 1 -- 172.21.15.103:0/61635499 >> v2:172.21.15.190:3300/0 conn(0x7fe030160090 msgr2=0x7fe030160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:10.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.450+0000 7fe02effd640 1 --2- 172.21.15.103:0/61635499 >> v2:172.21.15.190:3300/0 conn(0x7fe030160090 0x7fe030160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.450+0000 7fe02effd640 1 -- 172.21.15.103:0/61635499 >> v1:172.21.15.190:6789/0 conn(0x7fe03015f8a0 legacy=0x7fe0300d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.450+0000 7fe02effd640 1 -- 172.21.15.103:0/61635499 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0300d0090 con 0x7fe0300d4bc0 2024-08-18T23:58:10.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe02effd640 1 --2- 172.21.15.103:0/61635499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0300d4bc0 0x7fe0300d11c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe0300b5b40 tx=0x7fe02402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f259f49016ca73 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe02e7fc640 1 -- 172.21.15.103:0/61635499 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024037070 con 0x7fe0300d4bc0 2024-08-18T23:58:10.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe02e7fc640 1 -- 172.21.15.103:0/61635499 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024032440 con 0x7fe0300d4bc0 2024-08-18T23:58:10.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe02e7fc640 1 -- 172.21.15.103:0/61635499 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024032810 con 0x7fe0300d4bc0 2024-08-18T23:58:10.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe035c17640 1 -- 172.21.15.103:0/61635499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0300d4bc0 msgr2=0x7fe0300d11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe035c17640 1 --2- 172.21.15.103:0/61635499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0300d4bc0 0x7fe0300d11c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe0300b5b40 tx=0x7fe02402a270 comp rx=0 tx=0).stop 2024-08-18T23:58:10.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe035c17640 1 -- 172.21.15.103:0/61635499 shutdown_connections 2024-08-18T23:58:10.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe035c17640 1 --2- 172.21.15.103:0/61635499 >> v2:172.21.15.190:3300/0 conn(0x7fe030160090 0x7fe030160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe035c17640 1 --2- 172.21.15.103:0/61635499 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe0300d4bc0 0x7fe0300d11c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe035c17640 1 -- 172.21.15.103:0/61635499 >> 172.21.15.103:0/61635499 conn(0x7fe0300d40a0 msgr2=0x7fe0300d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:10.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe035c17640 1 -- 172.21.15.103:0/61635499 shutdown_connections 2024-08-18T23:58:10.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.451+0000 7fe035c17640 1 -- 172.21.15.103:0/61635499 wait complete. 2024-08-18T23:58:10.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.453+0000 7fe035c17640 1 Processor -- start 2024-08-18T23:58:10.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.453+0000 7fe035c17640 1 -- start start 2024-08-18T23:58:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.453+0000 7fe035c17640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0300d4bc0 0x7fe0301f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.453+0000 7fe035c17640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe03015f8a0 0x7fe0300b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.453+0000 7fe035c17640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030160090 0x7fe0300b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.453+0000 7fe035c17640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe0300b2fb0 con 0x7fe03015f8a0 2024-08-18T23:58:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.453+0000 7fe035c17640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe0300cf890 con 0x7fe030160090 2024-08-18T23:58:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.453+0000 7fe035c17640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe03015fc80 con 0x7fe0300d4bc0 2024-08-18T23:58:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe03015f8a0 0x7fe0300b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe03015f8a0 0x7fe0300b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37172/0 (socket says 172.21.15.103:37172) 2024-08-18T23:58:10.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 -- 172.21.15.103:0/2797140484 learned_addr learned my addr 172.21.15.103:0/2797140484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:10.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02f7fe640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0300d4bc0 0x7fe0301f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02ffff640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030160090 0x7fe0300b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 -- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0300d4bc0 msgr2=0x7fe0301f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0300d4bc0 0x7fe0301f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 -- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030160090 msgr2=0x7fe0300b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030160090 0x7fe0300b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 -- 172.21.15.103:0/2797140484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0300c8410 con 0x7fe03015f8a0 2024-08-18T23:58:10.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02ffff640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030160090 0x7fe0300b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:10.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe02effd640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe03015f8a0 0x7fe0300b39e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe02402a2b0 tx=0x7fe0240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe017fff640 1 -- 172.21.15.103:0/2797140484 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024041020 con 0x7fe03015f8a0 2024-08-18T23:58:10.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe017fff640 1 -- 172.21.15.103:0/2797140484 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0240306c0 con 0x7fe03015f8a0 2024-08-18T23:58:10.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0300c86f0 con 0x7fe03015f8a0 2024-08-18T23:58:10.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe017fff640 1 -- 172.21.15.103:0/2797140484 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024037040 con 0x7fe03015f8a0 2024-08-18T23:58:10.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.454+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0300c8cb0 con 0x7fe03015f8a0 2024-08-18T23:58:10.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.455+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe030160520 con 0x7fe03015f8a0 2024-08-18T23:58:10.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.456+0000 7fe017fff640 1 -- 172.21.15.103:0/2797140484 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe024044020 con 0x7fe03015f8a0 2024-08-18T23:58:10.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.456+0000 7fe017fff640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe01c06be30 0x7fe01c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.456+0000 7fe017fff640 1 -- 172.21.15.103:0/2797140484 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fe0240ab4a0 con 0x7fe03015f8a0 2024-08-18T23:58:10.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.456+0000 7fe02f7fe640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe01c06be30 0x7fe01c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.456+0000 7fe02f7fe640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe01c06be30 0x7fe01c06e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe020007fd0 tx=0x7fe020009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.460+0000 7fe017fff640 1 -- 172.21.15.103:0/2797140484 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fe02404b030 con 0x7fe03015f8a0 2024-08-18T23:58:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.622+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe03015cc70 con 0x7fe01c06be30 2024-08-18T23:58:10.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.623+0000 7fe017fff640 1 -- 172.21.15.103:0/2797140484 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7fe03015cc70 con 0x7fe01c06be30 2024-08-18T23:58:10.625 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:10.625 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:58:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe01c06be30 msgr2=0x7fe01c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe01c06be30 0x7fe01c06e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe020007fd0 tx=0x7fe020009040 comp rx=0 tx=0).stop 2024-08-18T23:58:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe03015f8a0 msgr2=0x7fe0300b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe03015f8a0 0x7fe0300b39e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe02402a2b0 tx=0x7fe0240046c0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 shutdown_connections 2024-08-18T23:58:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe01c06be30 0x7fe01c06e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe030160090 0x7fe0300b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe03015f8a0 0x7fe0300b39e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 --2- 172.21.15.103:0/2797140484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0300d4bc0 0x7fe0301f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 >> 172.21.15.103:0/2797140484 conn(0x7fe0300d40a0 msgr2=0x7fe0301540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 shutdown_connections 2024-08-18T23:58:10.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.625+0000 7fe035c17640 1 -- 172.21.15.103:0/2797140484 wait complete. 2024-08-18T23:58:10.637 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-08-18T23:58:10.179922+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221036,"kb_used_data":4856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753684,"statfs":{"total":773094113280,"available":772867772416,"internally_reserved":0,"allocated":4972544,"data_stored":2823135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-24260,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-3,"num_read_kb":-1,"num_write":-100,"num_write_kb":-61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.411818"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-18T23:58:06.809961+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:58:06.809961+0000","last_peered":"2024-08-18T23:58:06.809961+0000","last_clean":"2024-08-18T23:58:06.809961+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:58:06.809961+0000","last_undegraded":"2024-08-18T23:58:06.809961+0000","last_fullsized":"2024-08-18T23:58:06.809961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":799391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":203066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":793434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:58:10.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-18T23:58:10.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.735+0000 7fa25e925640 1 Processor -- start 2024-08-18T23:58:10.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.735+0000 7fa25e925640 1 -- start start 2024-08-18T23:58:10.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa25e925640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa25806f770 0x7fa2580ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa25e925640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa2580b4370 0x7fa2580adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa25e925640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa258072610 con 0x7fa25815ade0 2024-08-18T23:58:10.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa25e925640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fa25806db10 con 0x7fa2580b4370 2024-08-18T23:58:10.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa25e925640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa25815b1c0 con 0x7fa25806f770 2024-08-18T23:58:10.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa25cec2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa2580b4370 0x7fa2580adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa25cec2640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa2580b4370 0x7fa2580adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37188/0 (socket says 172.21.15.103:37188) 2024-08-18T23:58:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa25cec2640 1 -- 172.21.15.103:0/1184037809 learned_addr learned my addr 172.21.15.103:0/1184037809 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.736+0000 7fa257fff640 1 --1- 172.21.15.103:0/1184037809 >> v1:172.21.15.103:6789/0 conn(0x7fa25815ade0 0x7fa25806f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57960/0 (socket says 172.21.15.103:57960) 2024-08-18T23:58:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.737+0000 7fa2577fe640 1 --2- 172.21.15.103:0/1184037809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa25806f770 0x7fa2580ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.737+0000 7fa25cec2640 1 -- 172.21.15.103:0/1184037809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa25806f770 msgr2=0x7fa2580ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.737+0000 7fa25cec2640 1 --2- 172.21.15.103:0/1184037809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa25806f770 0x7fa2580ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.737+0000 7fa25cec2640 1 -- 172.21.15.103:0/1184037809 >> v1:172.21.15.103:6789/0 conn(0x7fa25815ade0 legacy=0x7fa25806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.737+0000 7fa256ffd640 1 -- 172.21.15.103:0/1184037809 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3702235852 0 0) 0x7fa258072610 con 0x7fa25815ade0 2024-08-18T23:58:10.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.737+0000 7fa25cec2640 1 -- 172.21.15.103:0/1184037809 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2580728f0 con 0x7fa2580b4370 2024-08-18T23:58:10.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.737+0000 7fa25cec2640 1 --2- 172.21.15.103:0/1184037809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2580b4370 0x7fa2580adf10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa250009e50 tx=0x7fa25002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1a60811f059c32 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa256ffd640 1 -- 172.21.15.103:0/1184037809 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250036070 con 0x7fa2580b4370 2024-08-18T23:58:10.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa256ffd640 1 -- 172.21.15.103:0/1184037809 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa250031600 con 0x7fa2580b4370 2024-08-18T23:58:10.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa256ffd640 1 -- 172.21.15.103:0/1184037809 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2500319d0 con 0x7fa2580b4370 2024-08-18T23:58:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa25e925640 1 -- 172.21.15.103:0/1184037809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2580b4370 msgr2=0x7fa2580adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa25e925640 1 --2- 172.21.15.103:0/1184037809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2580b4370 0x7fa2580adf10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa250009e50 tx=0x7fa25002a680 comp rx=0 tx=0).stop 2024-08-18T23:58:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa25e925640 1 -- 172.21.15.103:0/1184037809 shutdown_connections 2024-08-18T23:58:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa25e925640 1 --2- 172.21.15.103:0/1184037809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2580b4370 0x7fa2580adf10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa25e925640 1 --2- 172.21.15.103:0/1184037809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa25806f770 0x7fa2580ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa25e925640 1 -- 172.21.15.103:0/1184037809 >> 172.21.15.103:0/1184037809 conn(0x7fa2580cfc40 msgr2=0x7fa2580d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa25e925640 1 -- 172.21.15.103:0/1184037809 shutdown_connections 2024-08-18T23:58:10.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.738+0000 7fa25e925640 1 -- 172.21.15.103:0/1184037809 wait complete. 2024-08-18T23:58:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.739+0000 7fa25e925640 1 Processor -- start 2024-08-18T23:58:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa25e925640 1 -- start start 2024-08-18T23:58:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa25e925640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25806f770 0x7fa25815c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa25e925640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2580b4370 0x7fa2581577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa25e925640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa25815ade0 0x7fa258152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa25e925640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa25806d6c0 con 0x7fa25806f770 2024-08-18T23:58:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa25e925640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa258072eb0 con 0x7fa25815ade0 2024-08-18T23:58:10.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa25e925640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa25806d840 con 0x7fa2580b4370 2024-08-18T23:58:10.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa257fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25806f770 0x7fa25815c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa257fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25806f770 0x7fa25815c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37202/0 (socket says 172.21.15.103:37202) 2024-08-18T23:58:10.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa257fff640 1 -- 172.21.15.103:0/3445622475 learned_addr learned my addr 172.21.15.103:0/3445622475 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:10.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa2577fe640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2580b4370 0x7fa2581577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.740+0000 7fa25cec2640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa25815ade0 0x7fa258152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa257fff640 1 -- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2580b4370 msgr2=0x7fa2581577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa257fff640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2580b4370 0x7fa2581577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa257fff640 1 -- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa25815ade0 msgr2=0x7fa258152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa257fff640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa25815ade0 0x7fa258152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa257fff640 1 -- 172.21.15.103:0/3445622475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25815ca80 con 0x7fa25806f770 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa25cec2640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa25815ade0 0x7fa258152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa257fff640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25806f770 0x7fa25815c190 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa24800c460 tx=0x7fa24800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa254ff9640 1 -- 172.21.15.103:0/3445622475 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248018070 con 0x7fa25806f770 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa254ff9640 1 -- 172.21.15.103:0/3445622475 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa248007500 con 0x7fa25806f770 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25815cd60 con 0x7fa25806f770 2024-08-18T23:58:10.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa254ff9640 1 -- 172.21.15.103:0/3445622475 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248004a20 con 0x7fa25806f770 2024-08-18T23:58:10.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.741+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25815c6d0 con 0x7fa25806f770 2024-08-18T23:58:10.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.742+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2580b47b0 con 0x7fa25806f770 2024-08-18T23:58:10.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.742+0000 7fa254ff9640 1 -- 172.21.15.103:0/3445622475 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa24801b070 con 0x7fa25806f770 2024-08-18T23:58:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.743+0000 7fa254ff9640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa24406be30 0x7fa24406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.743+0000 7fa254ff9640 1 -- 172.21.15.103:0/3445622475 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fa248089e60 con 0x7fa25806f770 2024-08-18T23:58:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.743+0000 7fa2577fe640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa24406be30 0x7fa24406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.743+0000 7fa2577fe640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa24406be30 0x7fa24406e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa2581f52a0 tx=0x7fa24c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:10.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.747+0000 7fa254ff9640 1 -- 172.21.15.103:0/3445622475 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7fa2480583c0 con 0x7fa25806f770 2024-08-18T23:58:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.914+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2580af300 con 0x7fa25806f770 2024-08-18T23:58:10.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.914+0000 7fa254ff9640 1 -- 172.21.15.103:0/3445622475 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+13329 (secure 0 0 0) 0x7fa24805c6c0 con 0x7fa25806f770 2024-08-18T23:58:10.916 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:10.916 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":41,"fsid":"c396ba9f-4334-441d-8e0e-0892ec29262b","created":"2024-08-18T23:56:30.037763+0000","modified":"2024-08-18T23:58:06.801237+0000","last_up_change":"2024-08-18T23:56:41.243694+0000","last_in_change":"2024-08-18T23:56:32.151302+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-18T23:56:42.194634+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b1f9a3a-f06c-433c-82ff-713f4b6795f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6809","nonce":927187765}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6811","nonce":927187765}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6815","nonce":927187765}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":927187765},{"type":"v1","addr":"172.21.15.103:6813","nonce":927187765}]},"public_addr":"172.21.15.103:6809/927187765","cluster_addr":"172.21.15.103:6811/927187765","heartbeat_back_addr":"172.21.15.103:6815/927187765","heartbeat_front_addr":"172.21.15.103:6813/927187765","state":["exists","up"]},{"osd":1,"uuid":"b4ee0121-2a73-4e8f-ac53-6d6e3fb46c96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6801","nonce":3370631755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6803","nonce":3370631755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6807","nonce":3370631755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":3370631755},{"type":"v1","addr":"172.21.15.103:6805","nonce":3370631755}]},"public_addr":"172.21.15.103:6801/3370631755","cluster_addr":"172.21.15.103:6803/3370631755","heartbeat_back_addr":"172.21.15.103:6807/3370631755","heartbeat_front_addr":"172.21.15.103:6805/3370631755","state":["exists","up"]},{"osd":2,"uuid":"6f95c531-a160-44bb-ba3b-cb14c0d8211e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6825","nonce":1313986771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6827","nonce":1313986771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6831","nonce":1313986771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1313986771},{"type":"v1","addr":"172.21.15.103:6829","nonce":1313986771}]},"public_addr":"172.21.15.103:6825/1313986771","cluster_addr":"172.21.15.103:6827/1313986771","heartbeat_back_addr":"172.21.15.103:6831/1313986771","heartbeat_front_addr":"172.21.15.103:6829/1313986771","state":["exists","up"]},{"osd":3,"uuid":"3bec0691-db8a-4585-b836-a7514d5f4608","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6817","nonce":2012367824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6819","nonce":2012367824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6823","nonce":2012367824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2012367824},{"type":"v1","addr":"172.21.15.103:6821","nonce":2012367824}]},"public_addr":"172.21.15.103:6817/2012367824","cluster_addr":"172.21.15.103:6819/2012367824","heartbeat_back_addr":"172.21.15.103:6823/2012367824","heartbeat_front_addr":"172.21.15.103:6821/2012367824","state":["exists","up"]},{"osd":4,"uuid":"1ebcbeef-b261-4928-aaac-bcfc4f059480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6817","nonce":491823420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6819","nonce":491823420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6823","nonce":491823420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":491823420},{"type":"v1","addr":"172.21.15.190:6821","nonce":491823420}]},"public_addr":"172.21.15.190:6817/491823420","cluster_addr":"172.21.15.190:6819/491823420","heartbeat_back_addr":"172.21.15.190:6823/491823420","heartbeat_front_addr":"172.21.15.190:6821/491823420","state":["exists","up"]},{"osd":5,"uuid":"7c35f08e-6a41-4c0a-b689-f1b0f8f502c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6801","nonce":1802306472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6803","nonce":1802306472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6807","nonce":1802306472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":1802306472},{"type":"v1","addr":"172.21.15.190:6805","nonce":1802306472}]},"public_addr":"172.21.15.190:6801/1802306472","cluster_addr":"172.21.15.190:6803/1802306472","heartbeat_back_addr":"172.21.15.190:6807/1802306472","heartbeat_front_addr":"172.21.15.190:6805/1802306472","state":["exists","up"]},{"osd":6,"uuid":"89517b57-3fe1-4fce-ab99-9bd7459c26cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6825","nonce":1150487598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6827","nonce":1150487598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6831","nonce":1150487598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":1150487598},{"type":"v1","addr":"172.21.15.190:6829","nonce":1150487598}]},"public_addr":"172.21.15.190:6825/1150487598","cluster_addr":"172.21.15.190:6827/1150487598","heartbeat_back_addr":"172.21.15.190:6831/1150487598","heartbeat_front_addr":"172.21.15.190:6829/1150487598","state":["exists","up"]},{"osd":7,"uuid":"ea9953da-93fc-481f-bf91-afcbaa141807","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6809","nonce":3667598505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6811","nonce":3667598505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6815","nonce":3667598505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":3667598505},{"type":"v1","addr":"172.21.15.190:6813","nonce":3667598505}]},"public_addr":"172.21.15.190:6809/3667598505","cluster_addr":"172.21.15.190:6811/3667598505","heartbeat_back_addr":"172.21.15.190:6815/3667598505","heartbeat_front_addr":"172.21.15.190:6813/3667598505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.303111+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.277216+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.305082+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.355425+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.300945+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.283904+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.344864+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-18T23:56:37.240190+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6835/171106802":"2024-08-19T23:58:03.763708+0000","172.21.15.103:6834/171106802":"2024-08-19T23:58:03.763708+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-18T23:58:10.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa24406be30 msgr2=0x7fa24406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa24406be30 0x7fa24406e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa2581f52a0 tx=0x7fa24c009190 comp rx=0 tx=0).stop 2024-08-18T23:58:10.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25806f770 msgr2=0x7fa25815c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:10.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25806f770 0x7fa25815c190 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa24800c460 tx=0x7fa24800c920 comp rx=0 tx=0).stop 2024-08-18T23:58:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 shutdown_connections 2024-08-18T23:58:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fa24406be30 0x7fa24406e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa25815ade0 0x7fa258152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2580b4370 0x7fa2581577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 --2- 172.21.15.103:0/3445622475 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa25806f770 0x7fa25815c190 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.916+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 >> 172.21.15.103:0/3445622475 conn(0x7fa2580cfc40 msgr2=0x7fa2580ad8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.917+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 shutdown_connections 2024-08-18T23:58:10.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:10.917+0000 7fa25e925640 1 -- 172.21.15.103:0/3445622475 wait complete. 2024-08-18T23:58:11.930 INFO:tasks.ceph:Scrubbing osd.0 2024-08-18T23:58:11.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-18T23:58:12.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.044+0000 7f81b7da8640 1 Processor -- start 2024-08-18T23:58:12.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.044+0000 7f81b7da8640 1 -- start start 2024-08-18T23:58:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.045+0000 7f81b7da8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 0x7f81b00b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.045+0000 7f81b7da8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b0073940 con 0x7f81b006de10 2024-08-18T23:58:12.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.045+0000 7f81b7da8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81b006e430 con 0x7f81b00b3ac0 2024-08-18T23:58:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.045+0000 7f81b7da8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f81b00b3f20 con 0x7f81b0073560 2024-08-18T23:58:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.045+0000 7f81b6345640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f81b006de10 0x7f81b0071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57968/0 (socket says 172.21.15.103:57968) 2024-08-18T23:58:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.045+0000 7f81b6345640 1 -- 172.21.15.103:0/2451813461 learned_addr learned my addr 172.21.15.103:0/2451813461 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.045+0000 7f81b5b44640 1 --2- 172.21.15.103:0/2451813461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 0x7f81b00b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.046+0000 7f81b4b42640 1 -- 172.21.15.103:0/2451813461 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403576918 0 0) 0x7f81b0073940 con 0x7f81b006de10 2024-08-18T23:58:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.046+0000 7f81b4b42640 1 -- 172.21.15.103:0/2451813461 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f819c003520 con 0x7f81b006de10 2024-08-18T23:58:12.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.046+0000 7f81b4b42640 1 -- 172.21.15.103:0/2451813461 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1615460885 0 0) 0x7f81b006e430 con 0x7f81b00b3ac0 2024-08-18T23:58:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.046+0000 7f81b4b42640 1 -- 172.21.15.103:0/2451813461 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81b0073940 con 0x7f81b00b3ac0 2024-08-18T23:58:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.046+0000 7f81b5b44640 1 -- 172.21.15.103:0/2451813461 >> v1:172.21.15.190:6789/0 conn(0x7f81b00b3ac0 legacy=0x7f81b006d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.046+0000 7f81b5b44640 1 -- 172.21.15.103:0/2451813461 >> v1:172.21.15.103:6789/0 conn(0x7f81b006de10 legacy=0x7f81b0071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.046+0000 7f81b5b44640 1 -- 172.21.15.103:0/2451813461 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b006e710 con 0x7f81b0073560 2024-08-18T23:58:12.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b5b44640 1 --2- 172.21.15.103:0/2451813461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 0x7f81b00b3580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81a400a970 tx=0x7f81a402a4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7428e24d7fa0d24c server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b4b42640 1 -- 172.21.15.103:0/2451813461 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a400b040 con 0x7f81b0073560 2024-08-18T23:58:12.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b4b42640 1 -- 172.21.15.103:0/2451813461 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a402f710 con 0x7f81b0073560 2024-08-18T23:58:12.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b4b42640 1 -- 172.21.15.103:0/2451813461 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a402fac0 con 0x7f81b0073560 2024-08-18T23:58:12.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b7da8640 1 -- 172.21.15.103:0/2451813461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 msgr2=0x7f81b00b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b7da8640 1 --2- 172.21.15.103:0/2451813461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 0x7f81b00b3580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81a400a970 tx=0x7f81a402a4c0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b7da8640 1 -- 172.21.15.103:0/2451813461 shutdown_connections 2024-08-18T23:58:12.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b7da8640 1 --2- 172.21.15.103:0/2451813461 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 0x7f81b00b3580 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.047+0000 7f81b7da8640 1 -- 172.21.15.103:0/2451813461 >> 172.21.15.103:0/2451813461 conn(0x7f81b006bae0 msgr2=0x7f81b006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.048+0000 7f81b7da8640 1 -- 172.21.15.103:0/2451813461 shutdown_connections 2024-08-18T23:58:12.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.048+0000 7f81b7da8640 1 -- 172.21.15.103:0/2451813461 wait complete. 2024-08-18T23:58:12.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.049+0000 7f81b7da8640 1 Processor -- start 2024-08-18T23:58:12.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.049+0000 7f81b7da8640 1 -- start start 2024-08-18T23:58:12.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b7da8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b006de10 0x7f81b0152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b7da8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 0x7f81b00c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b7da8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b00b3ac0 0x7f81b01594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b7da8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f81b006efb0 con 0x7f81b00b3ac0 2024-08-18T23:58:12.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b7da8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f81b006ecd0 con 0x7f81b006de10 2024-08-18T23:58:12.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b7da8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f81b00cfec0 con 0x7f81b0073560 2024-08-18T23:58:12.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b00b3ac0 0x7f81b01594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b00b3ac0 0x7f81b01594f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37214/0 (socket says 172.21.15.103:37214) 2024-08-18T23:58:12.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 -- 172.21.15.103:0/4019632575 learned_addr learned my addr 172.21.15.103:0/4019632575 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:12.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b5b44640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b006de10 0x7f81b0152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b5343640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 0x7f81b00c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 -- 172.21.15.103:0/4019632575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 msgr2=0x7f81b00c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b0073560 0x7f81b00c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 -- 172.21.15.103:0/4019632575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b006de10 msgr2=0x7f81b0152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b006de10 0x7f81b0152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 -- 172.21.15.103:0/4019632575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b00c5820 con 0x7f81b00b3ac0 2024-08-18T23:58:12.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b6345640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b00b3ac0 0x7f81b01594f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f81a800cb70 tx=0x7f81a800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8017070 con 0x7f81b00b3ac0 2024-08-18T23:58:12.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a800ad60 con 0x7f81b00b3ac0 2024-08-18T23:58:12.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b00c5b00 con 0x7f81b00b3ac0 2024-08-18T23:58:12.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8012640 con 0x7f81b00b3ac0 2024-08-18T23:58:12.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.050+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b009cad0 con 0x7f81b00b3ac0 2024-08-18T23:58:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.051+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81b00c55d0 con 0x7f81b00b3ac0 2024-08-18T23:58:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.052+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81a801a070 con 0x7f81b00b3ac0 2024-08-18T23:58:12.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.052+0000 7f81a27fc640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f819406be30 0x7f819406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.052+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f81a808aa60 con 0x7f81b00b3ac0 2024-08-18T23:58:12.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.053+0000 7f81b5b44640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f819406be30 0x7f819406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.053+0000 7f81a27fc640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f81940722d0 0x7f8194074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.053+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 --> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8194074de0 con 0x7f81940722d0 2024-08-18T23:58:12.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.053+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f81a808f2c0 con 0x7f81b00b3ac0 2024-08-18T23:58:12.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.053+0000 7f81b5343640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f81940722d0 0x7f8194074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.053+0000 7f81b5b44640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f819406be30 0x7f819406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f81a4034000 tx=0x7f81a400c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.053+0000 7f81b5343640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f81940722d0 0x7f8194074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.054+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 <== osd.0 v2:172.21.15.103:6808/927187765 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8194074de0 con 0x7f81940722d0 2024-08-18T23:58:12.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.066+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 --> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f81b00d02c0 con 0x7f81940722d0 2024-08-18T23:58:12.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.066+0000 7f81a27fc640 1 -- 172.21.15.103:0/4019632575 <== osd.0 v2:172.21.15.103:6808/927187765 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f81b00d02c0 con 0x7f81940722d0 2024-08-18T23:58:12.068 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:58:12.068 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T23:58:12.068 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:58:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f81940722d0 msgr2=0x7f8194074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6808/927187765,v1:172.21.15.103:6809/927187765] conn(0x7f81940722d0 0x7f8194074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f819406be30 msgr2=0x7f819406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f819406be30 0x7f819406e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f81a4034000 tx=0x7f81a400c040 comp rx=0 tx=0).stop 2024-08-18T23:58:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b00b3ac0 msgr2=0x7f81b01594f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 --2- 172.21.15.103:0/4019632575 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81b00b3ac0 0x7f81b01594f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f81a800cb70 tx=0x7f81a800a430 comp rx=0 tx=0).stop 2024-08-18T23:58:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b6345640 1 -- 172.21.15.103:0/4019632575 reap_dead start 2024-08-18T23:58:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 shutdown_connections 2024-08-18T23:58:12.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 >> 172.21.15.103:0/4019632575 conn(0x7f81b006bae0 msgr2=0x7f81b0153910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 shutdown_connections 2024-08-18T23:58:12.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.067+0000 7f81b7da8640 1 -- 172.21.15.103:0/4019632575 wait complete. 2024-08-18T23:58:12.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-18T23:58:12.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.178+0000 7f10bada8640 1 Processor -- start 2024-08-18T23:58:12.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.178+0000 7f10bada8640 1 -- start start 2024-08-18T23:58:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.179+0000 7f10bada8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b415e3b0 0x7f10b40d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.179+0000 7f10bada8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10b40b4a10 0x7f10b40d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.179+0000 7f10bada8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b40d4e10 con 0x7f10b40d21b0 2024-08-18T23:58:12.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.179+0000 7f10bada8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f10b40d4bc0 con 0x7f10b40b4a10 2024-08-18T23:58:12.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.179+0000 7f10bada8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f10b40cf960 con 0x7f10b415e3b0 2024-08-18T23:58:12.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.179+0000 7f10b9345640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10b40b4a10 0x7f10b40d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.179+0000 7f10b9345640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f10b40b4a10 0x7f10b40d2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37218/0 (socket says 172.21.15.103:37218) 2024-08-18T23:58:12.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.179+0000 7f10b9345640 1 -- 172.21.15.103:0/2939348070 learned_addr learned my addr 172.21.15.103:0/2939348070 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:12.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.180+0000 7f10b8b44640 1 --2- 172.21.15.103:0/2939348070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b415e3b0 0x7f10b40d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.180+0000 7f10b9345640 1 -- 172.21.15.103:0/2939348070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b415e3b0 msgr2=0x7f10b40d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.180+0000 7f10b9345640 1 --2- 172.21.15.103:0/2939348070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b415e3b0 0x7f10b40d2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.180+0000 7f10b9345640 1 -- 172.21.15.103:0/2939348070 >> v1:172.21.15.103:6789/0 conn(0x7f10b40d21b0 legacy=0x7f10b40d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.180+0000 7f10b9345640 1 -- 172.21.15.103:0/2939348070 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b40cfbb0 con 0x7f10b40b4a10 2024-08-18T23:58:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.181+0000 7f10b9345640 1 --2- 172.21.15.103:0/2939348070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b40d2c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009e50 tx=0x7f10ac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d13e19cd4669b server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.181+0000 7f10b37fe640 1 -- 172.21.15.103:0/2939348070 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac036070 con 0x7f10b40b4a10 2024-08-18T23:58:12.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.181+0000 7f10b37fe640 1 -- 172.21.15.103:0/2939348070 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10ac031600 con 0x7f10b40b4a10 2024-08-18T23:58:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.181+0000 7f10b37fe640 1 -- 172.21.15.103:0/2939348070 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0319d0 con 0x7f10b40b4a10 2024-08-18T23:58:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.181+0000 7f10bada8640 1 -- 172.21.15.103:0/2939348070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 msgr2=0x7f10b40d2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.181+0000 7f10bada8640 1 --2- 172.21.15.103:0/2939348070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b40d2c40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009e50 tx=0x7f10ac02a710 comp rx=0 tx=0).stop 2024-08-18T23:58:12.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.182+0000 7f10bada8640 1 -- 172.21.15.103:0/2939348070 shutdown_connections 2024-08-18T23:58:12.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.182+0000 7f10bada8640 1 --2- 172.21.15.103:0/2939348070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b40d2c40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.182+0000 7f10bada8640 1 --2- 172.21.15.103:0/2939348070 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b415e3b0 0x7f10b40d2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.182+0000 7f10bada8640 1 -- 172.21.15.103:0/2939348070 >> 172.21.15.103:0/2939348070 conn(0x7f10b40d40a0 msgr2=0x7f10b40d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.182+0000 7f10bada8640 1 -- 172.21.15.103:0/2939348070 shutdown_connections 2024-08-18T23:58:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.182+0000 7f10bada8640 1 -- 172.21.15.103:0/2939348070 wait complete. 2024-08-18T23:58:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.183+0000 7f10bada8640 1 Processor -- start 2024-08-18T23:58:12.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.183+0000 7f10bada8640 1 -- start start 2024-08-18T23:58:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10bada8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b41534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10bada8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b40d21b0 0x7f10b409f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10bada8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10b415e3b0 0x7f10b40cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10bada8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10b415e790 con 0x7f10b40b4a10 2024-08-18T23:58:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10bada8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f10b40d0200 con 0x7f10b415e3b0 2024-08-18T23:58:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10bada8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f10b415e910 con 0x7f10b40d21b0 2024-08-18T23:58:12.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b41534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b41534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37222/0 (socket says 172.21.15.103:37222) 2024-08-18T23:58:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 -- 172.21.15.103:0/4218706806 learned_addr learned my addr 172.21.15.103:0/4218706806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b9345640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10b415e3b0 0x7f10b40cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b3fff640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b40d21b0 0x7f10b409f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 -- 172.21.15.103:0/4218706806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b40d21b0 msgr2=0x7f10b409f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b40d21b0 0x7f10b409f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 -- 172.21.15.103:0/4218706806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10b415e3b0 msgr2=0x7f10b40cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10b415e3b0 0x7f10b40cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 -- 172.21.15.103:0/4218706806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b409e120 con 0x7f10b40b4a10 2024-08-18T23:58:12.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.184+0000 7f10b8b44640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b41534a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10a800d5f0 tx=0x7f10a800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.185+0000 7f10b17fa640 1 -- 172.21.15.103:0/4218706806 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80125f0 con 0x7f10b40b4a10 2024-08-18T23:58:12.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.185+0000 7f10b17fa640 1 -- 172.21.15.103:0/4218706806 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a8019070 con 0x7f10b40b4a10 2024-08-18T23:58:12.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.185+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b409e400 con 0x7f10b40b4a10 2024-08-18T23:58:12.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.185+0000 7f10b17fa640 1 -- 172.21.15.103:0/4218706806 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a80129d0 con 0x7f10b40b4a10 2024-08-18T23:58:12.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.185+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b409e9c0 con 0x7f10b40b4a10 2024-08-18T23:58:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.186+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b40b3000 con 0x7f10b40b4a10 2024-08-18T23:58:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.186+0000 7f10b17fa640 1 -- 172.21.15.103:0/4218706806 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f10a8012b70 con 0x7f10b40b4a10 2024-08-18T23:58:12.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.187+0000 7f10b17fa640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f109806be30 0x7f109806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.187+0000 7f10b17fa640 1 -- 172.21.15.103:0/4218706806 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f10a808aef0 con 0x7f10b40b4a10 2024-08-18T23:58:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.187+0000 7f10b3fff640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f109806be30 0x7f109806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.187+0000 7f10b3fff640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f109806be30 0x7f109806e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10b4157010 tx=0x7f10a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.195+0000 7f10b17fa640 1 -- 172.21.15.103:0/4218706806 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f10a8059450 con 0x7f10b40b4a10 2024-08-18T23:58:12.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.371+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f10b4068df0 con 0x7f109806be30 2024-08-18T23:58:12.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.371+0000 7f10b17fa640 1 -- 172.21.15.103:0/4218706806 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f10b4068df0 con 0x7f109806be30 2024-08-18T23:58:12.373 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 0 to deep-scrub 2024-08-18T23:58:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f109806be30 msgr2=0x7f109806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f109806be30 0x7f109806e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10b4157010 tx=0x7f10a0009040 comp rx=0 tx=0).stop 2024-08-18T23:58:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 msgr2=0x7f10b41534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b41534a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10a800d5f0 tx=0x7f10a800dab0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 shutdown_connections 2024-08-18T23:58:12.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f109806be30 0x7f109806e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10b415e3b0 0x7f10b40cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10b40d21b0 0x7f10b409f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 --2- 172.21.15.103:0/4218706806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10b40b4a10 0x7f10b41534a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 >> 172.21.15.103:0/4218706806 conn(0x7f10b40d40a0 msgr2=0x7f10b40b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 shutdown_connections 2024-08-18T23:58:12.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.374+0000 7f10bada8640 1 -- 172.21.15.103:0/4218706806 wait complete. 2024-08-18T23:58:12.387 INFO:tasks.ceph:Scrubbing osd.1 2024-08-18T23:58:12.387 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-18T23:58:12.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.490+0000 7f367fecb640 1 Processor -- start 2024-08-18T23:58:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.490+0000 7f367fecb640 1 -- start start 2024-08-18T23:58:12.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.491+0000 7f367fecb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f36780b3580 0x7f36780b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.491+0000 7f367fecb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 0x7f367806db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.491+0000 7f367fecb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3678073940 con 0x7f3678073560 2024-08-18T23:58:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.491+0000 7f367fecb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f36780d05d0 con 0x7f36780b3580 2024-08-18T23:58:12.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.491+0000 7f367fecb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f36780b3f20 con 0x7f367806d700 2024-08-18T23:58:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367e468640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 0x7f367806db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367d466640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f36780b3580 0x7f36780b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367dc67640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f3678073560 0x7f36780cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:40010/0 (socket says 172.21.15.103:40010) 2024-08-18T23:58:12.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367dc67640 1 -- 172.21.15.103:0/1801931656 learned_addr learned my addr 172.21.15.103:0/1801931656 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367d466640 1 -- 172.21.15.103:0/1801931656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 msgr2=0x7f367806db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367d466640 1 --2- 172.21.15.103:0/1801931656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 0x7f367806db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367d466640 1 -- 172.21.15.103:0/1801931656 >> v1:172.21.15.190:6789/0 conn(0x7f3678073560 legacy=0x7f36780cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367d466640 1 -- 172.21.15.103:0/1801931656 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367806e430 con 0x7f36780b3580 2024-08-18T23:58:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367cc65640 1 -- 172.21.15.103:0/1801931656 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935605901 0 0) 0x7f3678073940 con 0x7f3678073560 2024-08-18T23:58:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.492+0000 7f367e468640 1 --2- 172.21.15.103:0/1801931656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 0x7f367806db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.493+0000 7f367d466640 1 --2- 172.21.15.103:0/1801931656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 0x7f36780b39e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f366c009d90 tx=0x7f366c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=743174bd650a76b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.493+0000 7f367cc65640 1 -- 172.21.15.103:0/1801931656 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c007740 con 0x7f36780b3580 2024-08-18T23:58:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.493+0000 7f367cc65640 1 -- 172.21.15.103:0/1801931656 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c0078e0 con 0x7f36780b3580 2024-08-18T23:58:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.493+0000 7f367cc65640 1 -- 172.21.15.103:0/1801931656 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c007cb0 con 0x7f36780b3580 2024-08-18T23:58:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.494+0000 7f367fecb640 1 -- 172.21.15.103:0/1801931656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 msgr2=0x7f36780b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.494+0000 7f367fecb640 1 --2- 172.21.15.103:0/1801931656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 0x7f36780b39e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f366c009d90 tx=0x7f366c02a660 comp rx=0 tx=0).stop 2024-08-18T23:58:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.494+0000 7f367fecb640 1 -- 172.21.15.103:0/1801931656 shutdown_connections 2024-08-18T23:58:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.494+0000 7f367fecb640 1 --2- 172.21.15.103:0/1801931656 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 0x7f367806db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.494+0000 7f367fecb640 1 --2- 172.21.15.103:0/1801931656 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 0x7f36780b39e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.494+0000 7f367fecb640 1 -- 172.21.15.103:0/1801931656 >> 172.21.15.103:0/1801931656 conn(0x7f367806bae0 msgr2=0x7f367806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.494+0000 7f367fecb640 1 -- 172.21.15.103:0/1801931656 shutdown_connections 2024-08-18T23:58:12.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.494+0000 7f367fecb640 1 -- 172.21.15.103:0/1801931656 wait complete. 2024-08-18T23:58:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.495+0000 7f367fecb640 1 Processor -- start 2024-08-18T23:58:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.495+0000 7f367fecb640 1 -- start start 2024-08-18T23:58:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367fecb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 0x7f367814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367fecb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3678073560 0x7f3678152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367fecb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 0x7f367814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367fecb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f367806ecd0 con 0x7f3678073560 2024-08-18T23:58:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367fecb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f367806e9f0 con 0x7f36780b3580 2024-08-18T23:58:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367fecb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f367806efb0 con 0x7f367806d700 2024-08-18T23:58:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3678073560 0x7f3678152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3678073560 0x7f3678152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37234/0 (socket says 172.21.15.103:37234) 2024-08-18T23:58:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 -- 172.21.15.103:0/2134811635 learned_addr learned my addr 172.21.15.103:0/2134811635 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:12.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367dc67640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 0x7f367814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367e468640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 0x7f367814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 -- 172.21.15.103:0/2134811635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 msgr2=0x7f367814b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f367806d700 0x7f367814b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 -- 172.21.15.103:0/2134811635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 msgr2=0x7f367814fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 0x7f367814fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 -- 172.21.15.103:0/2134811635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367814de60 con 0x7f3678073560 2024-08-18T23:58:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367e468640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36780b3580 0x7f367814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f367d466640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3678073560 0x7f3678152450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f366c000f80 tx=0x7f366c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.496+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c040070 con 0x7f3678073560 2024-08-18T23:58:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.497+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367814e140 con 0x7f3678073560 2024-08-18T23:58:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.497+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c031c40 con 0x7f3678073560 2024-08-18T23:58:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.497+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c009450 con 0x7f3678073560 2024-08-18T23:58:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.497+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367814e700 con 0x7f3678073560 2024-08-18T23:58:12.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.497+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f367815ce20 con 0x7f3678073560 2024-08-18T23:58:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.498+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f366c039040 con 0x7f3678073560 2024-08-18T23:58:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.498+0000 7f36767fc640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f366406be30 0x7f366406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.498+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f366c0abe50 con 0x7f3678073560 2024-08-18T23:58:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.499+0000 7f367dc67640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f366406be30 0x7f366406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.499+0000 7f36767fc640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7f36640722d0 0x7f3664074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.499+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 --> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f366c04aec0 con 0x7f36640722d0 2024-08-18T23:58:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.499+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f366c0ae550 con 0x7f3678073560 2024-08-18T23:58:12.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.499+0000 7f367e468640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7f36640722d0 0x7f3664074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.499+0000 7f367dc67640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f366406be30 0x7f366406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3670000f60 tx=0x7f3670007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.499+0000 7f367e468640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7f36640722d0 0x7f3664074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.500+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 <== osd.1 v2:172.21.15.103:6800/3370631755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f366c04aec0 con 0x7f36640722d0 2024-08-18T23:58:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 --> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3678152990 con 0x7f36640722d0 2024-08-18T23:58:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f36767fc640 1 -- 172.21.15.103:0/2134811635 <== osd.1 v2:172.21.15.103:6800/3370631755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3678152990 con 0x7f36640722d0 2024-08-18T23:58:12.514 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:58:12.514 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T23:58:12.514 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:58:12.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7f36640722d0 msgr2=0x7f3664074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f367fecb640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6800/3370631755,v1:172.21.15.103:6801/3370631755] conn(0x7f36640722d0 0x7f3664074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f366406be30 msgr2=0x7f366406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f367fecb640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f366406be30 0x7f366406e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3670000f60 tx=0x7f3670007de0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3678073560 msgr2=0x7f3678152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f367fecb640 1 --2- 172.21.15.103:0/2134811635 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3678073560 0x7f3678152450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f366c000f80 tx=0x7f366c004a40 comp rx=0 tx=0).stop 2024-08-18T23:58:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.512+0000 7f367e468640 1 -- 172.21.15.103:0/2134811635 reap_dead start 2024-08-18T23:58:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.513+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 shutdown_connections 2024-08-18T23:58:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.513+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 >> 172.21.15.103:0/2134811635 conn(0x7f367806bae0 msgr2=0x7f3678153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.513+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 shutdown_connections 2024-08-18T23:58:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.513+0000 7f367fecb640 1 -- 172.21.15.103:0/2134811635 wait complete. 2024-08-18T23:58:12.524 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-18T23:58:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.624+0000 7f2e4075b640 1 Processor -- start 2024-08-18T23:58:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.625+0000 7f2e4075b640 1 -- start start 2024-08-18T23:58:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.625+0000 7f2e4075b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2e3815f5c0 0x7f2e380ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.625+0000 7f2e4075b640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e380cdd60 con 0x7f2e380ceb90 2024-08-18T23:58:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.625+0000 7f2e4075b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e380d29e0 con 0x7f2e380c6d00 2024-08-18T23:58:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.625+0000 7f2e4075b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f2e380d2cc0 con 0x7f2e3815f5c0 2024-08-18T23:58:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3dcf6640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f2e380ceb90 0x7f2e380cfa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57974/0 (socket says 172.21.15.103:57974) 2024-08-18T23:58:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3dcf6640 1 -- 172.21.15.103:0/975241533 learned_addr learned my addr 172.21.15.103:0/975241533 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3e4f7640 1 --2- 172.21.15.103:0/975241533 >> v2:172.21.15.190:3300/0 conn(0x7f2e3815f5c0 0x7f2e380ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3d4f5640 1 -- 172.21.15.103:0/975241533 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1527385869 0 0) 0x7f2e380cdd60 con 0x7f2e380ceb90 2024-08-18T23:58:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3d4f5640 1 -- 172.21.15.103:0/975241533 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e24003520 con 0x7f2e380ceb90 2024-08-18T23:58:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3e4f7640 1 -- 172.21.15.103:0/975241533 >> v1:172.21.15.190:6789/0 conn(0x7f2e380c6d00 legacy=0x7f2e380d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3d4f5640 1 -- 172.21.15.103:0/975241533 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651631616 0 0) 0x7f2e380d29e0 con 0x7f2e380c6d00 2024-08-18T23:58:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3e4f7640 1 -- 172.21.15.103:0/975241533 >> v1:172.21.15.103:6789/0 conn(0x7f2e380ceb90 legacy=0x7f2e380cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.626+0000 7f2e3e4f7640 1 -- 172.21.15.103:0/975241533 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e380cd4c0 con 0x7f2e3815f5c0 2024-08-18T23:58:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.627+0000 7f2e3e4f7640 1 --2- 172.21.15.103:0/975241533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e3815f5c0 0x7f2e380ce650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e280097a0 tx=0x7f2e2802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ff0f10326fbeeef server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.627+0000 7f2e3d4f5640 1 -- 172.21.15.103:0/975241533 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28037070 con 0x7f2e3815f5c0 2024-08-18T23:58:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.627+0000 7f2e3d4f5640 1 -- 172.21.15.103:0/975241533 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2802ac30 con 0x7f2e3815f5c0 2024-08-18T23:58:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.627+0000 7f2e3d4f5640 1 -- 172.21.15.103:0/975241533 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34001670 con 0x7f2e3815f5c0 2024-08-18T23:58:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.628+0000 7f2e4075b640 1 -- 172.21.15.103:0/975241533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e3815f5c0 msgr2=0x7f2e380ce650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.628+0000 7f2e4075b640 1 --2- 172.21.15.103:0/975241533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e3815f5c0 0x7f2e380ce650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e280097a0 tx=0x7f2e2802a1a0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.628+0000 7f2e4075b640 1 -- 172.21.15.103:0/975241533 shutdown_connections 2024-08-18T23:58:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.628+0000 7f2e4075b640 1 --2- 172.21.15.103:0/975241533 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e3815f5c0 0x7f2e380ce650 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.628+0000 7f2e4075b640 1 -- 172.21.15.103:0/975241533 >> 172.21.15.103:0/975241533 conn(0x7f2e380d1ec0 msgr2=0x7f2e380d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.628+0000 7f2e4075b640 1 -- 172.21.15.103:0/975241533 shutdown_connections 2024-08-18T23:58:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.628+0000 7f2e4075b640 1 -- 172.21.15.103:0/975241533 wait complete. 2024-08-18T23:58:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.630+0000 7f2e4075b640 1 Processor -- start 2024-08-18T23:58:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.630+0000 7f2e4075b640 1 -- start start 2024-08-18T23:58:12.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e4075b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e380c6d00 0x7f2e3815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e4075b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e380ceb90 0x7f2e380c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e4075b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e3815f5c0 0x7f2e3815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e4075b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3815f9a0 con 0x7f2e380c6d00 2024-08-18T23:58:12.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e4075b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2e380cda80 con 0x7f2e380ceb90 2024-08-18T23:58:12.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e4075b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2e3815fb20 con 0x7f2e3815f5c0 2024-08-18T23:58:12.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3e4f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e380c6d00 0x7f2e3815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3e4f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e380c6d00 0x7f2e3815bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37244/0 (socket says 172.21.15.103:37244) 2024-08-18T23:58:12.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3e4f7640 1 -- 172.21.15.103:0/3111241216 learned_addr learned my addr 172.21.15.103:0/3111241216 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:12.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3dcf6640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e380ceb90 0x7f2e380c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3ecf8640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e3815f5c0 0x7f2e3815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3e4f7640 1 -- 172.21.15.103:0/3111241216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e3815f5c0 msgr2=0x7f2e3815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3e4f7640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e3815f5c0 0x7f2e3815aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3e4f7640 1 -- 172.21.15.103:0/3111241216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e380ceb90 msgr2=0x7f2e380c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3e4f7640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e380ceb90 0x7f2e380c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.631+0000 7f2e3e4f7640 1 -- 172.21.15.103:0/3111241216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e380ca470 con 0x7f2e380c6d00 2024-08-18T23:58:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.632+0000 7f2e3e4f7640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e380c6d00 0x7f2e3815bb10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2e280098c0 tx=0x7f2e280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.632+0000 7f2e2effd640 1 -- 172.21.15.103:0/3111241216 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28042070 con 0x7f2e380c6d00 2024-08-18T23:58:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.632+0000 7f2e2effd640 1 -- 172.21.15.103:0/3111241216 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2803e460 con 0x7f2e380c6d00 2024-08-18T23:58:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.632+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e380c9890 con 0x7f2e380c6d00 2024-08-18T23:58:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.632+0000 7f2e2effd640 1 -- 172.21.15.103:0/3111241216 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e28037040 con 0x7f2e380c6d00 2024-08-18T23:58:12.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.632+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e380c9e50 con 0x7f2e380c6d00 2024-08-18T23:58:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.633+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e380ce650 con 0x7f2e380c6d00 2024-08-18T23:58:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.633+0000 7f2e2effd640 1 -- 172.21.15.103:0/3111241216 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e28045070 con 0x7f2e380c6d00 2024-08-18T23:58:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.634+0000 7f2e2effd640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f2e1c06be30 0x7f2e1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.634+0000 7f2e2effd640 1 -- 172.21.15.103:0/3111241216 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f2e280ab320 con 0x7f2e380c6d00 2024-08-18T23:58:12.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.634+0000 7f2e3dcf6640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f2e1c06be30 0x7f2e1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.634+0000 7f2e3dcf6640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f2e1c06be30 0x7f2e1c06e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2e34001600 tx=0x7f2e34001570 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.642+0000 7f2e2effd640 1 -- 172.21.15.103:0/3111241216 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f2e28079770 con 0x7f2e380c6d00 2024-08-18T23:58:12.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.813+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f2e380693f0 con 0x7f2e1c06be30 2024-08-18T23:58:12.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.813+0000 7f2e2effd640 1 -- 172.21.15.103:0/3111241216 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2e34004d70 con 0x7f2e1c06be30 2024-08-18T23:58:12.815 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 1 to deep-scrub 2024-08-18T23:58:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f2e1c06be30 msgr2=0x7f2e1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f2e1c06be30 0x7f2e1c06e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2e34001600 tx=0x7f2e34001570 comp rx=0 tx=0).stop 2024-08-18T23:58:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e380c6d00 msgr2=0x7f2e3815bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e380c6d00 0x7f2e3815bb10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2e280098c0 tx=0x7f2e280046c0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 shutdown_connections 2024-08-18T23:58:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f2e1c06be30 0x7f2e1c06e2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2e3815f5c0 0x7f2e3815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2e380ceb90 0x7f2e380c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 --2- 172.21.15.103:0/3111241216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e380c6d00 0x7f2e3815bb10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 >> 172.21.15.103:0/3111241216 conn(0x7f2e380d1ec0 msgr2=0x7f2e380cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 shutdown_connections 2024-08-18T23:58:12.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.816+0000 7f2e4075b640 1 -- 172.21.15.103:0/3111241216 wait complete. 2024-08-18T23:58:12.831 INFO:tasks.ceph:Scrubbing osd.2 2024-08-18T23:58:12.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-18T23:58:12.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.934+0000 7fc04748f640 1 Processor -- start 2024-08-18T23:58:12.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.935+0000 7fc04748f640 1 -- start start 2024-08-18T23:58:12.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.935+0000 7fc04748f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 0x7fc04006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.935+0000 7fc04748f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc04006b900 0x7fc04006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.935+0000 7fc04748f640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0400b4570 con 0x7fc04015e100 2024-08-18T23:58:12.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.935+0000 7fc04748f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc0400b0130 con 0x7fc04006b900 2024-08-18T23:58:12.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.935+0000 7fc04748f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc0400b0410 con 0x7fc040070d40 2024-08-18T23:58:12.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc04522b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc04015e100 0x7fc0400b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57990/0 (socket says 172.21.15.103:57990) 2024-08-18T23:58:12.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc04522b640 1 -- 172.21.15.103:0/124088549 learned_addr learned my addr 172.21.15.103:0/124088549 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:12.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc045a2c640 1 --2- 172.21.15.103:0/124088549 >> v2:172.21.15.190:3300/0 conn(0x7fc04006b900 0x7fc04006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc044a2a640 1 --2- 172.21.15.103:0/124088549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 0x7fc04006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc037fff640 1 -- 172.21.15.103:0/124088549 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580976613 0 0) 0x7fc0400b4570 con 0x7fc04015e100 2024-08-18T23:58:12.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc037fff640 1 -- 172.21.15.103:0/124088549 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc02c003520 con 0x7fc04015e100 2024-08-18T23:58:12.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc045a2c640 1 -- 172.21.15.103:0/124088549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 msgr2=0x7fc04006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:12.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc045a2c640 1 --2- 172.21.15.103:0/124088549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 0x7fc04006e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc045a2c640 1 -- 172.21.15.103:0/124088549 >> v1:172.21.15.103:6789/0 conn(0x7fc04015e100 legacy=0x7fc0400b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.936+0000 7fc045a2c640 1 -- 172.21.15.103:0/124088549 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0400b06f0 con 0x7fc04006b900 2024-08-18T23:58:12.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.937+0000 7fc045a2c640 1 --2- 172.21.15.103:0/124088549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04006b900 0x7fc04006bdb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc038009d90 tx=0x7fc03802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4332d66c7099ace server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.937+0000 7fc037fff640 1 -- 172.21.15.103:0/124088549 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038007740 con 0x7fc04006b900 2024-08-18T23:58:12.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.937+0000 7fc037fff640 1 -- 172.21.15.103:0/124088549 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0380078e0 con 0x7fc04006b900 2024-08-18T23:58:12.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.937+0000 7fc037fff640 1 -- 172.21.15.103:0/124088549 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038007cb0 con 0x7fc04006b900 2024-08-18T23:58:12.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.938+0000 7fc04748f640 1 -- 172.21.15.103:0/124088549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04006b900 msgr2=0x7fc04006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.938+0000 7fc04748f640 1 --2- 172.21.15.103:0/124088549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04006b900 0x7fc04006bdb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc038009d90 tx=0x7fc03802a660 comp rx=0 tx=0).stop 2024-08-18T23:58:12.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.938+0000 7fc04748f640 1 -- 172.21.15.103:0/124088549 shutdown_connections 2024-08-18T23:58:12.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.938+0000 7fc04748f640 1 --2- 172.21.15.103:0/124088549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04006b900 0x7fc04006bdb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.938+0000 7fc04748f640 1 --2- 172.21.15.103:0/124088549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 0x7fc04006e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.938+0000 7fc04748f640 1 -- 172.21.15.103:0/124088549 >> 172.21.15.103:0/124088549 conn(0x7fc04006d2f0 msgr2=0x7fc0400b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.938+0000 7fc04748f640 1 -- 172.21.15.103:0/124088549 shutdown_connections 2024-08-18T23:58:12.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.938+0000 7fc04748f640 1 -- 172.21.15.103:0/124088549 wait complete. 2024-08-18T23:58:12.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.939+0000 7fc04748f640 1 Processor -- start 2024-08-18T23:58:12.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.939+0000 7fc04748f640 1 -- start start 2024-08-18T23:58:12.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04748f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc04006b900 0x7fc040154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04748f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 0x7fc040161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04748f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04015e100 0x7fc04014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04748f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc0400b4d30 con 0x7fc04006b900 2024-08-18T23:58:12.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04748f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc04015e4e0 con 0x7fc04015e100 2024-08-18T23:58:12.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04748f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc0400b4eb0 con 0x7fc040070d40 2024-08-18T23:58:12.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc04006b900 0x7fc040154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc04006b900 0x7fc040154df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37256/0 (socket says 172.21.15.103:37256) 2024-08-18T23:58:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 -- 172.21.15.103:0/3155479534 learned_addr learned my addr 172.21.15.103:0/3155479534 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc044a2a640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 0x7fc040161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc045a2c640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04015e100 0x7fc04014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 -- 172.21.15.103:0/3155479534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 msgr2=0x7fc040161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc040070d40 0x7fc040161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 -- 172.21.15.103:0/3155479534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04015e100 msgr2=0x7fc04014b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04015e100 0x7fc04014b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 -- 172.21.15.103:0/3155479534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc040156570 con 0x7fc04006b900 2024-08-18T23:58:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc045a2c640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc04015e100 0x7fc04014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04522b640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc04006b900 0x7fc040154df0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c390 tx=0x7fc03000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc030017070 con 0x7fc04006b900 2024-08-18T23:58:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc030005ce0 con 0x7fc04006b900 2024-08-18T23:58:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.940+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc040156850 con 0x7fc04006b900 2024-08-18T23:58:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.941+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0300072f0 con 0x7fc04006b900 2024-08-18T23:58:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.941+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04015f6c0 con 0x7fc04006b900 2024-08-18T23:58:12.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.942+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc04006e7c0 con 0x7fc04006b900 2024-08-18T23:58:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.943+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc03001a070 con 0x7fc04006b900 2024-08-18T23:58:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.943+0000 7fc035ffb640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc02406be30 0x7fc02406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.943+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fc030089ff0 con 0x7fc04006b900 2024-08-18T23:58:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.943+0000 7fc044a2a640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc02406be30 0x7fc02406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.943+0000 7fc035ffb640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7fc0240722d0 0x7fc024074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.943+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 --> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc030015e70 con 0x7fc0240722d0 2024-08-18T23:58:12.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.943+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc030091050 con 0x7fc04006b900 2024-08-18T23:58:12.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.943+0000 7fc045a2c640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7fc0240722d0 0x7fc024074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:12.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.944+0000 7fc044a2a640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc02406be30 0x7fc02406e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc040160260 tx=0x7fc03c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.944+0000 7fc045a2c640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7fc0240722d0 0x7fc024074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:12.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.944+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 <== osd.2 v2:172.21.15.103:6824/1313986771 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc030015e70 con 0x7fc0240722d0 2024-08-18T23:58:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 --> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc0400b1c50 con 0x7fc0240722d0 2024-08-18T23:58:12.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc035ffb640 1 -- 172.21.15.103:0/3155479534 <== osd.2 v2:172.21.15.103:6824/1313986771 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc0400b1c50 con 0x7fc0240722d0 2024-08-18T23:58:12.959 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:58:12.959 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T23:58:12.959 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:58:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7fc0240722d0 msgr2=0x7fc024074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6824/1313986771,v1:172.21.15.103:6825/1313986771] conn(0x7fc0240722d0 0x7fc024074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc02406be30 msgr2=0x7fc02406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc02406be30 0x7fc02406e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc040160260 tx=0x7fc03c009190 comp rx=0 tx=0).stop 2024-08-18T23:58:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc04006b900 msgr2=0x7fc040154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:12.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 --2- 172.21.15.103:0/3155479534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc04006b900 0x7fc040154df0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c390 tx=0x7fc03000c850 comp rx=0 tx=0).stop 2024-08-18T23:58:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc045a2c640 1 -- 172.21.15.103:0/3155479534 reap_dead start 2024-08-18T23:58:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 shutdown_connections 2024-08-18T23:58:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.957+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 >> 172.21.15.103:0/3155479534 conn(0x7fc04006d2f0 msgr2=0x7fc0400d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.958+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 shutdown_connections 2024-08-18T23:58:12.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:12.958+0000 7fc04748f640 1 -- 172.21.15.103:0/3155479534 wait complete. 2024-08-18T23:58:12.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-18T23:58:13.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.068+0000 7f54cca20640 1 Processor -- start 2024-08-18T23:58:13.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.068+0000 7f54cca20640 1 -- start start 2024-08-18T23:58:13.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54cca20640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f54c815e3b0 0x7f54c80d2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54cca20640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54c80b4a10 0x7f54c80d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54cca20640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c80d4e10 con 0x7f54c80d21b0 2024-08-18T23:58:13.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54cca20640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f54c80d4bc0 con 0x7f54c815e3b0 2024-08-18T23:58:13.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54cca20640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f54c80cf960 con 0x7f54c80b4a10 2024-08-18T23:58:13.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f54c815e3b0 0x7f54c80d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c659c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f54c815e3b0 0x7f54c80d2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37262/0 (socket says 172.21.15.103:37262) 2024-08-18T23:58:13.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c5d9b640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f54c80d21b0 0x7f54c80d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:57998/0 (socket says 172.21.15.103:57998) 2024-08-18T23:58:13.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c659c640 1 -- 172.21.15.103:0/2744822678 learned_addr learned my addr 172.21.15.103:0/2744822678 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c6d9d640 1 --2- 172.21.15.103:0/2744822678 >> v2:172.21.15.190:3300/0 conn(0x7f54c80b4a10 0x7f54c80d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c659c640 1 -- 172.21.15.103:0/2744822678 >> v2:172.21.15.190:3300/0 conn(0x7f54c80b4a10 msgr2=0x7f54c80d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:13.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c659c640 1 --2- 172.21.15.103:0/2744822678 >> v2:172.21.15.190:3300/0 conn(0x7f54c80b4a10 0x7f54c80d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c659c640 1 -- 172.21.15.103:0/2744822678 >> v1:172.21.15.103:6789/0 conn(0x7f54c80d21b0 legacy=0x7f54c80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c659c640 1 -- 172.21.15.103:0/2744822678 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c80cfbb0 con 0x7f54c815e3b0 2024-08-18T23:58:13.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.069+0000 7f54c6d9d640 1 --2- 172.21.15.103:0/2744822678 >> v2:172.21.15.190:3300/0 conn(0x7f54c80b4a10 0x7f54c80d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:13.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.070+0000 7f54c659c640 1 --2- 172.21.15.103:0/2744822678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c815e3b0 0x7f54c80d2700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f54c80ceda0 tx=0x7f54bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678aa2aa5f51b597 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.070+0000 7f54c559a640 1 -- 172.21.15.103:0/2744822678 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc037070 con 0x7f54c815e3b0 2024-08-18T23:58:13.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.070+0000 7f54c559a640 1 -- 172.21.15.103:0/2744822678 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54bc032440 con 0x7f54c815e3b0 2024-08-18T23:58:13.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.070+0000 7f54c559a640 1 -- 172.21.15.103:0/2744822678 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc032810 con 0x7f54c815e3b0 2024-08-18T23:58:13.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.071+0000 7f54cca20640 1 -- 172.21.15.103:0/2744822678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c815e3b0 msgr2=0x7f54c80d2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.071+0000 7f54cca20640 1 --2- 172.21.15.103:0/2744822678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c815e3b0 0x7f54c80d2700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f54c80ceda0 tx=0x7f54bc02a270 comp rx=0 tx=0).stop 2024-08-18T23:58:13.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.071+0000 7f54cca20640 1 -- 172.21.15.103:0/2744822678 shutdown_connections 2024-08-18T23:58:13.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.071+0000 7f54cca20640 1 --2- 172.21.15.103:0/2744822678 >> v2:172.21.15.190:3300/0 conn(0x7f54c80b4a10 0x7f54c80d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.071+0000 7f54cca20640 1 --2- 172.21.15.103:0/2744822678 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c815e3b0 0x7f54c80d2700 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.071+0000 7f54cca20640 1 -- 172.21.15.103:0/2744822678 >> 172.21.15.103:0/2744822678 conn(0x7f54c80d40a0 msgr2=0x7f54c80d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.071+0000 7f54cca20640 1 -- 172.21.15.103:0/2744822678 shutdown_connections 2024-08-18T23:58:13.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.071+0000 7f54cca20640 1 -- 172.21.15.103:0/2744822678 wait complete. 2024-08-18T23:58:13.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.073+0000 7f54cca20640 1 Processor -- start 2024-08-18T23:58:13.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.073+0000 7f54cca20640 1 -- start start 2024-08-18T23:58:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.074+0000 7f54cca20640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c80b4a10 0x7f54c80cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.074+0000 7f54cca20640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80d21b0 0x7f54c814f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.074+0000 7f54cca20640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c815e3b0 0x7f54c81592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.074+0000 7f54cca20640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f54c815e790 con 0x7f54c80d21b0 2024-08-18T23:58:13.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.074+0000 7f54cca20640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f54c80d0200 con 0x7f54c815e3b0 2024-08-18T23:58:13.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.074+0000 7f54cca20640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f54c815e910 con 0x7f54c80b4a10 2024-08-18T23:58:13.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80d21b0 0x7f54c814f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80d21b0 0x7f54c814f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37268/0 (socket says 172.21.15.103:37268) 2024-08-18T23:58:13.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 -- 172.21.15.103:0/1528166503 learned_addr learned my addr 172.21.15.103:0/1528166503 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c6d9d640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c815e3b0 0x7f54c81592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c659c640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c80b4a10 0x7f54c80cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 -- 172.21.15.103:0/1528166503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c80b4a10 msgr2=0x7f54c80cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c80b4a10 0x7f54c80cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 -- 172.21.15.103:0/1528166503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c815e3b0 msgr2=0x7f54c81592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c815e3b0 0x7f54c81592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 -- 172.21.15.103:0/1528166503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c814fd10 con 0x7f54c80d21b0 2024-08-18T23:58:13.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54c5d9b640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80d21b0 0x7f54c814f3c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c430 tx=0x7f54b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54b6ffd640 1 -- 172.21.15.103:0/1528166503 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b80074e0 con 0x7f54c80d21b0 2024-08-18T23:58:13.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54b6ffd640 1 -- 172.21.15.103:0/1528166503 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b8007680 con 0x7f54c80d21b0 2024-08-18T23:58:13.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c80ce150 con 0x7f54c80d21b0 2024-08-18T23:58:13.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54b6ffd640 1 -- 172.21.15.103:0/1528166503 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8004a00 con 0x7f54c80d21b0 2024-08-18T23:58:13.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.075+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c80b8370 con 0x7f54c80d21b0 2024-08-18T23:58:13.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.076+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c8068df0 con 0x7f54c80d21b0 2024-08-18T23:58:13.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.077+0000 7f54b6ffd640 1 -- 172.21.15.103:0/1528166503 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54b801a020 con 0x7f54c80d21b0 2024-08-18T23:58:13.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.077+0000 7f54b6ffd640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f54a806be30 0x7f54a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.077+0000 7f54b6ffd640 1 -- 172.21.15.103:0/1528166503 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f54b808a540 con 0x7f54c80d21b0 2024-08-18T23:58:13.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.077+0000 7f54c659c640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f54a806be30 0x7f54a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.078+0000 7f54c659c640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f54a806be30 0x7f54a806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f54bc034000 tx=0x7f54bc02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.085+0000 7f54b6ffd640 1 -- 172.21.15.103:0/1528166503 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f54c814fd10 con 0x7f54c80d21b0 2024-08-18T23:58:13.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.255+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f54c80d1420 con 0x7f54a806be30 2024-08-18T23:58:13.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.256+0000 7f54b6ffd640 1 -- 172.21.15.103:0/1528166503 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f54c80d1420 con 0x7f54a806be30 2024-08-18T23:58:13.257 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 2 to deep-scrub 2024-08-18T23:58:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f54a806be30 msgr2=0x7f54a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f54a806be30 0x7f54a806e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f54bc034000 tx=0x7f54bc02e000 comp rx=0 tx=0).stop 2024-08-18T23:58:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80d21b0 msgr2=0x7f54c814f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80d21b0 0x7f54c814f3c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f54b800c430 tx=0x7f54b800c8f0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 shutdown_connections 2024-08-18T23:58:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f54a806be30 0x7f54a806e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54c815e3b0 0x7f54c81592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c80d21b0 0x7f54c814f3c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 --2- 172.21.15.103:0/1528166503 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54c80b4a10 0x7f54c80cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 >> 172.21.15.103:0/1528166503 conn(0x7f54c80d40a0 msgr2=0x7f54c806d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 shutdown_connections 2024-08-18T23:58:13.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.258+0000 7f54cca20640 1 -- 172.21.15.103:0/1528166503 wait complete. 2024-08-18T23:58:13.270 INFO:tasks.ceph:Scrubbing osd.3 2024-08-18T23:58:13.270 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-18T23:58:13.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.372+0000 7f566b5f8640 1 Processor -- start 2024-08-18T23:58:13.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.372+0000 7f566b5f8640 1 -- start start 2024-08-18T23:58:13.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.373+0000 7f566b5f8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f566406f8d0 0x7f56640ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.373+0000 7f566b5f8640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566406b900 con 0x7f566415e330 2024-08-18T23:58:13.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.373+0000 7f566b5f8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f566406f080 con 0x7f56640b3f80 2024-08-18T23:58:13.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.373+0000 7f566b5f8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f566406bba0 con 0x7f566406f8d0 2024-08-18T23:58:13.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.373+0000 7f5669394640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f566415e330 0x7f56640b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51168/0 (socket says 172.21.15.103:51168) 2024-08-18T23:58:13.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.373+0000 7f5669394640 1 -- 172.21.15.103:0/1026039970 learned_addr learned my addr 172.21.15.103:0/1026039970 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:13.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.373+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3653640647 0 0) 0x7f566406b900 con 0x7f566415e330 2024-08-18T23:58:13.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f564c003520 con 0x7f566415e330 2024-08-18T23:58:13.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5669b95640 1 --2- 172.21.15.103:0/1026039970 >> v2:172.21.15.190:3300/0 conn(0x7f566406f8d0 0x7f56640ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4090691706 0 0) 0x7f564c003520 con 0x7f566415e330 2024-08-18T23:58:13.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 >> v2:172.21.15.190:3300/0 conn(0x7f566406f8d0 msgr2=0x7f56640ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:13.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 --2- 172.21.15.103:0/1026039970 >> v2:172.21.15.190:3300/0 conn(0x7f566406f8d0 0x7f56640ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 >> v1:172.21.15.190:6789/0 conn(0x7f56640b3f80 legacy=0x7f566406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566406be80 con 0x7f566415e330 2024-08-18T23:58:13.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f56540019f0 con 0x7f566415e330 2024-08-18T23:58:13.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 >> v1:172.21.15.103:6789/0 conn(0x7f566415e330 legacy=0x7f56640b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564c0039b0 0x7f564c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f564c004800 0x7f564c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0051c0 0x7f564c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f566406bba0 con 0x7f564c0051c0 2024-08-18T23:58:13.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f564c00c060 con 0x7f564c0039b0 2024-08-18T23:58:13.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f564c00c260 con 0x7f564c004800 2024-08-18T23:58:13.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5669b95640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0051c0 0x7f564c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5669394640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564c0039b0 0x7f564c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5668b93640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f564c004800 0x7f564c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5669b95640 1 -- 172.21.15.103:0/1026039970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f564c004800 msgr2=0x7f564c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:13.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5669b95640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f564c004800 0x7f564c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5669b95640 1 -- 172.21.15.103:0/1026039970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564c0039b0 msgr2=0x7f564c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:13.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5669b95640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f564c0039b0 0x7f564c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.374+0000 7f5669b95640 1 -- 172.21.15.103:0/1026039970 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c003520 con 0x7f564c0051c0 2024-08-18T23:58:13.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.375+0000 7f5669b95640 1 -- 172.21.15.103:0/1026039970 reap_dead start 2024-08-18T23:58:13.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.375+0000 7f5669b95640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0051c0 0x7f564c00b9c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f565c009ac0 tx=0x7f564c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8504cd81e8c2ccf server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.375+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c009690 con 0x7f564c0051c0 2024-08-18T23:58:13.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.375+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c004020 con 0x7f564c0051c0 2024-08-18T23:58:13.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.375+0000 7f5663fff640 1 -- 172.21.15.103:0/1026039970 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c004410 con 0x7f564c0051c0 2024-08-18T23:58:13.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.376+0000 7f566b5f8640 1 -- 172.21.15.103:0/1026039970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0051c0 msgr2=0x7f564c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.376+0000 7f566b5f8640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0051c0 0x7f564c00b9c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f565c009ac0 tx=0x7f564c005830 comp rx=0 tx=0).stop 2024-08-18T23:58:13.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.376+0000 7f566b5f8640 1 -- 172.21.15.103:0/1026039970 shutdown_connections 2024-08-18T23:58:13.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.376+0000 7f566b5f8640 1 --2- 172.21.15.103:0/1026039970 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f564c0051c0 0x7f564c00b9c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.376+0000 7f566b5f8640 1 -- 172.21.15.103:0/1026039970 >> 172.21.15.103:0/1026039970 conn(0x7f56640d0650 msgr2=0x7f56640d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.376+0000 7f566b5f8640 1 -- 172.21.15.103:0/1026039970 shutdown_connections 2024-08-18T23:58:13.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.376+0000 7f566b5f8640 1 -- 172.21.15.103:0/1026039970 wait complete. 2024-08-18T23:58:13.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.377+0000 7f566b5f8640 1 Processor -- start 2024-08-18T23:58:13.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.377+0000 7f566b5f8640 1 -- start start 2024-08-18T23:58:13.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f566b5f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f564c0051c0 0x7f5664150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f566b5f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5664151ab0 0x7f56640ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f566b5f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5664151f30 0x7f56640cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f566b5f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f566406de80 con 0x7f5664151f30 2024-08-18T23:58:13.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f566b5f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f566406ed70 con 0x7f5664151ab0 2024-08-18T23:58:13.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f566b5f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f566406e000 con 0x7f564c0051c0 2024-08-18T23:58:13.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5664151f30 0x7f56640cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5668b93640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5664151ab0 0x7f56640ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5664151f30 0x7f56640cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57376/0 (socket says 172.21.15.103:57376) 2024-08-18T23:58:13.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 -- 172.21.15.103:0/2932154632 learned_addr learned my addr 172.21.15.103:0/2932154632 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669394640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f564c0051c0 0x7f5664150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 -- 172.21.15.103:0/2932154632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f564c0051c0 msgr2=0x7f5664150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f564c0051c0 0x7f5664150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 -- 172.21.15.103:0/2932154632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5664151ab0 msgr2=0x7f56640ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5664151ab0 0x7f56640ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 -- 172.21.15.103:0/2932154632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56641f4980 con 0x7f5664151f30 2024-08-18T23:58:13.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5669b95640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5664151f30 0x7f56640cd0c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f565c02abe0 tx=0x7f565c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c003e20 con 0x7f5664151f30 2024-08-18T23:58:13.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c040070 con 0x7f5664151f30 2024-08-18T23:58:13.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c03a470 con 0x7f5664151f30 2024-08-18T23:58:13.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.378+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5664150290 con 0x7f5664151f30 2024-08-18T23:58:13.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.379+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5664150850 con 0x7f5664151f30 2024-08-18T23:58:13.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.379+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f56641f4c60 con 0x7f5664151f30 2024-08-18T23:58:13.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.380+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f565c03a610 con 0x7f5664151f30 2024-08-18T23:58:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.380+0000 7f5661ffb640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f565006be30 0x7f565006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.380+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f565c0aadd0 con 0x7f5664151f30 2024-08-18T23:58:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.380+0000 7f5669394640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f565006be30 0x7f565006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.381+0000 7f5661ffb640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f56500722d0 0x7f5650074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.381+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 --> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f565c004020 con 0x7f56500722d0 2024-08-18T23:58:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.381+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f565c0ad4d0 con 0x7f5664151f30 2024-08-18T23:58:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.381+0000 7f5668b93640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f56500722d0 0x7f5650074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.381+0000 7f5669394640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f565006be30 0x7f565006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5654001560 tx=0x7f5654006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.381+0000 7f5668b93640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f56500722d0 0x7f5650074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.382+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 <== osd.3 v2:172.21.15.103:6816/2012367824 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f565c004020 con 0x7f56500722d0 2024-08-18T23:58:13.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.394+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 --> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f56640ad8b0 con 0x7f56500722d0 2024-08-18T23:58:13.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.394+0000 7f5661ffb640 1 -- 172.21.15.103:0/2932154632 <== osd.3 v2:172.21.15.103:6816/2012367824 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f56640ad8b0 con 0x7f56500722d0 2024-08-18T23:58:13.396 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:58:13.396 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T23:58:13.396 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:58:13.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.394+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f56500722d0 msgr2=0x7f5650074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.394+0000 7f566b5f8640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6816/2012367824,v1:172.21.15.103:6817/2012367824] conn(0x7f56500722d0 0x7f5650074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f565006be30 msgr2=0x7f565006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f566b5f8640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f565006be30 0x7f565006e2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5654001560 tx=0x7f5654006040 comp rx=0 tx=0).stop 2024-08-18T23:58:13.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5664151f30 msgr2=0x7f56640cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f566b5f8640 1 --2- 172.21.15.103:0/2932154632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5664151f30 0x7f56640cd0c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f565c02abe0 tx=0x7f565c004730 comp rx=0 tx=0).stop 2024-08-18T23:58:13.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f5669b95640 1 -- 172.21.15.103:0/2932154632 reap_dead start 2024-08-18T23:58:13.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 shutdown_connections 2024-08-18T23:58:13.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 >> 172.21.15.103:0/2932154632 conn(0x7f56640d0650 msgr2=0x7f5664071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 shutdown_connections 2024-08-18T23:58:13.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.395+0000 7f566b5f8640 1 -- 172.21.15.103:0/2932154632 wait complete. 2024-08-18T23:58:13.406 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-18T23:58:13.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.504+0000 7f048b9f8640 1 Processor -- start 2024-08-18T23:58:13.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.505+0000 7f048b9f8640 1 -- start start 2024-08-18T23:58:13.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.505+0000 7f048b9f8640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f048415bd80 0x7f048415c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.505+0000 7f048b9f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840b0380 0x7f04840d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.505+0000 7f048b9f8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0484073490 con 0x7f04840d15b0 2024-08-18T23:58:13.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f048b9f8640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f04840d1a00 con 0x7f048415bd80 2024-08-18T23:58:13.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f048b9f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f048415c9b0 con 0x7f04840b0380 2024-08-18T23:58:13.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0489794640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f048415bd80 0x7f048415c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0489794640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f048415bd80 0x7f048415c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57392/0 (socket says 172.21.15.103:57392) 2024-08-18T23:58:13.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0489794640 1 -- 172.21.15.103:0/3043120527 learned_addr learned my addr 172.21.15.103:0/3043120527 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0488f93640 1 --2- 172.21.15.103:0/3043120527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840b0380 0x7f04840d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0489794640 1 -- 172.21.15.103:0/3043120527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840b0380 msgr2=0x7f04840d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:13.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0489794640 1 --2- 172.21.15.103:0/3043120527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840b0380 0x7f04840d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0489794640 1 -- 172.21.15.103:0/3043120527 >> v1:172.21.15.190:6789/0 conn(0x7f04840d15b0 legacy=0x7f048406b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:13.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0489794640 1 -- 172.21.15.103:0/3043120527 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048415cc90 con 0x7f048415bd80 2024-08-18T23:58:13.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.506+0000 7f0488f93640 1 --2- 172.21.15.103:0/3043120527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840b0380 0x7f04840d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:13.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f0489794640 1 --2- 172.21.15.103:0/3043120527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048415c160 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0480009870 tx=0x7f048002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431b7c8876ad2464 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f047bfff640 1 -- 172.21.15.103:0/3043120527 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480037070 con 0x7f048415bd80 2024-08-18T23:58:13.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f047bfff640 1 -- 172.21.15.103:0/3043120527 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0480032440 con 0x7f048415bd80 2024-08-18T23:58:13.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f047bfff640 1 -- 172.21.15.103:0/3043120527 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480032810 con 0x7f048415bd80 2024-08-18T23:58:13.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f048b9f8640 1 -- 172.21.15.103:0/3043120527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 msgr2=0x7f048415c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f048b9f8640 1 --2- 172.21.15.103:0/3043120527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048415c160 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0480009870 tx=0x7f048002a210 comp rx=0 tx=0).stop 2024-08-18T23:58:13.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f048b9f8640 1 -- 172.21.15.103:0/3043120527 shutdown_connections 2024-08-18T23:58:13.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f048b9f8640 1 --2- 172.21.15.103:0/3043120527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840b0380 0x7f04840d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f048b9f8640 1 --2- 172.21.15.103:0/3043120527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048415c160 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.507+0000 7f048b9f8640 1 -- 172.21.15.103:0/3043120527 >> 172.21.15.103:0/3043120527 conn(0x7f04840b2c80 msgr2=0x7f04840b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.508+0000 7f048b9f8640 1 -- 172.21.15.103:0/3043120527 shutdown_connections 2024-08-18T23:58:13.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.508+0000 7f048b9f8640 1 -- 172.21.15.103:0/3043120527 wait complete. 2024-08-18T23:58:13.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.509+0000 7f048b9f8640 1 Processor -- start 2024-08-18T23:58:13.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.509+0000 7f048b9f8640 1 -- start start 2024-08-18T23:58:13.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.509+0000 7f048b9f8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04840b0380 0x7f048409b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.509+0000 7f048b9f8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840d15b0 0x7f048415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.509+0000 7f048b9f8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048409c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.509+0000 7f048b9f8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f048415d580 con 0x7f048415bd80 2024-08-18T23:58:13.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.509+0000 7f048b9f8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f048415d250 con 0x7f04840b0380 2024-08-18T23:58:13.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.509+0000 7f048b9f8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f048415c6a0 con 0x7f04840d15b0 2024-08-18T23:58:13.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048409c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048409c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57394/0 (socket says 172.21.15.103:57394) 2024-08-18T23:58:13.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 -- 172.21.15.103:0/4231607448 learned_addr learned my addr 172.21.15.103:0/4231607448 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0488f93640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840d15b0 0x7f048415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489794640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04840b0380 0x7f048409b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 -- 172.21.15.103:0/4231607448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840d15b0 msgr2=0x7f048415acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840d15b0 0x7f048415acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 -- 172.21.15.103:0/4231607448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04840b0380 msgr2=0x7f048409b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04840b0380 0x7f048409b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 -- 172.21.15.103:0/4231607448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048415b230 con 0x7f048415bd80 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0488f93640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840d15b0 0x7f048415acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0489f95640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048409c720 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f047c00c7b0 tx=0x7f047c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0479ffb640 1 -- 172.21.15.103:0/4231607448 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c004b60 con 0x7f048415bd80 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0479ffb640 1 -- 172.21.15.103:0/4231607448 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c004d00 con 0x7f048415bd80 2024-08-18T23:58:13.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f0479ffb640 1 -- 172.21.15.103:0/4231607448 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c00aa90 con 0x7f048415bd80 2024-08-18T23:58:13.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04841f5200 con 0x7f048415bd80 2024-08-18T23:58:13.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.510+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048409bd50 con 0x7f048415bd80 2024-08-18T23:58:13.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.511+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04840cf5f0 con 0x7f048415bd80 2024-08-18T23:58:13.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.512+0000 7f0479ffb640 1 -- 172.21.15.103:0/4231607448 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f047c00ac30 con 0x7f048415bd80 2024-08-18T23:58:13.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.512+0000 7f0479ffb640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f046806be60 0x7f046806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.512+0000 7f0489794640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f046806be60 0x7f046806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.512+0000 7f0479ffb640 1 -- 172.21.15.103:0/4231607448 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f047c08ae00 con 0x7f048415bd80 2024-08-18T23:58:13.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.513+0000 7f0489794640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f046806be60 0x7f046806e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0480034000 tx=0x7f048002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.517+0000 7f0479ffb640 1 -- 172.21.15.103:0/4231607448 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f047c020070 con 0x7f048415bd80 2024-08-18T23:58:13.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.682+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f048406d590 con 0x7f046806be60 2024-08-18T23:58:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.682+0000 7f0479ffb640 1 -- 172.21.15.103:0/4231607448 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f048406d590 con 0x7f046806be60 2024-08-18T23:58:13.684 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 3 to deep-scrub 2024-08-18T23:58:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f046806be60 msgr2=0x7f046806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f046806be60 0x7f046806e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0480034000 tx=0x7f048002e000 comp rx=0 tx=0).stop 2024-08-18T23:58:13.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 msgr2=0x7f048409c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048409c720 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f047c00c7b0 tx=0x7f047c00cc70 comp rx=0 tx=0).stop 2024-08-18T23:58:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 shutdown_connections 2024-08-18T23:58:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f046806be60 0x7f046806e320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f048415bd80 0x7f048409c720 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f04840d15b0 0x7f048415acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 --2- 172.21.15.103:0/4231607448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04840b0380 0x7f048409b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.684+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 >> 172.21.15.103:0/4231607448 conn(0x7f04840b2c80 msgr2=0x7f04840add80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.685+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 shutdown_connections 2024-08-18T23:58:13.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.685+0000 7f048b9f8640 1 -- 172.21.15.103:0/4231607448 wait complete. 2024-08-18T23:58:13.697 INFO:tasks.ceph:Scrubbing osd.4 2024-08-18T23:58:13.697 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-18T23:58:13.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.798+0000 7fe74ee7d640 1 Processor -- start 2024-08-18T23:58:13.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.798+0000 7fe74ee7d640 1 -- start start 2024-08-18T23:58:13.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74ee7d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 0x7fe7480ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74ee7d640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe74806f8d0 0x7fe74806c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74ee7d640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74806b900 con 0x7fe74815e330 2024-08-18T23:58:13.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74ee7d640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7fe74806f080 con 0x7fe74806f8d0 2024-08-18T23:58:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74ee7d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe74806bba0 con 0x7fe7480b3f80 2024-08-18T23:58:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74d41a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe74806f8d0 0x7fe74806c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74d41a640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe74806f8d0 0x7fe74806c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57400/0 (socket says 172.21.15.103:57400) 2024-08-18T23:58:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74cc19640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe74815e330 0x7fe7480b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51182/0 (socket says 172.21.15.103:51182) 2024-08-18T23:58:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74d41a640 1 -- 172.21.15.103:0/263686291 learned_addr learned my addr 172.21.15.103:0/263686291 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe747fff640 1 --2- 172.21.15.103:0/263686291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 0x7fe7480ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74d41a640 1 -- 172.21.15.103:0/263686291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 msgr2=0x7fe7480ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74d41a640 1 --2- 172.21.15.103:0/263686291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 0x7fe7480ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74d41a640 1 -- 172.21.15.103:0/263686291 >> v1:172.21.15.103:6789/0 conn(0x7fe74815e330 legacy=0x7fe7480b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe7477fe640 1 -- 172.21.15.103:0/263686291 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227825029 0 0) 0x7fe74806b900 con 0x7fe74815e330 2024-08-18T23:58:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.799+0000 7fe74d41a640 1 -- 172.21.15.103:0/263686291 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74806be80 con 0x7fe74806f8d0 2024-08-18T23:58:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.800+0000 7fe74d41a640 1 --2- 172.21.15.103:0/263686291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 0x7fe74806c680 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe740009e50 tx=0x7fe74002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef28f1b715bd537 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.800+0000 7fe7477fe640 1 -- 172.21.15.103:0/263686291 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740036070 con 0x7fe74806f8d0 2024-08-18T23:58:13.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.800+0000 7fe7477fe640 1 -- 172.21.15.103:0/263686291 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe740031600 con 0x7fe74806f8d0 2024-08-18T23:58:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.800+0000 7fe7477fe640 1 -- 172.21.15.103:0/263686291 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7400319d0 con 0x7fe74806f8d0 2024-08-18T23:58:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.800+0000 7fe74ee7d640 1 -- 172.21.15.103:0/263686291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 msgr2=0x7fe74806c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.800+0000 7fe74ee7d640 1 --2- 172.21.15.103:0/263686291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 0x7fe74806c680 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe740009e50 tx=0x7fe74002a710 comp rx=0 tx=0).stop 2024-08-18T23:58:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.801+0000 7fe74ee7d640 1 -- 172.21.15.103:0/263686291 shutdown_connections 2024-08-18T23:58:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.801+0000 7fe74ee7d640 1 --2- 172.21.15.103:0/263686291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 0x7fe74806c680 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.801+0000 7fe74ee7d640 1 --2- 172.21.15.103:0/263686291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 0x7fe7480ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.801+0000 7fe74ee7d640 1 -- 172.21.15.103:0/263686291 >> 172.21.15.103:0/263686291 conn(0x7fe7480d0650 msgr2=0x7fe7480d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.801+0000 7fe74ee7d640 1 -- 172.21.15.103:0/263686291 shutdown_connections 2024-08-18T23:58:13.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.801+0000 7fe74ee7d640 1 -- 172.21.15.103:0/263686291 wait complete. 2024-08-18T23:58:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.802+0000 7fe74ee7d640 1 Processor -- start 2024-08-18T23:58:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.802+0000 7fe74ee7d640 1 -- start start 2024-08-18T23:58:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74ee7d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 0x7fe74814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74ee7d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 0x7fe748157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74ee7d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe74815e330 0x7fe748160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74ee7d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe74806de80 con 0x7fe74806f8d0 2024-08-18T23:58:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74ee7d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe74806ed70 con 0x7fe74815e330 2024-08-18T23:58:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74ee7d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe74806e000 con 0x7fe7480b3f80 2024-08-18T23:58:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 0x7fe74814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 0x7fe74814aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57404/0 (socket says 172.21.15.103:57404) 2024-08-18T23:58:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 -- 172.21.15.103:0/2343853172 learned_addr learned my addr 172.21.15.103:0/2343853172 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74d41a640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe74815e330 0x7fe748160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe747fff640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 0x7fe748157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 -- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 msgr2=0x7fe748157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe7480b3f80 0x7fe748157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 -- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe74815e330 msgr2=0x7fe748160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe74815e330 0x7fe748160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 -- 172.21.15.103:0/2343853172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe748156790 con 0x7fe74806f8d0 2024-08-18T23:58:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74d41a640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe74815e330 0x7fe748160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74cc19640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 0x7fe74814aff0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c430 tx=0x7fe73c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0074e0 con 0x7fe74806f8d0 2024-08-18T23:58:13.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73c0047e0 con 0x7fe74806f8d0 2024-08-18T23:58:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74814b530 con 0x7fe74806f8d0 2024-08-18T23:58:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c004bd0 con 0x7fe74806f8d0 2024-08-18T23:58:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.803+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe748155cb0 con 0x7fe74806f8d0 2024-08-18T23:58:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.804+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe7480ad8b0 con 0x7fe74806f8d0 2024-08-18T23:58:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.805+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe73c011070 con 0x7fe74806f8d0 2024-08-18T23:58:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.805+0000 7fe7457fa640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe72c06be30 0x7fe72c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.805+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fe73c08a960 con 0x7fe74806f8d0 2024-08-18T23:58:13.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.805+0000 7fe747fff640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe72c06be30 0x7fe72c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.805+0000 7fe7457fa640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7fe72c0722d0 0x7fe72c074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.805+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 --> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe73c01ce80 con 0x7fe72c0722d0 2024-08-18T23:58:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.805+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fe73c08f2c0 con 0x7fe74806f8d0 2024-08-18T23:58:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.805+0000 7fe74d41a640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7fe72c0722d0 0x7fe72c074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.806+0000 7fe747fff640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe72c06be30 0x7fe72c06e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe748068c40 tx=0x7fe734008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.806+0000 7fe74d41a640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7fe72c0722d0 0x7fe72c074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.807+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 <== osd.4 v2:172.21.15.190:6816/491823420 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe73c01ce80 con 0x7fe72c0722d0 2024-08-18T23:58:13.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.819+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 --> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe7480d03c0 con 0x7fe72c0722d0 2024-08-18T23:58:13.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe7457fa640 1 -- 172.21.15.103:0/2343853172 <== osd.4 v2:172.21.15.190:6816/491823420 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe7480d03c0 con 0x7fe72c0722d0 2024-08-18T23:58:13.821 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:58:13.821 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T23:58:13.822 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:58:13.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7fe72c0722d0 msgr2=0x7fe72c074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.190:6816/491823420,v1:172.21.15.190:6817/491823420] conn(0x7fe72c0722d0 0x7fe72c074710 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe72c06be30 msgr2=0x7fe72c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fe72c06be30 0x7fe72c06e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe748068c40 tx=0x7fe734008040 comp rx=0 tx=0).stop 2024-08-18T23:58:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 msgr2=0x7fe74814aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 --2- 172.21.15.103:0/2343853172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe74806f8d0 0x7fe74814aff0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c430 tx=0x7fe73c00c8f0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74d41a640 1 -- 172.21.15.103:0/2343853172 reap_dead start 2024-08-18T23:58:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 shutdown_connections 2024-08-18T23:58:13.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 >> 172.21.15.103:0/2343853172 conn(0x7fe7480d0650 msgr2=0x7fe74815a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 shutdown_connections 2024-08-18T23:58:13.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.820+0000 7fe74ee7d640 1 -- 172.21.15.103:0/2343853172 wait complete. 2024-08-18T23:58:13.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-18T23:58:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.931+0000 7f91aa8fc640 1 Processor -- start 2024-08-18T23:58:13.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.931+0000 7f91aa8fc640 1 -- start start 2024-08-18T23:58:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.931+0000 7f91aa8fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a406f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.931+0000 7f91aa8fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91a406d3f0 0x7f91a4072b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.931+0000 7f91aa8fc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91a406f710 con 0x7f91a406c6c0 2024-08-18T23:58:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.931+0000 7f91aa8fc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f91a4073080 con 0x7f91a406d3f0 2024-08-18T23:58:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91aa8fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f91a406d8b0 con 0x7f91a4072760 2024-08-18T23:58:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a37fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91a406d3f0 0x7f91a4072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a37fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91a406d3f0 0x7f91a4072b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:60346/0 (socket says 172.21.15.103:60346) 2024-08-18T23:58:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a37fe640 1 -- 172.21.15.103:0/2726720436 learned_addr learned my addr 172.21.15.103:0/2726720436 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a3fff640 1 --2- 172.21.15.103:0/2726720436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a406f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a3fff640 1 -- 172.21.15.103:0/2726720436 >> v2:172.21.15.190:3300/0 conn(0x7f91a406d3f0 msgr2=0x7f91a4072b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a3fff640 1 --2- 172.21.15.103:0/2726720436 >> v2:172.21.15.190:3300/0 conn(0x7f91a406d3f0 0x7f91a4072b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a3fff640 1 -- 172.21.15.103:0/2726720436 >> v1:172.21.15.190:6789/0 conn(0x7f91a406c6c0 legacy=0x7f91a40af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a2ffd640 1 -- 172.21.15.103:0/2726720436 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731755911 0 0) 0x7f919c001490 con 0x7f91a406c6c0 2024-08-18T23:58:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a3fff640 1 -- 172.21.15.103:0/2726720436 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a406b900 con 0x7f91a4072760 2024-08-18T23:58:13.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.932+0000 7f91a37fe640 1 --2- 172.21.15.103:0/2726720436 >> v2:172.21.15.190:3300/0 conn(0x7f91a406d3f0 0x7f91a4072b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.933+0000 7f91a3fff640 1 --2- 172.21.15.103:0/2726720436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a406f1d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f91940097a0 tx=0x7f919402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=683842766a478ce7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.933+0000 7f91a2ffd640 1 -- 172.21.15.103:0/2726720436 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194037070 con 0x7f91a4072760 2024-08-18T23:58:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.933+0000 7f91a2ffd640 1 -- 172.21.15.103:0/2726720436 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9194032440 con 0x7f91a4072760 2024-08-18T23:58:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.933+0000 7f91a2ffd640 1 -- 172.21.15.103:0/2726720436 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194032810 con 0x7f91a4072760 2024-08-18T23:58:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.934+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2726720436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 msgr2=0x7f91a406f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.934+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2726720436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a406f1d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f91940097a0 tx=0x7f919402a180 comp rx=0 tx=0).stop 2024-08-18T23:58:13.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.934+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2726720436 shutdown_connections 2024-08-18T23:58:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.934+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2726720436 >> v2:172.21.15.190:3300/0 conn(0x7f91a406d3f0 0x7f91a4072b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.934+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2726720436 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a406f1d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.934+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2726720436 >> 172.21.15.103:0/2726720436 conn(0x7f91a40b2b80 msgr2=0x7f91a40b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.934+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2726720436 shutdown_connections 2024-08-18T23:58:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.934+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2726720436 wait complete. 2024-08-18T23:58:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.935+0000 7f91aa8fc640 1 Processor -- start 2024-08-18T23:58:13.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.935+0000 7f91aa8fc640 1 -- start start 2024-08-18T23:58:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91aa8fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a406c6c0 0x7f91a40cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91aa8fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a406d3f0 0x7f91a409c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91aa8fc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a409ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91aa8fc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f91a406c1a0 con 0x7f91a406c6c0 2024-08-18T23:58:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91aa8fc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f91a406bec0 con 0x7f91a406d3f0 2024-08-18T23:58:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91aa8fc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f91a415cfc0 con 0x7f91a4072760 2024-08-18T23:58:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a406c6c0 0x7f91a40cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a406c6c0 0x7f91a40cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57408/0 (socket says 172.21.15.103:57408) 2024-08-18T23:58:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a3fff640 1 -- 172.21.15.103:0/2246116596 learned_addr learned my addr 172.21.15.103:0/2246116596 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a37fe640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a406d3f0 0x7f91a409c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a8e99640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a409ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a3fff640 1 -- 172.21.15.103:0/2246116596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 msgr2=0x7f91a409ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a3fff640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a409ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a3fff640 1 -- 172.21.15.103:0/2246116596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a406d3f0 msgr2=0x7f91a409c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a3fff640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a406d3f0 0x7f91a409c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.936+0000 7f91a3fff640 1 -- 172.21.15.103:0/2246116596 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a409d4a0 con 0x7f91a406c6c0 2024-08-18T23:58:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.937+0000 7f91a3fff640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a406c6c0 0x7f91a40cffd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9194035040 tx=0x7f91940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.937+0000 7f91a0ff9640 1 -- 172.21.15.103:0/2246116596 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194037040 con 0x7f91a406c6c0 2024-08-18T23:58:13.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.937+0000 7f91a0ff9640 1 -- 172.21.15.103:0/2246116596 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9194004230 con 0x7f91a406c6c0 2024-08-18T23:58:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.937+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a409d780 con 0x7f91a406c6c0 2024-08-18T23:58:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.937+0000 7f91a0ff9640 1 -- 172.21.15.103:0/2246116596 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9194003610 con 0x7f91a406c6c0 2024-08-18T23:58:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.937+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a4149a40 con 0x7f91a406c6c0 2024-08-18T23:58:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.938+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a4149550 con 0x7f91a406c6c0 2024-08-18T23:58:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.939+0000 7f91a0ff9640 1 -- 172.21.15.103:0/2246116596 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91940037b0 con 0x7f91a406c6c0 2024-08-18T23:58:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.939+0000 7f91a0ff9640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f918406be30 0x7f918406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.939+0000 7f91a0ff9640 1 -- 172.21.15.103:0/2246116596 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f91940abe70 con 0x7f91a406c6c0 2024-08-18T23:58:13.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.939+0000 7f91a37fe640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f918406be30 0x7f918406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:13.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.939+0000 7f91a37fe640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f918406be30 0x7f918406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f91a409f140 tx=0x7f918c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:13.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:13.943+0000 7f91a0ff9640 1 -- 172.21.15.103:0/2246116596 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f919407a990 con 0x7f91a406c6c0 2024-08-18T23:58:14.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.110+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f91a4072b40 con 0x7f918406be30 2024-08-18T23:58:14.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.110+0000 7f91a0ff9640 1 -- 172.21.15.103:0/2246116596 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f91a4072b40 con 0x7f918406be30 2024-08-18T23:58:14.112 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 4 to deep-scrub 2024-08-18T23:58:14.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f918406be30 msgr2=0x7f918406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f918406be30 0x7f918406e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f91a409f140 tx=0x7f918c008040 comp rx=0 tx=0).stop 2024-08-18T23:58:14.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a406c6c0 msgr2=0x7f91a40cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a406c6c0 0x7f91a40cffd0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9194035040 tx=0x7f91940046c0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 shutdown_connections 2024-08-18T23:58:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f918406be30 0x7f918406e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a4072760 0x7f91a409ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a406d3f0 0x7f91a409c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 --2- 172.21.15.103:0/2246116596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91a406c6c0 0x7f91a40cffd0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 >> 172.21.15.103:0/2246116596 conn(0x7f91a40b2b80 msgr2=0x7f91a406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 shutdown_connections 2024-08-18T23:58:14.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.113+0000 7f91aa8fc640 1 -- 172.21.15.103:0/2246116596 wait complete. 2024-08-18T23:58:14.125 INFO:tasks.ceph:Scrubbing osd.5 2024-08-18T23:58:14.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-18T23:58:14.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.227+0000 7fc22a944640 1 Processor -- start 2024-08-18T23:58:14.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.227+0000 7fc22a944640 1 -- start start 2024-08-18T23:58:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc22a944640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc22415e150 0x7fc2240ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc22a944640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 0x7fc2240d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc22a944640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2240cf270 con 0x7fc2240701d0 2024-08-18T23:58:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc22a944640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc224070c20 con 0x7fc22415e150 2024-08-18T23:58:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc22a944640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc224070660 con 0x7fc2240d1270 2024-08-18T23:58:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc2237fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fc2240701d0 0x7fc2240ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51192/0 (socket says 172.21.15.103:51192) 2024-08-18T23:58:14.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc2237fe640 1 -- 172.21.15.103:0/3653721796 learned_addr learned my addr 172.21.15.103:0/3653721796 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:14.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc228ee1640 1 --2- 172.21.15.103:0/3653721796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 0x7fc2240d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc223fff640 1 --2- 172.21.15.103:0/3653721796 >> v2:172.21.15.190:3300/0 conn(0x7fc22415e150 0x7fc2240ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc222ffd640 1 -- 172.21.15.103:0/3653721796 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627274500 0 0) 0x7fc2240cf270 con 0x7fc2240701d0 2024-08-18T23:58:14.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.228+0000 7fc222ffd640 1 -- 172.21.15.103:0/3653721796 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc20c003520 con 0x7fc2240701d0 2024-08-18T23:58:14.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.229+0000 7fc228ee1640 1 -- 172.21.15.103:0/3653721796 >> v2:172.21.15.190:3300/0 conn(0x7fc22415e150 msgr2=0x7fc2240ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:14.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.229+0000 7fc228ee1640 1 --2- 172.21.15.103:0/3653721796 >> v2:172.21.15.190:3300/0 conn(0x7fc22415e150 0x7fc2240ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.229+0000 7fc228ee1640 1 -- 172.21.15.103:0/3653721796 >> v1:172.21.15.103:6789/0 conn(0x7fc2240701d0 legacy=0x7fc2240ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.229+0000 7fc228ee1640 1 -- 172.21.15.103:0/3653721796 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc224070940 con 0x7fc2240d1270 2024-08-18T23:58:14.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.229+0000 7fc223fff640 1 --2- 172.21.15.103:0/3653721796 >> v2:172.21.15.190:3300/0 conn(0x7fc22415e150 0x7fc2240ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:14.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.229+0000 7fc228ee1640 1 --2- 172.21.15.103:0/3653721796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 0x7fc2240d01d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009d90 tx=0x7fc21c02a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=866383e6c5456985 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.229+0000 7fc222ffd640 1 -- 172.21.15.103:0/3653721796 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c007740 con 0x7fc2240d1270 2024-08-18T23:58:14.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc222ffd640 1 -- 172.21.15.103:0/3653721796 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc21c0078e0 con 0x7fc2240d1270 2024-08-18T23:58:14.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc222ffd640 1 -- 172.21.15.103:0/3653721796 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c007c90 con 0x7fc2240d1270 2024-08-18T23:58:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc22a944640 1 -- 172.21.15.103:0/3653721796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 msgr2=0x7fc2240d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc22a944640 1 --2- 172.21.15.103:0/3653721796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 0x7fc2240d01d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009d90 tx=0x7fc21c02a6f0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc22a944640 1 -- 172.21.15.103:0/3653721796 shutdown_connections 2024-08-18T23:58:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc22a944640 1 --2- 172.21.15.103:0/3653721796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 0x7fc2240d01d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc22a944640 1 --2- 172.21.15.103:0/3653721796 >> v2:172.21.15.190:3300/0 conn(0x7fc22415e150 0x7fc2240ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc22a944640 1 -- 172.21.15.103:0/3653721796 >> 172.21.15.103:0/3653721796 conn(0x7fc2240d1eb0 msgr2=0x7fc2240d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc22a944640 1 -- 172.21.15.103:0/3653721796 shutdown_connections 2024-08-18T23:58:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.230+0000 7fc22a944640 1 -- 172.21.15.103:0/3653721796 wait complete. 2024-08-18T23:58:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.231+0000 7fc22a944640 1 Processor -- start 2024-08-18T23:58:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.231+0000 7fc22a944640 1 -- start start 2024-08-18T23:58:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc22a944640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 0x7fc2240b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc22a944640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc22415e150 0x7fc2241610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc22a944640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2241f55d0 0x7fc22415ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc22a944640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc22415e530 con 0x7fc22415e150 2024-08-18T23:58:14.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc22a944640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc22406ce90 con 0x7fc2241f55d0 2024-08-18T23:58:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc22a944640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc22415e6b0 con 0x7fc2240d1270 2024-08-18T23:58:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc2237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc22415e150 0x7fc2241610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc2237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc22415e150 0x7fc2241610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57414/0 (socket says 172.21.15.103:57414) 2024-08-18T23:58:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc2237fe640 1 -- 172.21.15.103:0/1836472573 learned_addr learned my addr 172.21.15.103:0/1836472573 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc228ee1640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2241f55d0 0x7fc22415ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.232+0000 7fc223fff640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 0x7fc2240b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc2237fe640 1 -- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 msgr2=0x7fc2240b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc2237fe640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2240d1270 0x7fc2240b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc2237fe640 1 -- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2241f55d0 msgr2=0x7fc22415ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc2237fe640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2241f55d0 0x7fc22415ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc2237fe640 1 -- 172.21.15.103:0/1836472573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2240b5dd0 con 0x7fc22415e150 2024-08-18T23:58:14.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc2237fe640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc22415e150 0x7fc2241610c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc21800c430 tx=0x7fc21800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218017070 con 0x7fc22415e150 2024-08-18T23:58:14.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc218005ce0 con 0x7fc22415e150 2024-08-18T23:58:14.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2241617f0 con 0x7fc22415e150 2024-08-18T23:58:14.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2180072f0 con 0x7fc22415e150 2024-08-18T23:58:14.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.233+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2240b6350 con 0x7fc22415e150 2024-08-18T23:58:14.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.234+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc224075440 con 0x7fc22415e150 2024-08-18T23:58:14.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.234+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc21801a070 con 0x7fc22415e150 2024-08-18T23:58:14.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.235+0000 7fc220ff9640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc21006be30 0x7fc21006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.235+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7fc21808a160 con 0x7fc22415e150 2024-08-18T23:58:14.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.235+0000 7fc223fff640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc21006be30 0x7fc21006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.235+0000 7fc220ff9640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fc2100722d0 0x7fc210074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.235+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 --> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc218015e70 con 0x7fc2100722d0 2024-08-18T23:58:14.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.235+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7fc218091050 con 0x7fc22415e150 2024-08-18T23:58:14.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.235+0000 7fc228ee1640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fc2100722d0 0x7fc210074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.235+0000 7fc223fff640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc21006be30 0x7fc21006e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2240cde90 tx=0x7fc214008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.236+0000 7fc228ee1640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fc2100722d0 0x7fc210074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.236+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 <== osd.5 v2:172.21.15.190:6800/1802306472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc218015e70 con 0x7fc2100722d0 2024-08-18T23:58:14.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.249+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 --> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc2240ce620 con 0x7fc2100722d0 2024-08-18T23:58:14.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.249+0000 7fc220ff9640 1 -- 172.21.15.103:0/1836472573 <== osd.5 v2:172.21.15.190:6800/1802306472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc2240ce620 con 0x7fc2100722d0 2024-08-18T23:58:14.251 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:58:14.251 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T23:58:14.251 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:58:14.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.249+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fc2100722d0 msgr2=0x7fc210074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.249+0000 7fc22a944640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.190:6800/1802306472,v1:172.21.15.190:6801/1802306472] conn(0x7fc2100722d0 0x7fc210074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.249+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc21006be30 msgr2=0x7fc21006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.250+0000 7fc22a944640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7fc21006be30 0x7fc21006e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc2240cde90 tx=0x7fc214008040 comp rx=0 tx=0).stop 2024-08-18T23:58:14.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.250+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc22415e150 msgr2=0x7fc2241610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.250+0000 7fc22a944640 1 --2- 172.21.15.103:0/1836472573 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc22415e150 0x7fc2241610c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc21800c430 tx=0x7fc21800c8f0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.250+0000 7fc228ee1640 1 -- 172.21.15.103:0/1836472573 reap_dead start 2024-08-18T23:58:14.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.250+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 shutdown_connections 2024-08-18T23:58:14.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.250+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 >> 172.21.15.103:0/1836472573 conn(0x7fc2240d1eb0 msgr2=0x7fc2240ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.250+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 shutdown_connections 2024-08-18T23:58:14.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.250+0000 7fc22a944640 1 -- 172.21.15.103:0/1836472573 wait complete. 2024-08-18T23:58:14.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-18T23:58:14.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.359+0000 7f6113d4d640 1 Processor -- start 2024-08-18T23:58:14.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.359+0000 7f6113d4d640 1 -- start start 2024-08-18T23:58:14.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6113d4d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f610c0cf4d0 0x7f610c06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6113d4d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c0cf8b0 0x7f610c0cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6113d4d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c06b900 con 0x7f610c15faf0 2024-08-18T23:58:14.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6113d4d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f610c06bbe0 con 0x7f610c0cf4d0 2024-08-18T23:58:14.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6113d4d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f610c06bec0 con 0x7f610c0cf8b0 2024-08-18T23:58:14.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6111ae9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f610c0cf4d0 0x7f610c06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f61122ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c0cf8b0 0x7f610c0cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6111ae9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f610c0cf4d0 0x7f610c06cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.103:60390/0 (socket says 172.21.15.103:60390) 2024-08-18T23:58:14.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f61122ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c0cf8b0 0x7f610c0cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.103:38084/0 (socket says 172.21.15.103:38084) 2024-08-18T23:58:14.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6111ae9640 1 -- 172.21.15.103:0/2645281595 learned_addr learned my addr 172.21.15.103:0/2645281595 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:14.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f61112e8640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f610c15faf0 0x7f610c15ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.103:38236/0 (socket says 172.21.15.103:38236) 2024-08-18T23:58:14.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6111ae9640 1 -- 172.21.15.103:0/2645281595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c0cf8b0 msgr2=0x7f610c0cfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:14.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6111ae9640 1 --2- 172.21.15.103:0/2645281595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c0cf8b0 0x7f610c0cfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6111ae9640 1 -- 172.21.15.103:0/2645281595 >> v1:172.21.15.190:6789/0 conn(0x7f610c15faf0 legacy=0x7f610c15ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6111ae9640 1 -- 172.21.15.103:0/2645281595 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c06c1a0 con 0x7f610c0cf4d0 2024-08-18T23:58:14.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f6110ae7640 1 -- 172.21.15.103:0/2645281595 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3718631273 0 0) 0x7f610c06b900 con 0x7f610c15faf0 2024-08-18T23:58:14.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.360+0000 7f61122ea640 1 --2- 172.21.15.103:0/2645281595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c0cf8b0 0x7f610c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.361+0000 7f6111ae9640 1 --2- 172.21.15.103:0/2645281595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf4d0 0x7f610c06cc80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009870 tx=0x7f60fc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ad53a719e8d0132 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.361+0000 7f6110ae7640 1 -- 172.21.15.103:0/2645281595 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc037070 con 0x7f610c0cf4d0 2024-08-18T23:58:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.361+0000 7f6110ae7640 1 -- 172.21.15.103:0/2645281595 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc032440 con 0x7f610c0cf4d0 2024-08-18T23:58:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.361+0000 7f6110ae7640 1 -- 172.21.15.103:0/2645281595 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc032810 con 0x7f610c0cf4d0 2024-08-18T23:58:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.362+0000 7f6113d4d640 1 -- 172.21.15.103:0/2645281595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf4d0 msgr2=0x7f610c06cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.362+0000 7f6113d4d640 1 --2- 172.21.15.103:0/2645281595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf4d0 0x7f610c06cc80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009870 tx=0x7f60fc02a270 comp rx=0 tx=0).stop 2024-08-18T23:58:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.362+0000 7f6113d4d640 1 -- 172.21.15.103:0/2645281595 shutdown_connections 2024-08-18T23:58:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.362+0000 7f6113d4d640 1 --2- 172.21.15.103:0/2645281595 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c0cf8b0 0x7f610c0cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.362+0000 7f6113d4d640 1 --2- 172.21.15.103:0/2645281595 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf4d0 0x7f610c06cc80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.362+0000 7f6113d4d640 1 -- 172.21.15.103:0/2645281595 >> 172.21.15.103:0/2645281595 conn(0x7f610c0d05c0 msgr2=0x7f610c0d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.362+0000 7f6113d4d640 1 -- 172.21.15.103:0/2645281595 shutdown_connections 2024-08-18T23:58:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.362+0000 7f6113d4d640 1 -- 172.21.15.103:0/2645281595 wait complete. 2024-08-18T23:58:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.363+0000 7f6113d4d640 1 Processor -- start 2024-08-18T23:58:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.363+0000 7f6113d4d640 1 -- start start 2024-08-18T23:58:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6113d4d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c0cf4d0 0x7f610c140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6113d4d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf8b0 0x7f610c0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6113d4d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c15faf0 0x7f610c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6113d4d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f610c06d1c0 con 0x7f610c0cf4d0 2024-08-18T23:58:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6113d4d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f610c06c760 con 0x7f610c0cf8b0 2024-08-18T23:58:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6113d4d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f610c0d0260 con 0x7f610c15faf0 2024-08-18T23:58:14.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c0cf4d0 0x7f610c140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c0cf4d0 0x7f610c140270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57428/0 (socket says 172.21.15.103:57428) 2024-08-18T23:58:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 -- 172.21.15.103:0/1282754576 learned_addr learned my addr 172.21.15.103:0/1282754576 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f61112e8640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf8b0 0x7f610c0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f61122ea640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c15faf0 0x7f610c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 -- 172.21.15.103:0/1282754576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c15faf0 msgr2=0x7f610c142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c15faf0 0x7f610c142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 -- 172.21.15.103:0/1282754576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf8b0 msgr2=0x7f610c0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf8b0 0x7f610c0aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 -- 172.21.15.103:0/1282754576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c144fa0 con 0x7f610c0cf4d0 2024-08-18T23:58:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6111ae9640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c0cf4d0 0x7f610c140270 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f60fc035040 tx=0x7f60fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f610a7fc640 1 -- 172.21.15.103:0/1282754576 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc037040 con 0x7f610c0cf4d0 2024-08-18T23:58:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f610a7fc640 1 -- 172.21.15.103:0/1282754576 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc004030 con 0x7f610c0cf4d0 2024-08-18T23:58:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c145280 con 0x7f610c0cf4d0 2024-08-18T23:58:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.364+0000 7f610a7fc640 1 -- 172.21.15.103:0/1282754576 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc004420 con 0x7f610c0cf4d0 2024-08-18T23:58:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.365+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c145840 con 0x7f610c0cf4d0 2024-08-18T23:58:14.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.365+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c06cc80 con 0x7f610c0cf4d0 2024-08-18T23:58:14.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.366+0000 7f610a7fc640 1 -- 172.21.15.103:0/1282754576 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f60fc03a070 con 0x7f610c0cf4d0 2024-08-18T23:58:14.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.366+0000 7f610a7fc640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60f806be30 0x7f60f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.366+0000 7f610a7fc640 1 -- 172.21.15.103:0/1282754576 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f60fc0ab290 con 0x7f610c0cf4d0 2024-08-18T23:58:14.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.366+0000 7f61112e8640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60f806be30 0x7f60f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.367+0000 7f61112e8640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60f806be30 0x7f60f806e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f610c0ce360 tx=0x7f6100007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.371+0000 7f610a7fc640 1 -- 172.21.15.103:0/1282754576 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f60fc041020 con 0x7f610c0cf4d0 2024-08-18T23:58:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.538+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f610c140bc0 con 0x7f60f806be30 2024-08-18T23:58:14.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.538+0000 7f610a7fc640 1 -- 172.21.15.103:0/1282754576 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f610c140bc0 con 0x7f60f806be30 2024-08-18T23:58:14.540 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 5 to deep-scrub 2024-08-18T23:58:14.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60f806be30 msgr2=0x7f60f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60f806be30 0x7f60f806e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f610c0ce360 tx=0x7f6100007ed0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c0cf4d0 msgr2=0x7f610c140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c0cf4d0 0x7f610c140270 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f60fc035040 tx=0x7f60fc0046c0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 shutdown_connections 2024-08-18T23:58:14.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f60f806be30 0x7f60f806e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f610c15faf0 0x7f610c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f610c0cf8b0 0x7f610c0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 --2- 172.21.15.103:0/1282754576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f610c0cf4d0 0x7f610c140270 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 >> 172.21.15.103:0/1282754576 conn(0x7f610c0d05c0 msgr2=0x7f610c0af620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 shutdown_connections 2024-08-18T23:58:14.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.540+0000 7f6113d4d640 1 -- 172.21.15.103:0/1282754576 wait complete. 2024-08-18T23:58:14.552 INFO:tasks.ceph:Scrubbing osd.6 2024-08-18T23:58:14.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-18T23:58:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.652+0000 7ff74474b640 1 Processor -- start 2024-08-18T23:58:14.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.652+0000 7ff74474b640 1 -- start start 2024-08-18T23:58:14.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.653+0000 7ff74474b640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff73c161a00 0x7ff73c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.653+0000 7ff74474b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 0x7ff73c0b7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff74474b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff73c0d28a0 con 0x7ff73c0d4930 2024-08-18T23:58:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff74474b640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7ff73c0d2650 con 0x7ff73c161a00 2024-08-18T23:58:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff74474b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff73c0b6ec0 con 0x7ff73c0cf860 2024-08-18T23:58:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff7424e7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff73c161a00 0x7ff73c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff7424e7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff73c161a00 0x7ff73c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57440/0 (socket says 172.21.15.103:57440) 2024-08-18T23:58:14.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff7424e7640 1 -- 172.21.15.103:0/4132809928 learned_addr learned my addr 172.21.15.103:0/4132809928 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff742ce8640 1 --2- 172.21.15.103:0/4132809928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 0x7ff73c0b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff7424e7640 1 -- 172.21.15.103:0/4132809928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 msgr2=0x7ff73c0b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff7424e7640 1 --2- 172.21.15.103:0/4132809928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 0x7ff73c0b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff7424e7640 1 -- 172.21.15.103:0/4132809928 >> v1:172.21.15.190:6789/0 conn(0x7ff73c0d4930 legacy=0x7ff73c0cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.654+0000 7ff7424e7640 1 -- 172.21.15.103:0/4132809928 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73c0d2b80 con 0x7ff73c161a00 2024-08-18T23:58:14.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff7424e7640 1 --2- 172.21.15.103:0/4132809928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c161a00 0x7ff73c0cec10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009e50 tx=0x7ff72c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22af5aab42165d4e server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff7414e5640 1 -- 172.21.15.103:0/4132809928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c036070 con 0x7ff73c161a00 2024-08-18T23:58:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff7414e5640 1 -- 172.21.15.103:0/4132809928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff72c031600 con 0x7ff73c161a00 2024-08-18T23:58:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff7414e5640 1 -- 172.21.15.103:0/4132809928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c0319d0 con 0x7ff73c161a00 2024-08-18T23:58:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff74474b640 1 -- 172.21.15.103:0/4132809928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c161a00 msgr2=0x7ff73c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff74474b640 1 --2- 172.21.15.103:0/4132809928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c161a00 0x7ff73c0cec10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff72c009e50 tx=0x7ff72c02a7a0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff74474b640 1 -- 172.21.15.103:0/4132809928 shutdown_connections 2024-08-18T23:58:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff74474b640 1 --2- 172.21.15.103:0/4132809928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 0x7ff73c0b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff74474b640 1 --2- 172.21.15.103:0/4132809928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c161a00 0x7ff73c0cec10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff74474b640 1 -- 172.21.15.103:0/4132809928 >> 172.21.15.103:0/4132809928 conn(0x7ff73c09d420 msgr2=0x7ff73c0d4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.655+0000 7ff74474b640 1 -- 172.21.15.103:0/4132809928 shutdown_connections 2024-08-18T23:58:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.656+0000 7ff74474b640 1 -- 172.21.15.103:0/4132809928 wait complete. 2024-08-18T23:58:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff74474b640 1 Processor -- start 2024-08-18T23:58:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff74474b640 1 -- start start 2024-08-18T23:58:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff74474b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 0x7ff73c152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff74474b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c0d4930 0x7ff73c15b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff74474b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff73c161a00 0x7ff73c15bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff74474b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c0b7890 con 0x7ff73c0d4930 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff74474b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c0d17c0 con 0x7ff73c161a00 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff74474b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff73c0b7a10 con 0x7ff73c0cf860 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.657+0000 7ff741ce6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c0d4930 0x7ff73c15b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff741ce6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c0d4930 0x7ff73c15b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57442/0 (socket says 172.21.15.103:57442) 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff741ce6640 1 -- 172.21.15.103:0/4092273896 learned_addr learned my addr 172.21.15.103:0/4092273896 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff742ce8640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff73c161a00 0x7ff73c15bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff7424e7640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 0x7ff73c152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff741ce6640 1 -- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 msgr2=0x7ff73c152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff741ce6640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff73c0cf860 0x7ff73c152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff741ce6640 1 -- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff73c161a00 msgr2=0x7ff73c15bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff741ce6640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff73c161a00 0x7ff73c15bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff741ce6640 1 -- 172.21.15.103:0/4092273896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73c160740 con 0x7ff73c0d4930 2024-08-18T23:58:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff741ce6640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c0d4930 0x7ff73c15b790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c430 tx=0x7ff73000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7300052d0 con 0x7ff73c0d4930 2024-08-18T23:58:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff730005490 con 0x7ff73c0d4930 2024-08-18T23:58:14.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730007260 con 0x7ff73c0d4930 2024-08-18T23:58:14.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73c0cd900 con 0x7ff73c0d4930 2024-08-18T23:58:14.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.658+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff73c0cdec0 con 0x7ff73c0d4930 2024-08-18T23:58:14.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.659+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff73c0b7350 con 0x7ff73c0d4930 2024-08-18T23:58:14.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.660+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff730007400 con 0x7ff73c0d4930 2024-08-18T23:58:14.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.660+0000 7ff73affd640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff72806be30 0x7ff72806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.660+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7ff73008a970 con 0x7ff73c0d4930 2024-08-18T23:58:14.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.660+0000 7ff7424e7640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff72806be30 0x7ff72806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.660+0000 7ff73affd640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7ff7280722d0 0x7ff728074710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.660+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 --> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff730010e50 con 0x7ff7280722d0 2024-08-18T23:58:14.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.660+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7ff73008ae00 con 0x7ff73c0d4930 2024-08-18T23:58:14.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.661+0000 7ff742ce8640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7ff7280722d0 0x7ff728074710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.661+0000 7ff7424e7640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff72806be30 0x7ff72806e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff72c033000 tx=0x7ff72c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.661+0000 7ff742ce8640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7ff7280722d0 0x7ff728074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.662+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 <== osd.6 v2:172.21.15.190:6824/1150487598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff730010e50 con 0x7ff7280722d0 2024-08-18T23:58:14.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.674+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 --> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff73c0d0d60 con 0x7ff7280722d0 2024-08-18T23:58:14.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff73affd640 1 -- 172.21.15.103:0/4092273896 <== osd.6 v2:172.21.15.190:6824/1150487598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff73c0d0d60 con 0x7ff7280722d0 2024-08-18T23:58:14.677 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:58:14.677 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T23:58:14.677 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:58:14.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7ff7280722d0 msgr2=0x7ff728074710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.190:6824/1150487598,v1:172.21.15.190:6825/1150487598] conn(0x7ff7280722d0 0x7ff728074710 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff72806be30 msgr2=0x7ff72806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7ff72806be30 0x7ff72806e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff72c033000 tx=0x7ff72c009000 comp rx=0 tx=0).stop 2024-08-18T23:58:14.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c0d4930 msgr2=0x7ff73c15b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 --2- 172.21.15.103:0/4092273896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff73c0d4930 0x7ff73c15b790 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff73000c430 tx=0x7ff73000c8f0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff742ce8640 1 -- 172.21.15.103:0/4092273896 reap_dead start 2024-08-18T23:58:14.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 shutdown_connections 2024-08-18T23:58:14.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 >> 172.21.15.103:0/4092273896 conn(0x7ff73c09d420 msgr2=0x7ff73c06dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 shutdown_connections 2024-08-18T23:58:14.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.675+0000 7ff74474b640 1 -- 172.21.15.103:0/4092273896 wait complete. 2024-08-18T23:58:14.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-18T23:58:14.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.785+0000 7f37336bc640 1 Processor -- start 2024-08-18T23:58:14.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.785+0000 7f37336bc640 1 -- start start 2024-08-18T23:58:14.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f37336bc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 0x7f372c071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f37336bc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f372c15e170 0x7f372c15e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.790 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f37336bc640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f372c15ead0 con 0x7f372c0ce260 2024-08-18T23:58:14.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f37336bc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f372c0ceeb0 con 0x7f372c15e170 2024-08-18T23:58:14.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f37336bc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f372c0c4b20 con 0x7f372c15a5f0 2024-08-18T23:58:14.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3731c59640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f372c0ce260 0x7f372c0c58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51196/0 (socket says 172.21.15.103:51196) 2024-08-18T23:58:14.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3731c59640 1 -- 172.21.15.103:0/2647309654 learned_addr learned my addr 172.21.15.103:0/2647309654 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:14.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3731458640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 0x7f372c071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3730c57640 1 --2- 172.21.15.103:0/2647309654 >> v2:172.21.15.190:3300/0 conn(0x7f372c15e170 0x7f372c15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448310937 0 0) 0x7f372c15ead0 con 0x7f372c0ce260 2024-08-18T23:58:14.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3718004630 con 0x7f372c0ce260 2024-08-18T23:58:14.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2608110506 0 0) 0x7f3718004630 con 0x7f372c0ce260 2024-08-18T23:58:14.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 msgr2=0x7f372c071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:14.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 0x7f372c071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 >> v2:172.21.15.190:3300/0 conn(0x7f372c15e170 msgr2=0x7f372c15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:14.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 --2- 172.21.15.103:0/2647309654 >> v2:172.21.15.190:3300/0 conn(0x7f372c15e170 0x7f372c15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c0c4e00 con 0x7f372c0ce260 2024-08-18T23:58:14.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f37240019f0 con 0x7f372c0ce260 2024-08-18T23:58:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 >> v1:172.21.15.103:6789/0 conn(0x7f372c0ce260 legacy=0x7f372c0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f3718004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.786+0000 7f3723fff640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718005910 0x7f3718005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3723fff640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 0x7f37180062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f372c0ceeb0 con 0x7f3718004ac0 2024-08-18T23:58:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f372c0c4b20 con 0x7f3718005910 2024-08-18T23:58:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f371800cad0 con 0x7f372c15a5f0 2024-08-18T23:58:14.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3731458640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f3718004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3730c57640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718005910 0x7f3718005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3731c59640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 0x7f37180062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3731458640 1 -- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 msgr2=0x7f37180062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:14.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3731458640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 0x7f37180062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3731458640 1 -- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718005910 msgr2=0x7f3718005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:14.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3731458640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718005910 0x7f3718005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3731458640 1 -- 172.21.15.103:0/2647309654 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3718004630 con 0x7f3718004ac0 2024-08-18T23:58:14.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.787+0000 7f3731c59640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c15a5f0 0x7f37180062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:14.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f3731458640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f3718004ee0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3728009ac0 tx=0x7f3718006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ce55364140e6f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728036070 con 0x7f3718004ac0 2024-08-18T23:58:14.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3728031400 con 0x7f3718004ac0 2024-08-18T23:58:14.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f3723fff640 1 -- 172.21.15.103:0/2647309654 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728009690 con 0x7f3718004ac0 2024-08-18T23:58:14.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f37336bc640 1 -- 172.21.15.103:0/2647309654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 msgr2=0x7f3718004ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f37336bc640 1 --2- 172.21.15.103:0/2647309654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f3718004ee0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3728009ac0 tx=0x7f3718006940 comp rx=0 tx=0).stop 2024-08-18T23:58:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f3731c59640 1 -- 172.21.15.103:0/2647309654 reap_dead start 2024-08-18T23:58:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f37336bc640 1 -- 172.21.15.103:0/2647309654 shutdown_connections 2024-08-18T23:58:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f37336bc640 1 -- 172.21.15.103:0/2647309654 >> 172.21.15.103:0/2647309654 conn(0x7f372c0cc6e0 msgr2=0x7f372c0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f37336bc640 1 -- 172.21.15.103:0/2647309654 shutdown_connections 2024-08-18T23:58:14.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.788+0000 7f37336bc640 1 -- 172.21.15.103:0/2647309654 wait complete. 2024-08-18T23:58:14.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.789+0000 7f37336bc640 1 Processor -- start 2024-08-18T23:58:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f37336bc640 1 -- start start 2024-08-18T23:58:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f37336bc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f372c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f37336bc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c0b4d80 0x7f372c0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f37336bc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f372c15ab50 0x7f372c15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f37336bc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f372c15a9d0 con 0x7f3718004ac0 2024-08-18T23:58:14.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f37336bc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f372c0c53c0 con 0x7f372c15ab50 2024-08-18T23:58:14.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f37336bc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f372c0c5ff0 con 0x7f372c0b4d80 2024-08-18T23:58:14.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f3731458640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f372c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f3731458640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f372c14e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57466/0 (socket says 172.21.15.103:57466) 2024-08-18T23:58:14.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f3731458640 1 -- 172.21.15.103:0/3279336384 learned_addr learned my addr 172.21.15.103:0/3279336384 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:14.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f3730c57640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c0b4d80 0x7f372c0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.790+0000 7f3731c59640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f372c15ab50 0x7f372c15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3731458640 1 -- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c0b4d80 msgr2=0x7f372c0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3731458640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c0b4d80 0x7f372c0b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3731458640 1 -- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f372c15ab50 msgr2=0x7f372c15afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3731458640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f372c15ab50 0x7f372c15afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3731458640 1 -- 172.21.15.103:0/3279336384 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c09cea0 con 0x7f3718004ac0 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3731c59640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f372c15ab50 0x7f372c15afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3730c57640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c0b4d80 0x7f372c0b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3731458640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f372c14e7f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3728009be0 tx=0x7f3728004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3721ffb640 1 -- 172.21.15.103:0/3279336384 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728040020 con 0x7f3718004ac0 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3721ffb640 1 -- 172.21.15.103:0/3279336384 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3728003bc0 con 0x7f3718004ac0 2024-08-18T23:58:14.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372c09d180 con 0x7f3718004ac0 2024-08-18T23:58:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f3721ffb640 1 -- 172.21.15.103:0/3279336384 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728036040 con 0x7f3718004ac0 2024-08-18T23:58:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.791+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372c09d740 con 0x7f3718004ac0 2024-08-18T23:58:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.792+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372c0c6420 con 0x7f3718004ac0 2024-08-18T23:58:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.793+0000 7f3721ffb640 1 -- 172.21.15.103:0/3279336384 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3728043020 con 0x7f3718004ac0 2024-08-18T23:58:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.793+0000 7f3721ffb640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f371006be30 0x7f371006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.793+0000 7f3721ffb640 1 -- 172.21.15.103:0/3279336384 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f37280aa860 con 0x7f3718004ac0 2024-08-18T23:58:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.793+0000 7f3730c57640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f371006be30 0x7f371006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:14.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.794+0000 7f3730c57640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f371006be30 0x7f371006e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f372c06f220 tx=0x7f371c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:14.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.797+0000 7f3721ffb640 1 -- 172.21.15.103:0/3279336384 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f37280044e0 con 0x7f3718004ac0 2024-08-18T23:58:14.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.963+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f372c09cc50 con 0x7f371006be30 2024-08-18T23:58:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.963+0000 7f3721ffb640 1 -- 172.21.15.103:0/3279336384 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f372c09cc50 con 0x7f371006be30 2024-08-18T23:58:14.965 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 6 to deep-scrub 2024-08-18T23:58:14.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f371006be30 msgr2=0x7f371006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f371006be30 0x7f371006e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f372c06f220 tx=0x7f371c008040 comp rx=0 tx=0).stop 2024-08-18T23:58:14.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 msgr2=0x7f372c14e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:14.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f372c14e7f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3728009be0 tx=0x7f3728004730 comp rx=0 tx=0).stop 2024-08-18T23:58:14.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 shutdown_connections 2024-08-18T23:58:14.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f371006be30 0x7f371006e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f372c15ab50 0x7f372c15afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f372c0b4d80 0x7f372c0b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 --2- 172.21.15.103:0/3279336384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3718004ac0 0x7f372c14e7f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:14.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 >> 172.21.15.103:0/3279336384 conn(0x7f372c0cc6e0 msgr2=0x7f372c0ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:14.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 shutdown_connections 2024-08-18T23:58:14.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:14.965+0000 7f37336bc640 1 -- 172.21.15.103:0/3279336384 wait complete. 2024-08-18T23:58:14.977 INFO:tasks.ceph:Scrubbing osd.7 2024-08-18T23:58:14.977 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-18T23:58:15.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.078+0000 7f85f27bb640 1 Processor -- start 2024-08-18T23:58:15.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.078+0000 7f85f27bb640 1 -- start start 2024-08-18T23:58:15.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.079+0000 7f85f27bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec0cfec0 0x7f85ec0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.079+0000 7f85f27bb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f85ec0acd70 0x7f85ec0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.079+0000 7f85f27bb640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85ec0d07e0 con 0x7f85ec0ccbf0 2024-08-18T23:58:15.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.079+0000 7f85f27bb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f85ec0cf3d0 con 0x7f85ec0acd70 2024-08-18T23:58:15.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.079+0000 7f85f27bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec0cf6b0 con 0x7f85ec0cfec0 2024-08-18T23:58:15.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.079+0000 7f85f0d58640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f85ec0ccbf0 0x7f85ec0b3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51206/0 (socket says 172.21.15.103:51206) 2024-08-18T23:58:15.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.079+0000 7f85f0d58640 1 -- 172.21.15.103:0/2358713815 learned_addr learned my addr 172.21.15.103:0/2358713815 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:15.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85ebfff640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec0cfec0 0x7f85ec0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754586484 0 0) 0x7f85ec0d07e0 con 0x7f85ec0ccbf0 2024-08-18T23:58:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eb7fe640 1 --2- 172.21.15.103:0/2358713815 >> v2:172.21.15.190:3300/0 conn(0x7f85ec0acd70 0x7f85ec0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85d4003520 con 0x7f85ec0ccbf0 2024-08-18T23:58:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3886785074 0 0) 0x7f85d4003520 con 0x7f85ec0ccbf0 2024-08-18T23:58:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec0cfec0 msgr2=0x7f85ec0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec0cfec0 0x7f85ec0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 >> v2:172.21.15.190:3300/0 conn(0x7f85ec0acd70 msgr2=0x7f85ec0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 --2- 172.21.15.103:0/2358713815 >> v2:172.21.15.190:3300/0 conn(0x7f85ec0acd70 0x7f85ec0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec0cf990 con 0x7f85ec0ccbf0 2024-08-18T23:58:15.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f85e40019f0 con 0x7f85ec0ccbf0 2024-08-18T23:58:15.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 >> v1:172.21.15.103:6789/0 conn(0x7f85ec0ccbf0 legacy=0x7f85ec0b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85d40039b0 0x7f85d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec0cfec0 0x7f85d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec0cf3d0 con 0x7f85d4004800 2024-08-18T23:58:15.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec0cf6b0 con 0x7f85d40039b0 2024-08-18T23:58:15.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85d400b9c0 con 0x7f85ec0cfec0 2024-08-18T23:58:15.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eb7fe640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85ebfff640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85d40039b0 0x7f85d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85f0d58640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec0cfec0 0x7f85d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eb7fe640 1 -- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec0cfec0 msgr2=0x7f85d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eb7fe640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec0cfec0 0x7f85d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eb7fe640 1 -- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85d40039b0 msgr2=0x7f85d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eb7fe640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85d40039b0 0x7f85d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85eb7fe640 1 -- 172.21.15.103:0/2358713815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4003520 con 0x7f85d4004800 2024-08-18T23:58:15.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.080+0000 7f85ebfff640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85d40039b0 0x7f85d4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:15.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.081+0000 7f85eb7fe640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85d4004c80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009a90 tx=0x7f85d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81c329d26100412 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.081+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0036070 con 0x7f85d4004800 2024-08-18T23:58:15.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.081+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e0031400 con 0x7f85d4004800 2024-08-18T23:58:15.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.081+0000 7f85eaffd640 1 -- 172.21.15.103:0/2358713815 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0009690 con 0x7f85d4004800 2024-08-18T23:58:15.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.082+0000 7f85f27bb640 1 -- 172.21.15.103:0/2358713815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 msgr2=0x7f85d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.082+0000 7f85f27bb640 1 --2- 172.21.15.103:0/2358713815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85d4004c80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009a90 tx=0x7f85d4005830 comp rx=0 tx=0).stop 2024-08-18T23:58:15.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.082+0000 7f85f0d58640 1 -- 172.21.15.103:0/2358713815 reap_dead start 2024-08-18T23:58:15.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.082+0000 7f85f27bb640 1 -- 172.21.15.103:0/2358713815 shutdown_connections 2024-08-18T23:58:15.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.082+0000 7f85f27bb640 1 -- 172.21.15.103:0/2358713815 >> 172.21.15.103:0/2358713815 conn(0x7f85ec06bae0 msgr2=0x7f85ec06bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:15.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.082+0000 7f85f27bb640 1 -- 172.21.15.103:0/2358713815 shutdown_connections 2024-08-18T23:58:15.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.082+0000 7f85f27bb640 1 -- 172.21.15.103:0/2358713815 wait complete. 2024-08-18T23:58:15.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.083+0000 7f85f27bb640 1 Processor -- start 2024-08-18T23:58:15.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.083+0000 7f85f27bb640 1 -- start start 2024-08-18T23:58:15.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85f27bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85ec155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85f27bb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ec15b230 0x7f85ec14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85f27bb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec1523a0 0x7f85ec152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85f27bb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec0b3250 con 0x7f85d4004800 2024-08-18T23:58:15.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85f27bb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f85ec0b2f70 con 0x7f85ec15b230 2024-08-18T23:58:15.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85f27bb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f85ec0b4f90 con 0x7f85ec1523a0 2024-08-18T23:58:15.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85ebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85ec155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85ebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85ec155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57486/0 (socket says 172.21.15.103:57486) 2024-08-18T23:58:15.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85ebfff640 1 -- 172.21.15.103:0/3420721939 learned_addr learned my addr 172.21.15.103:0/3420721939 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:15.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85eb7fe640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ec15b230 0x7f85ec14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85f0d58640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec1523a0 0x7f85ec152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85ebfff640 1 -- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec1523a0 msgr2=0x7f85ec152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85ebfff640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85ec1523a0 0x7f85ec152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85ebfff640 1 -- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ec15b230 msgr2=0x7f85ec14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85ebfff640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85ec15b230 0x7f85ec14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.084+0000 7f85ebfff640 1 -- 172.21.15.103:0/3420721939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85ec15e3c0 con 0x7f85d4004800 2024-08-18T23:58:15.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.085+0000 7f85ebfff640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85ec155f00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f85dc011700 tx=0x7f85dc011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.085+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc00f9c0 con 0x7f85d4004800 2024-08-18T23:58:15.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.085+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc00fb60 con 0x7f85d4004800 2024-08-18T23:58:15.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.085+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85ec15b780 con 0x7f85d4004800 2024-08-18T23:58:15.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.085+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc015460 con 0x7f85d4004800 2024-08-18T23:58:15.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.085+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85ec15e940 con 0x7f85d4004800 2024-08-18T23:58:15.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.086+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85ec15c150 con 0x7f85d4004800 2024-08-18T23:58:15.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.086+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85dc015600 con 0x7f85d4004800 2024-08-18T23:58:15.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.087+0000 7f85e8ff9640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85d806be60 0x7f85d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.087+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f85dc08b5d0 con 0x7f85d4004800 2024-08-18T23:58:15.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.087+0000 7f85eb7fe640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85d806be60 0x7f85d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.087+0000 7f85e8ff9640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f85d8072300 0x7f85d8074740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.087+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 --> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85dc027e50 con 0x7f85d8072300 2024-08-18T23:58:15.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.087+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f85dc092050 con 0x7f85d4004800 2024-08-18T23:58:15.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.087+0000 7f85f0d58640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f85d8072300 0x7f85d8074740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.087+0000 7f85eb7fe640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85d806be60 0x7f85d806e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85e0033000 tx=0x7f85e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.088+0000 7f85f0d58640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f85d8072300 0x7f85d8074740 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.088+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 <== osd.7 v2:172.21.15.190:6808/3667598505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85dc027e50 con 0x7f85d8072300 2024-08-18T23:58:15.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.101+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 --> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f85ec0cc490 con 0x7f85d8072300 2024-08-18T23:58:15.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.101+0000 7f85e8ff9640 1 -- 172.21.15.103:0/3420721939 <== osd.7 v2:172.21.15.190:6808/3667598505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f85ec0cc490 con 0x7f85d8072300 2024-08-18T23:58:15.104 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-18T23:58:15.104 INFO:teuthology.orchestra.run.smithi103.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-18T23:58:15.105 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-18T23:58:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.101+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f85d8072300 msgr2=0x7f85d8074740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.101+0000 7f85f27bb640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.190:6808/3667598505,v1:172.21.15.190:6809/3667598505] conn(0x7f85d8072300 0x7f85d8074740 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85d806be60 msgr2=0x7f85d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f27bb640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f85d806be60 0x7f85d806e320 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85e0033000 tx=0x7f85e0008030 comp rx=0 tx=0).stop 2024-08-18T23:58:15.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 msgr2=0x7f85ec155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f27bb640 1 --2- 172.21.15.103:0/3420721939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85d4004800 0x7f85ec155f00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f85dc011700 tx=0x7f85dc011bc0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f0d58640 1 -- 172.21.15.103:0/3420721939 reap_dead start 2024-08-18T23:58:15.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 shutdown_connections 2024-08-18T23:58:15.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 >> 172.21.15.103:0/3420721939 conn(0x7f85ec06bae0 msgr2=0x7f85ec0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:15.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 shutdown_connections 2024-08-18T23:58:15.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.102+0000 7f85f27bb640 1 -- 172.21.15.103:0/3420721939 wait complete. 2024-08-18T23:58:15.113 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-18T23:58:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.212+0000 7f9aaa5ea640 1 Processor -- start 2024-08-18T23:58:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.212+0000 7f9aaa5ea640 1 -- start start 2024-08-18T23:58:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aaa5ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa40c6340 0x7f9aa4165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aaa5ea640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa40721d0 con 0x7f9aa415ea60 2024-08-18T23:58:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aaa5ea640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa40cf0d0 con 0x7f9aa415ae70 2024-08-18T23:58:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aaa5ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa415b250 con 0x7f9aa40c6340 2024-08-18T23:58:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aa37fe640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f9aa415ea60 0x7f9aa40c5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:51222/0 (socket says 172.21.15.103:51222) 2024-08-18T23:58:15.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aa37fe640 1 -- 172.21.15.103:0/4075117658 learned_addr learned my addr 172.21.15.103:0/4075117658 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:15.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016390006 0 0) 0x7f9a98001110 con 0x7f9aa415ea60 2024-08-18T23:58:15.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aa8b87640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa40c6340 0x7f9aa4165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.213+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a8c005730 con 0x7f9aa415ea60 2024-08-18T23:58:15.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 781818177 0 0) 0x7f9a8c005730 con 0x7f9aa415ea60 2024-08-18T23:58:15.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa40c6340 msgr2=0x7f9aa4165cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa40c6340 0x7f9aa4165cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 >> v1:172.21.15.190:6789/0 conn(0x7f9aa415ae70 legacy=0x7f9aa415f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa4072450 con 0x7f9aa415ea60 2024-08-18T23:58:15.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f9a98001840 con 0x7f9aa415ea60 2024-08-18T23:58:15.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 >> v1:172.21.15.103:6789/0 conn(0x7f9aa415ea60 legacy=0x7f9aa40c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a8c005bf0 0x7f9a8c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a8c0065a0 0x7f9a8c006a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa40c6340 0x7f9a8c007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c00dc80 con 0x7f9a8c005bf0 2024-08-18T23:58:15.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c00de30 con 0x7f9a8c0065a0 2024-08-18T23:58:15.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8c00e030 con 0x7f9aa40c6340 2024-08-18T23:58:15.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa3fff640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a8c005bf0 0x7f9a8c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa37fe640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a8c0065a0 0x7f9a8c006a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa8b87640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa40c6340 0x7f9a8c007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa3fff640 1 -- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa40c6340 msgr2=0x7f9a8c007370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa3fff640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa40c6340 0x7f9a8c007370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa3fff640 1 -- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a8c0065a0 msgr2=0x7f9a8c006a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa3fff640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9a8c0065a0 0x7f9a8c006a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.214+0000 7f9aa3fff640 1 -- 172.21.15.103:0/4075117658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c005730 con 0x7f9a8c005bf0 2024-08-18T23:58:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.215+0000 7f9aa3fff640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a8c005bf0 0x7f9a8c005fd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9a94001860 tx=0x7f9a8c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e030806f9fca9ee server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.215+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94037070 con 0x7f9a8c005bf0 2024-08-18T23:58:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.215+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9402ac30 con 0x7f9a8c005bf0 2024-08-18T23:58:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.215+0000 7f9aa2ffd640 1 -- 172.21.15.103:0/4075117658 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94001430 con 0x7f9a8c005bf0 2024-08-18T23:58:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.215+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/4075117658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a8c005bf0 msgr2=0x7f9a8c005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.215+0000 7f9aaa5ea640 1 --2- 172.21.15.103:0/4075117658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9a8c005bf0 0x7f9a8c005fd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9a94001860 tx=0x7f9a8c007a40 comp rx=0 tx=0).stop 2024-08-18T23:58:15.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.215+0000 7f9aa8b87640 1 -- 172.21.15.103:0/4075117658 reap_dead start 2024-08-18T23:58:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.216+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/4075117658 shutdown_connections 2024-08-18T23:58:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.216+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/4075117658 >> 172.21.15.103:0/4075117658 conn(0x7f9aa40cc6e0 msgr2=0x7f9aa40ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.216+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/4075117658 shutdown_connections 2024-08-18T23:58:15.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.216+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/4075117658 wait complete. 2024-08-18T23:58:15.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.217+0000 7f9aaa5ea640 1 Processor -- start 2024-08-18T23:58:15.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.217+0000 7f9aaa5ea640 1 -- start start 2024-08-18T23:58:15.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aaa5ea640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa414fa00 0x7f9aa40ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aaa5ea640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa4156770 0x7f9aa4154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aaa5ea640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9aa4155250 0x7f9aa406e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aaa5ea640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa4072cf0 con 0x7f9aa4155250 2024-08-18T23:58:15.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aaa5ea640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa4072a10 con 0x7f9aa414fa00 2024-08-18T23:58:15.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aaa5ea640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa4072fd0 con 0x7f9aa4156770 2024-08-18T23:58:15.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9aa4155250 0x7f9aa406e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9aa4155250 0x7f9aa406e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57490/0 (socket says 172.21.15.103:57490) 2024-08-18T23:58:15.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 -- 172.21.15.103:0/1479494392 learned_addr learned my addr 172.21.15.103:0/1479494392 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:15.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa37fe640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa4156770 0x7f9aa4154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa3fff640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa414fa00 0x7f9aa40ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 -- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa4156770 msgr2=0x7f9aa4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa4156770 0x7f9aa4154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 -- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa414fa00 msgr2=0x7f9aa40ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa414fa00 0x7f9aa40ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 -- 172.21.15.103:0/1479494392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa4153930 con 0x7f9aa4155250 2024-08-18T23:58:15.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa3fff640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa414fa00 0x7f9aa40ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:15.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa8b87640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9aa4155250 0x7f9aa406e510 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40aef20 tx=0x7f9a9c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa0ff9640 1 -- 172.21.15.103:0/1479494392 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c011e60 con 0x7f9aa4155250 2024-08-18T23:58:15.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa0ff9640 1 -- 172.21.15.103:0/1479494392 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c01d070 con 0x7f9aa4155250 2024-08-18T23:58:15.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aa0ff9640 1 -- 172.21.15.103:0/1479494392 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c015650 con 0x7f9aa4155250 2024-08-18T23:58:15.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa4156ce0 con 0x7f9aa4155250 2024-08-18T23:58:15.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.218+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa40c8010 con 0x7f9aa4155250 2024-08-18T23:58:15.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.219+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa40c7e40 con 0x7f9aa4155250 2024-08-18T23:58:15.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.220+0000 7f9aa0ff9640 1 -- 172.21.15.103:0/1479494392 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a9c0157f0 con 0x7f9aa4155250 2024-08-18T23:58:15.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.220+0000 7f9aa0ff9640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a9006be30 0x7f9a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.220+0000 7f9aa0ff9640 1 -- 172.21.15.103:0/1479494392 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f9a9c08b540 con 0x7f9aa4155250 2024-08-18T23:58:15.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.220+0000 7f9aa3fff640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a9006be30 0x7f9a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.221+0000 7f9aa3fff640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a9006be30 0x7f9a9006e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9a94034000 tx=0x7f9a94009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.225+0000 7f9aa0ff9640 1 -- 172.21.15.103:0/1479494392 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9aa4153930 con 0x7f9aa4155250 2024-08-18T23:58:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.392+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f9aa40734f0 con 0x7f9a9006be30 2024-08-18T23:58:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.392+0000 7f9aa0ff9640 1 -- 172.21.15.103:0/1479494392 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9aa40734f0 con 0x7f9a9006be30 2024-08-18T23:58:15.394 INFO:teuthology.orchestra.run.smithi103.stderr:instructed osd(s) 7 to deep-scrub 2024-08-18T23:58:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a9006be30 msgr2=0x7f9a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a9006be30 0x7f9a9006e2f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9a94034000 tx=0x7f9a94009030 comp rx=0 tx=0).stop 2024-08-18T23:58:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9aa4155250 msgr2=0x7f9aa406e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9aa4155250 0x7f9aa406e510 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40aef20 tx=0x7f9a9c00f580 comp rx=0 tx=0).stop 2024-08-18T23:58:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 shutdown_connections 2024-08-18T23:58:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9a9006be30 0x7f9a9006e2f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9aa4155250 0x7f9aa406e510 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9aa4156770 0x7f9aa4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 --2- 172.21.15.103:0/1479494392 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9aa414fa00 0x7f9aa40ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.394+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 >> 172.21.15.103:0/1479494392 conn(0x7f9aa40cc6e0 msgr2=0x7f9aa40c5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:15.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.395+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 shutdown_connections 2024-08-18T23:58:15.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.395+0000 7f9aaa5ea640 1 -- 172.21.15.103:0/1479494392 wait complete. 2024-08-18T23:58:15.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:58:15.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.503+0000 7f7998816640 1 Processor -- start 2024-08-18T23:58:15.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.503+0000 7f7998816640 1 -- start start 2024-08-18T23:58:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f7998816640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f799415ade0 0x7f799406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f7998816640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b4370 0x7f799406f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f7998816640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7994072610 con 0x7f79940b47b0 2024-08-18T23:58:15.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f7998816640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f799406db10 con 0x7f799415ade0 2024-08-18T23:58:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f7998816640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f799415b1c0 con 0x7f79940b4370 2024-08-18T23:58:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f799259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f799415ade0 0x7f799406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f799259c640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f799415ade0 0x7f799406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57494/0 (socket says 172.21.15.103:57494) 2024-08-18T23:58:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f799259c640 1 -- 172.21.15.103:0/4225112931 learned_addr learned my addr 172.21.15.103:0/4225112931 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f7991d9b640 1 --2- 172.21.15.103:0/4225112931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b4370 0x7f799406f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f799259c640 1 -- 172.21.15.103:0/4225112931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b4370 msgr2=0x7f799406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f799259c640 1 --2- 172.21.15.103:0/4225112931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b4370 0x7f799406f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f799259c640 1 -- 172.21.15.103:0/4225112931 >> v1:172.21.15.190:6789/0 conn(0x7f79940b47b0 legacy=0x7f799415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f799259c640 1 -- 172.21.15.103:0/4225112931 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79940728f0 con 0x7f799415ade0 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.504+0000 7f7991d9b640 1 --2- 172.21.15.103:0/4225112931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b4370 0x7f799406f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.505+0000 7f799259c640 1 --2- 172.21.15.103:0/4225112931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f799406f060 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f798400bb10 tx=0x7f798402c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32094afa380e9289 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.505+0000 7f799159a640 1 -- 172.21.15.103:0/4225112931 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798403a070 con 0x7f799415ade0 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.505+0000 7f799159a640 1 -- 172.21.15.103:0/4225112931 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79840326f0 con 0x7f799415ade0 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.505+0000 7f799159a640 1 -- 172.21.15.103:0/4225112931 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984032ac0 con 0x7f799415ade0 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.505+0000 7f7998816640 1 -- 172.21.15.103:0/4225112931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 msgr2=0x7f799406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.505+0000 7f7998816640 1 --2- 172.21.15.103:0/4225112931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f799406f060 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f798400bb10 tx=0x7f798402c830 comp rx=0 tx=0).stop 2024-08-18T23:58:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.506+0000 7f7998816640 1 -- 172.21.15.103:0/4225112931 shutdown_connections 2024-08-18T23:58:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.506+0000 7f7998816640 1 --2- 172.21.15.103:0/4225112931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b4370 0x7f799406f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.506+0000 7f7998816640 1 --2- 172.21.15.103:0/4225112931 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f799406f060 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.506+0000 7f7998816640 1 -- 172.21.15.103:0/4225112931 >> 172.21.15.103:0/4225112931 conn(0x7f79940cfc40 msgr2=0x7f79940d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.506+0000 7f7998816640 1 -- 172.21.15.103:0/4225112931 shutdown_connections 2024-08-18T23:58:15.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.506+0000 7f7998816640 1 -- 172.21.15.103:0/4225112931 wait complete. 2024-08-18T23:58:15.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.507+0000 7f7998816640 1 Processor -- start 2024-08-18T23:58:15.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.507+0000 7f7998816640 1 -- start start 2024-08-18T23:58:15.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7998816640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79940b4370 0x7f799414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7998816640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b47b0 0x7f7994151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7998816640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f79940ce540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7998816640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f799406d6c0 con 0x7f799415ade0 2024-08-18T23:58:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7998816640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7994072eb0 con 0x7f79940b4370 2024-08-18T23:58:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7998816640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f799406d840 con 0x7f79940b47b0 2024-08-18T23:58:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f79940ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f79940ce540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57504/0 (socket says 172.21.15.103:57504) 2024-08-18T23:58:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 -- 172.21.15.103:0/3256089662 learned_addr learned my addr 172.21.15.103:0/3256089662 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f799259c640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79940b4370 0x7f799414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7991d9b640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b47b0 0x7f7994151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 -- 172.21.15.103:0/3256089662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b47b0 msgr2=0x7f7994151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b47b0 0x7f7994151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 -- 172.21.15.103:0/3256089662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79940b4370 msgr2=0x7f799414e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79940b4370 0x7f799414e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 -- 172.21.15.103:0/3256089662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799415b4e0 con 0x7f799415ade0 2024-08-18T23:58:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7992d9d640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f79940ce540 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c780 tx=0x7f798c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7982ffd640 1 -- 172.21.15.103:0/3256089662 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c004b60 con 0x7f799415ade0 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7982ffd640 1 -- 172.21.15.103:0/3256089662 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f798c004d00 con 0x7f799415ade0 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7982ffd640 1 -- 172.21.15.103:0/3256089662 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f798c00aa90 con 0x7f799415ade0 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799415b7c0 con 0x7f799415ade0 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.508+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7994151c50 con 0x7f799415ade0 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.509+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799415e8a0 con 0x7f799415ade0 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.510+0000 7f7982ffd640 1 -- 172.21.15.103:0/3256089662 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f798c00ac30 con 0x7f799415ade0 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.510+0000 7f7982ffd640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f797406be30 0x7f797406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.510+0000 7f7982ffd640 1 -- 172.21.15.103:0/3256089662 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f798c08ae00 con 0x7f799415ade0 2024-08-18T23:58:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.510+0000 7f799259c640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f797406be30 0x7f797406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.511+0000 7f799259c640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f797406be30 0x7f797406e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7984037000 tx=0x7f7984032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.514+0000 7f7982ffd640 1 -- 172.21.15.103:0/3256089662 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f798c020070 con 0x7f799415ade0 2024-08-18T23:58:15.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.676+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79940cf890 con 0x7f797406be30 2024-08-18T23:58:15.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.677+0000 7f7982ffd640 1 -- 172.21.15.103:0/3256089662 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13357 (secure 0 0 0) 0x7f79940cf890 con 0x7f797406be30 2024-08-18T23:58:15.678 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:15.679 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:58:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f797406be30 msgr2=0x7f797406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f797406be30 0x7f797406e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7984037000 tx=0x7f7984032000 comp rx=0 tx=0).stop 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 msgr2=0x7f79940ce540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f79940ce540 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f798c00c780 tx=0x7f798c00cc40 comp rx=0 tx=0).stop 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 shutdown_connections 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f797406be30 0x7f797406e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f799415ade0 0x7f79940ce540 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f79940b47b0 0x7f7994151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 --2- 172.21.15.103:0/3256089662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79940b4370 0x7f799414e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 >> 172.21.15.103:0/3256089662 conn(0x7f79940cfc40 msgr2=0x7f7994155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:15.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 shutdown_connections 2024-08-18T23:58:15.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:15.679+0000 7f7998816640 1 -- 172.21.15.103:0/3256089662 wait complete. 2024-08-18T23:58:15.691 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-08-18T23:58:14.180672+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221104,"kb_used_data":4936,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":5054464,"data_stored":2852920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.379359"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-18T23:58:06.809961+0000","last_change":"2024-08-18T23:56:43.255993+0000","last_active":"2024-08-18T23:58:06.809961+0000","last_peered":"2024-08-18T23:58:06.809961+0000","last_clean":"2024-08-18T23:58:06.809961+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:58:06.809961+0000","last_undegraded":"2024-08-18T23:58:06.809961+0000","last_fullsized":"2024-08-18T23:58:06.809961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-18T23:56:42.245601+0000","last_clean_scrub_stamp":"2024-08-18T23:56:42.245601+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T00:45:14.918860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":799391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28076,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343764,"statfs":{"total":96636764160,"available":96608014336,"internally_reserved":0,"allocated":1077248,"data_stored":799391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:58:15.693 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-18T23:56:42.245601+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=23, tm_min=56, tm_sec=42, tm_wday=6, tm_yday=231, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=18, tm_hour=23, tm_min=58, tm_sec=10, tm_wday=6, tm_yday=231, tm_isdst=0) 2024-08-18T23:58:15.693 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-18T23:58:24.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:58:24.503 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:58:35.694 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-18T23:58:35.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.803+0000 7f4168810640 1 Processor -- start 2024-08-18T23:58:35.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.803+0000 7f4168810640 1 -- start start 2024-08-18T23:58:35.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.804+0000 7f4168810640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f416406f770 0x7f41640ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:35.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.804+0000 7f4168810640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4164072610 con 0x7f41640b4370 2024-08-18T23:58:35.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.804+0000 7f4168810640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41640728f0 con 0x7f416415ade0 2024-08-18T23:58:35.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.804+0000 7f4168810640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f416406db10 con 0x7f416406f770 2024-08-18T23:58:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.804+0000 7f4162d9d640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f41640b4370 0x7f41640adf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:36510/0 (socket says 172.21.15.103:36510) 2024-08-18T23:58:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.804+0000 7f4162d9d640 1 -- 172.21.15.103:0/2235843082 learned_addr learned my addr 172.21.15.103:0/2235843082 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.804+0000 7f4161d9b640 1 --2- 172.21.15.103:0/2235843082 >> v2:172.21.15.190:3300/0 conn(0x7f416406f770 0x7f41640ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421167340 0 0) 0x7f4164072610 con 0x7f41640b4370 2024-08-18T23:58:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f414c003520 con 0x7f41640b4370 2024-08-18T23:58:35.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 <== mon.0 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1605049325 0 0) 0x7f414c003520 con 0x7f41640b4370 2024-08-18T23:58:35.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 >> v2:172.21.15.190:3300/0 conn(0x7f416406f770 msgr2=0x7f41640ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:35.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 --2- 172.21.15.103:0/2235843082 >> v2:172.21.15.190:3300/0 conn(0x7f416406f770 0x7f41640ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 >> v1:172.21.15.190:6789/0 conn(0x7f416415ade0 legacy=0x7f416406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:35.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4164072bd0 con 0x7f41640b4370 2024-08-18T23:58:35.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 <== mon.0 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3509096 0 0) 0x7f415c0019f0 con 0x7f41640b4370 2024-08-18T23:58:35.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f4161d9b640 1 --2- 172.21.15.103:0/2235843082 >> v2:172.21.15.190:3300/0 conn(0x7f416406f770 0x7f41640ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-18T23:58:35.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 >> v1:172.21.15.103:6789/0 conn(0x7f41640b4370 legacy=0x7f41640adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:35.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414c0039b0 0x7f414c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:35.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f414c004800 0x7f414c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:35.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f414c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:35.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f416406db10 con 0x7f414c0051c0 2024-08-18T23:58:35.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f414c00e370 con 0x7f414c0039b0 2024-08-18T23:58:35.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f414c00e570 con 0x7f414c004800 2024-08-18T23:58:35.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f4162d9d640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f414c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:35.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f4161d9b640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f414c004800 0x7f414c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:35.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416259c640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414c0039b0 0x7f414c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:35.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f4162d9d640 1 -- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f414c004800 msgr2=0x7f414c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:35.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f4162d9d640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f414c004800 0x7f414c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f4162d9d640 1 -- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414c0039b0 msgr2=0x7f414c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:35.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f4162d9d640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414c0039b0 0x7f414c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f4162d9d640 1 -- 172.21.15.103:0/2235843082 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414c003520 con 0x7f414c0051c0 2024-08-18T23:58:35.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.805+0000 7f416259c640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f414c0039b0 0x7f414c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:35.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.806+0000 7f4162d9d640 1 -- 172.21.15.103:0/2235843082 reap_dead start 2024-08-18T23:58:35.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.806+0000 7f4162d9d640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f414c00dbd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f41640d0cc0 tx=0x7f414c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a767ca3f8081adc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:35.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.806+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c00a4a0 con 0x7f414c0051c0 2024-08-18T23:58:35.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.806+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c02f070 con 0x7f414c0051c0 2024-08-18T23:58:35.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.806+0000 7f416159a640 1 -- 172.21.15.103:0/2235843082 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c02bc70 con 0x7f414c0051c0 2024-08-18T23:58:35.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.807+0000 7f4168810640 1 -- 172.21.15.103:0/2235843082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 msgr2=0x7f414c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:35.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.807+0000 7f4168810640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f414c00dbd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f41640d0cc0 tx=0x7f414c005830 comp rx=0 tx=0).stop 2024-08-18T23:58:35.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.807+0000 7f4168810640 1 -- 172.21.15.103:0/2235843082 shutdown_connections 2024-08-18T23:58:35.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.807+0000 7f4168810640 1 --2- 172.21.15.103:0/2235843082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f414c00dbd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.807+0000 7f4168810640 1 -- 172.21.15.103:0/2235843082 >> 172.21.15.103:0/2235843082 conn(0x7f41640cfc40 msgr2=0x7f41640d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:35.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.807+0000 7f4168810640 1 -- 172.21.15.103:0/2235843082 shutdown_connections 2024-08-18T23:58:35.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.807+0000 7f4168810640 1 -- 172.21.15.103:0/2235843082 wait complete. 2024-08-18T23:58:35.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.808+0000 7f4168810640 1 Processor -- start 2024-08-18T23:58:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.808+0000 7f4168810640 1 -- start start 2024-08-18T23:58:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f4168810640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f4164157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f4168810640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f416414e5f0 0x7f4164151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f4168810640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4164159cc0 0x7f416415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f4168810640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f416406d6c0 con 0x7f414c0051c0 2024-08-18T23:58:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f4168810640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f416415b1c0 con 0x7f416414e5f0 2024-08-18T23:58:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f4168810640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f416406d840 con 0x7f4164159cc0 2024-08-18T23:58:35.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f416259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f4164157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:35.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f416259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f4164157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51954/0 (socket says 172.21.15.103:51954) 2024-08-18T23:58:35.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f416259c640 1 -- 172.21.15.103:0/2628113088 learned_addr learned my addr 172.21.15.103:0/2628113088 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:35.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.809+0000 7f4161d9b640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f416414e5f0 0x7f4164151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:35.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f416259c640 1 -- 172.21.15.103:0/2628113088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4164159cc0 msgr2=0x7f416415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:35.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f416259c640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4164159cc0 0x7f416415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f416259c640 1 -- 172.21.15.103:0/2628113088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f416414e5f0 msgr2=0x7f4164151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:35.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f416259c640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f416414e5f0 0x7f4164151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f416259c640 1 -- 172.21.15.103:0/2628113088 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4164150640 con 0x7f414c0051c0 2024-08-18T23:58:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f4161d9b640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f416414e5f0 0x7f4164151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f416259c640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f4164157150 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f415400e470 tx=0x7f415400e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f4152ffd640 1 -- 172.21.15.103:0/2628113088 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154019070 con 0x7f414c0051c0 2024-08-18T23:58:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f4152ffd640 1 -- 172.21.15.103:0/2628113088 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41540052e0 con 0x7f414c0051c0 2024-08-18T23:58:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4164150920 con 0x7f414c0051c0 2024-08-18T23:58:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f4152ffd640 1 -- 172.21.15.103:0/2628113088 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154003830 con 0x7f414c0051c0 2024-08-18T23:58:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.810+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41641597a0 con 0x7f414c0051c0 2024-08-18T23:58:35.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.811+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41640b47b0 con 0x7f414c0051c0 2024-08-18T23:58:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.812+0000 7f4152ffd640 1 -- 172.21.15.103:0/2628113088 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f415401c070 con 0x7f414c0051c0 2024-08-18T23:58:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.812+0000 7f4152ffd640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f414406be60 0x7f414406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.812+0000 7f4152ffd640 1 -- 172.21.15.103:0/2628113088 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f415408a050 con 0x7f414c0051c0 2024-08-18T23:58:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.812+0000 7f4161d9b640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f414406be60 0x7f414406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:35.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.813+0000 7f4161d9b640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f414406be60 0x7f414406e320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4158006b10 tx=0x7f4158008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:35.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.816+0000 7f4152ffd640 1 -- 172.21.15.103:0/2628113088 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f41540585b0 con 0x7f414c0051c0 2024-08-18T23:58:35.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.979+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 --> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4164156a10 con 0x7f414406be60 2024-08-18T23:58:35.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.980+0000 7f4152ffd640 1 -- 172.21.15.103:0/2628113088 <== mgr.4104 v2:172.21.15.103:6832/2424797051 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13358 (secure 0 0 0) 0x7f4164156a10 con 0x7f414406be60 2024-08-18T23:58:35.983 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:35.983 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-18T23:58:35.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f414406be60 msgr2=0x7f414406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:35.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f414406be60 0x7f414406e320 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4158006b10 tx=0x7f4158008040 comp rx=0 tx=0).stop 2024-08-18T23:58:35.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 msgr2=0x7f4164157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:35.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f4164157150 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f415400e470 tx=0x7f415400e930 comp rx=0 tx=0).stop 2024-08-18T23:58:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 shutdown_connections 2024-08-18T23:58:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f414406be60 0x7f414406e320 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4164159cc0 0x7f416415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f416414e5f0 0x7f4164151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 --2- 172.21.15.103:0/2628113088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f414c0051c0 0x7f4164157150 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:35.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 >> 172.21.15.103:0/2628113088 conn(0x7f41640cfc40 msgr2=0x7f41640d0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:35.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 shutdown_connections 2024-08-18T23:58:35.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:35.982+0000 7f4168810640 1 -- 172.21.15.103:0/2628113088 wait complete. 2024-08-18T23:58:35.996 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-08-18T23:58:34.184846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221088,"kb_used_data":4936,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5054464,"data_stored":2852920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002538"},"pg_stats":[{"pgid":"1.0","version":"41'119","reported_seq":219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-08-18T23:58:16.163618+0000","last_change":"2024-08-18T23:58:16.163653+0000","last_active":"2024-08-18T23:58:16.163618+0000","last_peered":"2024-08-18T23:58:16.163618+0000","last_clean":"2024-08-18T23:58:16.163618+0000","last_became_active":"2024-08-18T23:56:43.255049+0000","last_became_peered":"2024-08-18T23:56:43.255049+0000","last_unstale":"2024-08-18T23:58:16.163618+0000","last_undegraded":"2024-08-18T23:58:16.163618+0000","last_fullsized":"2024-08-18T23:58:16.163618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'119","last_scrub_stamp":"2024-08-18T23:58:16.163528+0000","last_deep_scrub":"41'119","last_deep_scrub_stamp":"2024-08-18T23:58:16.163528+0000","last_clean_scrub_stamp":"2024-08-18T23:58:16.163528+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T06:26:24.342071+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1077248,"data_stored":799391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":209023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1077248,"data_stored":799391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-18T23:58:35.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-18T23:58:36.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.093+0000 7f9f75eb7640 1 Processor -- start 2024-08-18T23:58:36.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.093+0000 7f9f75eb7640 1 -- start start 2024-08-18T23:58:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f75eb7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 0x7f9f700ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f75eb7640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f7006f0e0 0x7f9f700719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f75eb7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9f7006d9b0 0x7f9f7006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f75eb7640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7015e5a0 con 0x7f9f7006f0e0 2024-08-18T23:58:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f75eb7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9f700cd490 con 0x7f9f7006d9b0 2024-08-18T23:58:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f75eb7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9f700ce3e0 con 0x7f9f7015e1c0 2024-08-18T23:58:36.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f7006f0e0 0x7f9f700719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6effd640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9f7006f0e0 0x7f9f700719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51960/0 (socket says 172.21.15.103:51960) 2024-08-18T23:58:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6effd640 1 -- 172.21.15.103:0/110604131 learned_addr learned my addr 172.21.15.103:0/110604131 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6f7fe640 1 --2- 172.21.15.103:0/110604131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 0x7f9f700ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6ffff640 1 --2- 172.21.15.103:0/110604131 >> v2:172.21.15.190:3300/0 conn(0x7f9f7006d9b0 0x7f9f7006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6effd640 1 -- 172.21.15.103:0/110604131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 msgr2=0x7f9f700ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6effd640 1 --2- 172.21.15.103:0/110604131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 0x7f9f700ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6effd640 1 -- 172.21.15.103:0/110604131 >> v2:172.21.15.190:3300/0 conn(0x7f9f7006d9b0 msgr2=0x7f9f7006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:36.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6effd640 1 --2- 172.21.15.103:0/110604131 >> v2:172.21.15.190:3300/0 conn(0x7f9f7006d9b0 0x7f9f7006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6effd640 1 -- 172.21.15.103:0/110604131 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f700cd1b0 con 0x7f9f7006f0e0 2024-08-18T23:58:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.094+0000 7f9f6ffff640 1 --2- 172.21.15.103:0/110604131 >> v2:172.21.15.190:3300/0 conn(0x7f9f7006d9b0 0x7f9f7006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-18T23:58:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.095+0000 7f9f6effd640 1 --2- 172.21.15.103:0/110604131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006f0e0 0x7f9f700719c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9f700ca670 tx=0x7f9f6402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9012b2bb39cf5a server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:36.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.095+0000 7f9f6e7fc640 1 -- 172.21.15.103:0/110604131 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64037070 con 0x7f9f7006f0e0 2024-08-18T23:58:36.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.095+0000 7f9f6e7fc640 1 -- 172.21.15.103:0/110604131 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f64032440 con 0x7f9f7006f0e0 2024-08-18T23:58:36.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.095+0000 7f9f6e7fc640 1 -- 172.21.15.103:0/110604131 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f64032810 con 0x7f9f7006f0e0 2024-08-18T23:58:36.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 -- 172.21.15.103:0/110604131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006f0e0 msgr2=0x7f9f700719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/110604131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006f0e0 0x7f9f700719c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9f700ca670 tx=0x7f9f6402a140 comp rx=0 tx=0).stop 2024-08-18T23:58:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 -- 172.21.15.103:0/110604131 shutdown_connections 2024-08-18T23:58:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/110604131 >> v2:172.21.15.190:3300/0 conn(0x7f9f7006d9b0 0x7f9f7006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/110604131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006f0e0 0x7f9f700719c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/110604131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 0x7f9f700ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 -- 172.21.15.103:0/110604131 >> 172.21.15.103:0/110604131 conn(0x7f9f700b1be0 msgr2=0x7f9f700b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 -- 172.21.15.103:0/110604131 shutdown_connections 2024-08-18T23:58:36.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.096+0000 7f9f75eb7640 1 -- 172.21.15.103:0/110604131 wait complete. 2024-08-18T23:58:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.097+0000 7f9f75eb7640 1 Processor -- start 2024-08-18T23:58:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.097+0000 7f9f75eb7640 1 -- start start 2024-08-18T23:58:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f75eb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006d9b0 0x7f9f701e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f75eb7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7006f0e0 0x7f9f701f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f75eb7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 0x7f9f701e34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f75eb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7006f4e0 con 0x7f9f7006d9b0 2024-08-18T23:58:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f75eb7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9f700ce070 con 0x7f9f7006f0e0 2024-08-18T23:58:36.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f75eb7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9f70071f00 con 0x7f9f7015e1c0 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006d9b0 0x7f9f701e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006d9b0 0x7f9f701e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51962/0 (socket says 172.21.15.103:51962) 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6f7fe640 1 -- 172.21.15.103:0/3836428922 learned_addr learned my addr 172.21.15.103:0/3836428922 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6ffff640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 0x7f9f701e34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6effd640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7006f0e0 0x7f9f701f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6f7fe640 1 -- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 msgr2=0x7f9f701e34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6f7fe640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 0x7f9f701e34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6f7fe640 1 -- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7006f0e0 msgr2=0x7f9f701f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6f7fe640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7006f0e0 0x7f9f701f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6f7fe640 1 -- 172.21.15.103:0/3836428922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f700b2ff0 con 0x7f9f7006d9b0 2024-08-18T23:58:36.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.098+0000 7f9f6effd640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7006f0e0 0x7f9f701f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:36.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.099+0000 7f9f6f7fe640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006d9b0 0x7f9f701e5f80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f60007e40 tx=0x7f9f6000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:36.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.099+0000 7f9f57fff640 1 -- 172.21.15.103:0/3836428922 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60014620 con 0x7f9f7006d9b0 2024-08-18T23:58:36.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.099+0000 7f9f57fff640 1 -- 172.21.15.103:0/3836428922 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f60019070 con 0x7f9f7006d9b0 2024-08-18T23:58:36.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.099+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f700b32d0 con 0x7f9f7006d9b0 2024-08-18T23:58:36.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.099+0000 7f9f57fff640 1 -- 172.21.15.103:0/3836428922 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f600149e0 con 0x7f9f7006d9b0 2024-08-18T23:58:36.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.099+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f700b4f90 con 0x7f9f7006d9b0 2024-08-18T23:58:36.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.100+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f700719c0 con 0x7f9f7006d9b0 2024-08-18T23:58:36.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.100+0000 7f9f57fff640 1 -- 172.21.15.103:0/3836428922 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f60014b80 con 0x7f9f7006d9b0 2024-08-18T23:58:36.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.101+0000 7f9f57fff640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9f5c06be30 0x7f9f5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.101+0000 7f9f57fff640 1 -- 172.21.15.103:0/3836428922 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f9f6008b460 con 0x7f9f7006d9b0 2024-08-18T23:58:36.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.101+0000 7f9f6effd640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9f5c06be30 0x7f9f5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.101+0000 7f9f6effd640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9f5c06be30 0x7f9f5c06e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f64034000 tx=0x7f9f6402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:36.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.106+0000 7f9f57fff640 1 -- 172.21.15.103:0/3836428922 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f9f6005a010 con 0x7f9f7006d9b0 2024-08-18T23:58:36.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.273+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f9f7009df50 con 0x7f9f7006d9b0 2024-08-18T23:58:36.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.277+0000 7f9f57fff640 1 -- 172.21.15.103:0/3836428922 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f9f60059910 con 0x7f9f7006d9b0 2024-08-18T23:58:36.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.278+0000 7f9f57fff640 1 -- 172.21.15.103:0/3836428922 <== mon.0 v2:172.21.15.103:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9f6005ee50 con 0x7f9f7006d9b0 2024-08-18T23:58:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9f5c06be30 msgr2=0x7f9f5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9f5c06be30 0x7f9f5c06e2f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f64034000 tx=0x7f9f6402e000 comp rx=0 tx=0).stop 2024-08-18T23:58:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006d9b0 msgr2=0x7f9f701e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006d9b0 0x7f9f701e5f80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f60007e40 tx=0x7f9f6000e4b0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 shutdown_connections 2024-08-18T23:58:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f9f5c06be30 0x7f9f5c06e2f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9f7015e1c0 0x7f9f701e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9f7006f0e0 0x7f9f701f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 --2- 172.21.15.103:0/3836428922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f7006d9b0 0x7f9f701e5f80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.279+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 >> 172.21.15.103:0/3836428922 conn(0x7f9f700b1be0 msgr2=0x7f9f700b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.280+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 shutdown_connections 2024-08-18T23:58:36.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.280+0000 7f9f75eb7640 1 -- 172.21.15.103:0/3836428922 wait complete. 2024-08-18T23:58:36.292 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-18T23:58:36.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-18T23:58:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.390+0000 7f2536837640 1 Processor -- start 2024-08-18T23:58:36.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.390+0000 7f2536837640 1 -- start start 2024-08-18T23:58:36.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.390+0000 7f2536837640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f253015e350 0x7f25300d47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.390+0000 7f2536837640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25300d1d10 0x7f25300d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.390+0000 7f2536837640 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253015e730 con 0x7f25300cfd40 2024-08-18T23:58:36.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.390+0000 7f2536837640 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 -- 0x7f25300cef80 con 0x7f25300d1d10 2024-08-18T23:58:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.390+0000 7f2536837640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f25300cf260 con 0x7f253015e350 2024-08-18T23:58:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.390+0000 7f2527fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25300d1d10 0x7f25300d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f2534dd4640 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f25300cfd40 0x7f2530161e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:36524/0 (socket says 172.21.15.103:36524) 2024-08-18T23:58:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f2534dd4640 1 -- 172.21.15.103:0/382572583 learned_addr learned my addr 172.21.15.103:0/382572583 (peer_addr_for_me v1:172.21.15.103:0/0) 2024-08-18T23:58:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f2527fff640 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f25300d1d10 0x7f25300d2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51972/0 (socket says 172.21.15.103:51972) 2024-08-18T23:58:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f252ffff640 1 --2- 172.21.15.103:0/382572583 >> v2:172.21.15.190:3300/0 conn(0x7f253015e350 0x7f25300d47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f2527fff640 1 -- 172.21.15.103:0/382572583 >> v2:172.21.15.190:3300/0 conn(0x7f253015e350 msgr2=0x7f25300d47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-18T23:58:36.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f2527fff640 1 --2- 172.21.15.103:0/382572583 >> v2:172.21.15.190:3300/0 conn(0x7f253015e350 0x7f25300d47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f2527fff640 1 -- 172.21.15.103:0/382572583 >> v1:172.21.15.103:6789/0 conn(0x7f25300cfd40 legacy=0x7f2530161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f2527fff640 1 -- 172.21.15.103:0/382572583 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25300cf540 con 0x7f25300d1d10 2024-08-18T23:58:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.391+0000 7f252f7fe640 1 -- 172.21.15.103:0/382572583 <== mon.0 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3600175325 0 0) 0x7f253015e730 con 0x7f25300cfd40 2024-08-18T23:58:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2527fff640 1 --2- 172.21.15.103:0/382572583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25300d1d10 0x7f25300d2670 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f253008ce10 tx=0x7f251802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f3412700a975f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f252f7fe640 1 -- 172.21.15.103:0/382572583 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518037070 con 0x7f25300d1d10 2024-08-18T23:58:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f252f7fe640 1 -- 172.21.15.103:0/382572583 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2518032440 con 0x7f25300d1d10 2024-08-18T23:58:36.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f252f7fe640 1 -- 172.21.15.103:0/382572583 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518032830 con 0x7f25300d1d10 2024-08-18T23:58:36.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2536837640 1 -- 172.21.15.103:0/382572583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25300d1d10 msgr2=0x7f25300d2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2536837640 1 --2- 172.21.15.103:0/382572583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25300d1d10 0x7f25300d2670 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f253008ce10 tx=0x7f251802a1a0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2536837640 1 -- 172.21.15.103:0/382572583 shutdown_connections 2024-08-18T23:58:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2536837640 1 --2- 172.21.15.103:0/382572583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f25300d1d10 0x7f25300d2670 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2536837640 1 --2- 172.21.15.103:0/382572583 >> v2:172.21.15.190:3300/0 conn(0x7f253015e350 0x7f25300d47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2536837640 1 -- 172.21.15.103:0/382572583 >> 172.21.15.103:0/382572583 conn(0x7f253009d3f0 msgr2=0x7f25300d40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2536837640 1 -- 172.21.15.103:0/382572583 shutdown_connections 2024-08-18T23:58:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.392+0000 7f2536837640 1 -- 172.21.15.103:0/382572583 wait complete. 2024-08-18T23:58:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2536837640 1 Processor -- start 2024-08-18T23:58:36.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2536837640 1 -- start start 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2536837640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25300cfd40 0x7f25301ea060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2536837640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25300d1d10 0x7f25300c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2536837640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f253015e350 0x7f25300ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2536837640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f25300d4d00 con 0x7f253015e350 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2536837640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f25300cec30 con 0x7f25300cfd40 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2536837640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f25300d4e80 con 0x7f25300d1d10 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2534dd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f253015e350 0x7f25300ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2534dd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f253015e350 0x7f25300ca290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51976/0 (socket says 172.21.15.103:51976) 2024-08-18T23:58:36.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f2534dd4640 1 -- 172.21.15.103:0/2806909646 learned_addr learned my addr 172.21.15.103:0/2806909646 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-18T23:58:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.394+0000 7f252ffff640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25300cfd40 0x7f25301ea060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2527fff640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25300d1d10 0x7f25300c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2534dd4640 1 -- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25300d1d10 msgr2=0x7f25300c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2534dd4640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25300d1d10 0x7f25300c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2534dd4640 1 -- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25300cfd40 msgr2=0x7f25301ea060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2534dd4640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25300cfd40 0x7f25301ea060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2534dd4640 1 -- 172.21.15.103:0/2806909646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25300ca7d0 con 0x7f253015e350 2024-08-18T23:58:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2527fff640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25300d1d10 0x7f25300c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-18T23:58:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2534dd4640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f253015e350 0x7f25300ca290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f252800c730 tx=0x7f252800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f252d7fa640 1 -- 172.21.15.103:0/2806909646 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528018070 con 0x7f253015e350 2024-08-18T23:58:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f252d7fa640 1 -- 172.21.15.103:0/2806909646 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f252800ce40 con 0x7f253015e350 2024-08-18T23:58:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f252d7fa640 1 -- 172.21.15.103:0/2806909646 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252800a880 con 0x7f253015e350 2024-08-18T23:58:36.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25300caaa0 con 0x7f253015e350 2024-08-18T23:58:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.395+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2530146450 con 0x7f253015e350 2024-08-18T23:58:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.396+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25300d47c0 con 0x7f253015e350 2024-08-18T23:58:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.396+0000 7f252d7fa640 1 -- 172.21.15.103:0/2806909646 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f252801b070 con 0x7f253015e350 2024-08-18T23:58:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.397+0000 7f252d7fa640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-18T23:58:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.397+0000 7f252d7fa640 1 -- 172.21.15.103:0/2806909646 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5335+0+0 (secure 0 0 0) 0x7f252808a270 con 0x7f253015e350 2024-08-18T23:58:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.397+0000 7f252ffff640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-18T23:58:36.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.397+0000 7f252ffff640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f251006be30 0x7f251006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f25301eaa30 tx=0x7f2520008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-18T23:58:36.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.401+0000 7f252d7fa640 1 -- 172.21.15.103:0/2806909646 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186747 (secure 0 0 0) 0x7f25280586b0 con 0x7f253015e350 2024-08-18T23:58:36.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.605+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25300d1660 con 0x7f253015e350 2024-08-18T23:58:36.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.605+0000 7f252d7fa640 1 -- 172.21.15.103:0/2806909646 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3923 (secure 0 0 0) 0x7f252805c9b0 con 0x7f253015e350 2024-08-18T23:58:36.607 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-18T23:58:36.607 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":18,"btime":"2024-08-18T23:58:04:791439+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3545783172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3545783172},{"type":"v1","addr":"172.21.15.103:6837","nonce":3545783172}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4631,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6833/2970236377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2970236377},{"type":"v1","addr":"172.21.15.190:6833","nonce":2970236377}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1367225190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1367225190},{"type":"v1","addr":"172.21.15.190:6835","nonce":1367225190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1956067139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1956067139},{"type":"v1","addr":"172.21.15.103:6835","nonce":1956067139}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-08-18T23:58:36.608 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 18 2024-08-18T23:58:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f251006be30 msgr2=0x7f251006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f251006be30 0x7f251006e2f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f25301eaa30 tx=0x7f2520008040 comp rx=0 tx=0).stop 2024-08-18T23:58:36.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f253015e350 msgr2=0x7f25300ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-18T23:58:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f253015e350 0x7f25300ca290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f252800c730 tx=0x7f252800cbf0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 shutdown_connections 2024-08-18T23:58:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:6832/2424797051,v1:172.21.15.103:6833/2424797051] conn(0x7f251006be30 0x7f251006e2f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f253015e350 0x7f25300ca290 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f25300d1d10 0x7f25300c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 --2- 172.21.15.103:0/2806909646 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f25300cfd40 0x7f25301ea060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-18T23:58:36.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 >> 172.21.15.103:0/2806909646 conn(0x7f253009d3f0 msgr2=0x7f25300b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-18T23:58:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 shutdown_connections 2024-08-18T23:58:36.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-18T23:58:36.608+0000 7f2536837640 1 -- 172.21.15.103:0/2806909646 wait complete. 2024-08-18T23:58:36.620 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-18T23:58:36.620 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-18T23:58:36.621 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-18T23:58:36.621 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:36.630 INFO:tasks.ceph.mds.a:Stopped 2024-08-18T23:58:36.630 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-18T23:58:36.630 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:36.679 INFO:tasks.ceph.mds.c:Stopped 2024-08-18T23:58:36.680 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-18T23:58:36.680 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:36.691 INFO:tasks.ceph.mds.b:Stopped 2024-08-18T23:58:36.692 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-18T23:58:36.692 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:36.743 INFO:tasks.ceph.mds.d:Stopped 2024-08-18T23:58:36.743 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-18T23:58:36.744 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-18T23:58:36.744 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:36.773 INFO:tasks.ceph.osd.0:Stopped 2024-08-18T23:58:36.774 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-18T23:58:36.774 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:36.841 INFO:tasks.ceph.osd.1:Stopped 2024-08-18T23:58:36.842 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-18T23:58:36.842 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:36.917 INFO:tasks.ceph.osd.2:Stopped 2024-08-18T23:58:36.918 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-18T23:58:36.918 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:36.988 INFO:tasks.ceph.osd.3:Stopped 2024-08-18T23:58:36.988 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-18T23:58:36.988 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.015 INFO:tasks.ceph.osd.4:Stopped 2024-08-18T23:58:37.016 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-18T23:58:37.016 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.086 INFO:tasks.ceph.osd.5:Stopped 2024-08-18T23:58:37.087 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-18T23:58:37.087 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.156 INFO:tasks.ceph.osd.6:Stopped 2024-08-18T23:58:37.156 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-18T23:58:37.156 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.225 INFO:tasks.ceph.osd.7:Stopped 2024-08-18T23:58:37.225 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-18T23:58:37.225 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-18T23:58:37.226 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.251 INFO:tasks.ceph.mgr.y:Stopped 2024-08-18T23:58:37.251 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-18T23:58:37.251 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.294 INFO:tasks.ceph.mgr.x:Stopped 2024-08-18T23:58:37.294 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-18T23:58:37.295 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-18T23:58:37.295 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.305 INFO:tasks.ceph.mon.a:Stopped 2024-08-18T23:58:37.306 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-18T23:58:37.306 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.347 INFO:tasks.ceph.mon.b:Stopped 2024-08-18T23:58:37.347 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-18T23:58:37.347 INFO:teuthology.orchestra.run:waiting for 300 2024-08-18T23:58:37.399 INFO:tasks.ceph.mon.c:Stopped 2024-08-18T23:58:37.399 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-18T23:58:37.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-18T23:58:37.437 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:58:37.437 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-18T23:58:37.647 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:58:37.648 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-18T23:58:37.723 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:58:37.723 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-18T23:58:37.780 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:58:37.780 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-18T23:58:37.829 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:58:37.829 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-18T23:58:37.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:58:37.956 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-18T23:58:38.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:58:38.020 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-18T23:58:38.067 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:58:38.068 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-18T23:58:38.166 INFO:tasks.ceph:Archiving mon data... 2024-08-18T23:58:38.167 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/data/mon.a.tgz 2024-08-18T23:58:38.168 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-08-18T23:58:38.184 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.FfvTEBnran 2024-08-18T23:58:38.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FfvTEBnran 2024-08-18T23:58:38.315 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.FfvTEBnran 2024-08-18T23:58:38.399 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.FfvTEBnran is 285KB 2024-08-18T23:58:38.495 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.FfvTEBnran 2024-08-18T23:58:38.510 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/data/mon.b.tgz 2024-08-18T23:58:38.510 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-08-18T23:58:38.528 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.QRdJIp60ma 2024-08-18T23:58:38.529 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.QRdJIp60ma 2024-08-18T23:58:38.689 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.QRdJIp60ma 2024-08-18T23:58:38.776 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.QRdJIp60ma is 386KB 2024-08-18T23:58:38.876 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.QRdJIp60ma 2024-08-18T23:58:38.891 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/data/mon.c.tgz 2024-08-18T23:58:38.891 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-08-18T23:58:38.949 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.dyshNGrpqK 2024-08-18T23:58:38.949 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dyshNGrpqK 2024-08-18T23:58:39.082 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.dyshNGrpqK 2024-08-18T23:58:39.166 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.dyshNGrpqK is 386KB 2024-08-18T23:58:39.262 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.dyshNGrpqK 2024-08-18T23:58:39.277 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-18T23:58:39.277 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-18T23:58:39.280 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-18T23:58:39.361 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-18T23:58:39.397 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-08-18T23:58:39.397 INFO:tasks.ceph:Archiving crash dumps... 2024-08-18T23:58:39.399 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/remote/smithi103/crash 2024-08-18T23:58:39.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-18T23:58:39.428 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/remote/smithi190/crash 2024-08-18T23:58:39.429 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-18T23:58:39.461 INFO:tasks.ceph:Shutting down logrotate 2024-08-18T23:58:39.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:58:39.472 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-18T23:58:39.719 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-18T23:58:39.746 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-18T23:58:39.775 INFO:tasks.ceph:Compressing logs... 2024-08-18T23:58:39.775 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T23:58:39.788 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-18T23:58:39.857 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23892.log 2024-08-18T23:58:39.857 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23852.log 2024-08-18T23:58:39.858 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.23892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23932.log 2024-08-18T23:58:39.858 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.23852.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.23892.log.gz 2024-08-18T23:58:39.858 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-18T23:58:39.858 INFO:teuthology.orchestra.run.smithi190.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.23852.log.gz 2024-08-18T23:58:39.858 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.23932.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-18T23:58:39.858 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.d.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.23932.log.gz 2024-08-18T23:58:39.858 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-18T23:58:39.858 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.31073.log 2024-08-18T23:58:39.859 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.30634.log 2024-08-18T23:58:39.859 INFO:teuthology.orchestra.run.smithi190.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-18T23:58:39.859 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.3.31073.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-18T23:58:39.859 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.1.30634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24012.log 2024-08-18T23:58:39.859 INFO:teuthology.orchestra.run.smithi190.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.3.31073.log.gz 2024-08-18T23:58:39.859 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-18T23:58:39.859 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.24012.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-18T23:58:39.859 INFO:teuthology.orchestra.run.smithi190.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.1.30634.log.gz 2024-08-18T23:58:39.860 INFO:teuthology.orchestra.run.smithi190.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.24012.log.gz 2024-08-18T23:58:39.860 INFO:teuthology.orchestra.run.smithi190.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-18T23:58:39.860 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23772.log 2024-08-18T23:58:39.860 INFO:teuthology.orchestra.run.smithi190.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-18T23:58:39.860 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24052.log 2024-08-18T23:58:39.860 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.23772.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-18T23:58:39.860 INFO:teuthology.orchestra.run.smithi190.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23772.log.gz 2024-08-18T23:58:39.860 INFO:teuthology.orchestra.run.smithi190.stderr:gzip/var/log/ceph/ceph-client.admin.24052.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23812.log 2024-08-18T23:58:39.861 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.6.log: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-18T23:58:39.861 INFO:teuthology.orchestra.run.smithi190.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.24052.log.gz 2024-08-18T23:58:39.861 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-18T23:58:39.861 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-18T23:58:39.861 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.23812.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph.log 2024-08-18T23:58:39.861 INFO:teuthology.orchestra.run.smithi190.stderr: -- replaced with /var/log/ceph/ceph-client.admin.23812.log.gz 2024-08-18T23:58:39.861 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-18T23:58:39.861 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23972.log 2024-08-18T23:58:39.862 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.23972.log: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-18T23:58:39.862 INFO:teuthology.orchestra.run.smithi190.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23972.log.gz 2024-08-18T23:58:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35525.log 2024-08-18T23:58:39.885 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36931.log 2024-08-18T23:58:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.35525.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.23647.log 2024-08-18T23:58:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30320.log 2024-08-18T23:58:39.886 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35525.log.gz 2024-08-18T23:58:39.886 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36931.log.gz 2024-08-18T23:58:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.23647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32643.log 2024-08-18T23:58:39.886 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30320.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.23647.log.gz 2024-08-18T23:58:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35372.log 2024-08-18T23:58:39.887 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30320.log.gz 2024-08-18T23:58:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35896.log 2024-08-18T23:58:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35372.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32643.log.gz 2024-08-18T23:58:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36711.log 2024-08-18T23:58:39.887 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35372.log.gz 2024-08-18T23:58:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31132.log 2024-08-18T23:58:39.887 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36711.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35896.log.gz 2024-08-18T23:58:39.888 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32644.log 2024-08-18T23:58:39.888 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36711.log.gz 2024-08-18T23:58:39.888 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35645.log 2024-08-18T23:58:39.888 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32644.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31132.log.gz 2024-08-18T23:58:39.888 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35120.log 2024-08-18T23:58:39.888 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32644.log.gz 2024-08-18T23:58:39.888 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39182.log 2024-08-18T23:58:39.888 INFO:teuthology.orchestra.run.smithi103.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35645.log.gz 2024-08-18T23:58:39.889 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31282.log 2024-08-18T23:58:39.889 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35467.log 2024-08-18T23:58:39.889 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35120.log.gz 2024-08-18T23:58:39.889 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39182.log.gz 2024-08-18T23:58:39.889 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38229.log 2024-08-18T23:58:39.889 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31282.log.gz 2024-08-18T23:58:39.889 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36293.log 2024-08-18T23:58:39.889 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38229.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35467.log.gz 2024-08-18T23:58:39.890 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-08-18T23:58:39.890 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36293.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38229.log.gz 2024-08-18T23:58:39.890 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23999.log 2024-08-18T23:58:39.890 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2024-08-18T23:58:39.890 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36666.log 2024-08-18T23:58:39.890 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-08-18T23:58:39.890 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.23999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35330.log 2024-08-18T23:58:39.890 INFO:teuthology.orchestra.run.smithi103.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.23999.log.gz 2024-08-18T23:58:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33315.log 2024-08-18T23:58:39.891 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36666.log.gz/var/log/ceph/ceph-client.admin.35330.log: 2024-08-18T23:58:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39013.log 2024-08-18T23:58:39.891 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3%/var/log/ceph/ceph-client.admin.33315.log: -- replaced with /var/log/ceph/ceph-client.admin.35330.log.gz 2024-08-18T23:58:39.891 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2024-08-18T23:58:39.891 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33315.log.gz 2024-08-18T23:58:39.892 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32422.log 2024-08-18T23:58:39.892 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32641.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39013.log.gz 2024-08-18T23:58:39.892 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-08-18T23:58:39.892 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32422.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2024-08-18T23:58:39.892 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36538.log 2024-08-18T23:58:39.893 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32422.log.gz 2024-08-18T23:58:39.893 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39098.log 2024-08-18T23:58:39.893 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36538.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-08-18T23:58:39.893 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23896.log 2024-08-18T23:58:39.893 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39098.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36538.log.gz 2024-08-18T23:58:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39937.log 2024-08-18T23:58:39.894 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39098.log.gz 2024-08-18T23:58:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.23896.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33309.log 2024-08-18T23:58:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39937.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23896.log.gz 2024-08-18T23:58:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39726.log 2024-08-18T23:58:39.894 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39937.log.gz 2024-08-18T23:58:39.894 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35246.log 2024-08-18T23:58:39.895 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33309.log.gz 2024-08-18T23:58:39.895 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34968.log 2024-08-18T23:58:39.895 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37594.log 88.0% 2024-08-18T23:58:39.895 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39726.log.gz 2024-08-18T23:58:39.895 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35246.log.gz 2024-08-18T23:58:39.895 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35010.log 2024-08-18T23:58:39.895 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34968.log.gz 2024-08-18T23:58:39.896 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30509.log 2024-08-18T23:58:39.896 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35010.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37594.log.gz 2024-08-18T23:58:39.896 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32980.log 2024-08-18T23:58:39.896 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35010.log.gz 2024-08-18T23:58:39.896 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31048.log 2024-08-18T23:58:39.896 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30509.log.gz 2024-08-18T23:58:39.896 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39895.log 2024-08-18T23:58:39.896 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32980.log.gz 2024-08-18T23:58:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31048.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-18T23:58:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39895.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31048.log.gz 2024-08-18T23:58:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37636.log 2024-08-18T23:58:39.897 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39895.log.gz 2024-08-18T23:58:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32976.log 2024-08-18T23:58:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5/var/log/ceph/ceph-client.admin.37636.log: --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-18T23:58:39.897 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35288.log 2024-08-18T23:58:39.897 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32976.log.gz 2024-08-18T23:58:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.3.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.37636.log.gz 2024-08-18T23:58:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30878.log 2024-08-18T23:58:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32974.log 2024-08-18T23:58:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30878.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35288.log.gz 2024-08-18T23:58:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-08-18T23:58:39.898 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30878.log.gz 2024-08-18T23:58:39.898 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33640.log 2024-08-18T23:58:39.898 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32974.log.gz 2024-08-18T23:58:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.17595.log 2024-08-18T23:58:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35938.log: /var/log/ceph/ceph-client.admin.33640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32464.log 2024-08-18T23:58:39.899 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-08-18T23:58:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.tmp-client.admin.17595.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33640.log.gz 2024-08-18T23:58:39.899 INFO:teuthology.orchestra.run.smithi103.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.17595.log.gz 2024-08-18T23:58:39.899 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33317.log 2024-08-18T23:58:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37282.log 2024-08-18T23:58:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32464.log: /var/log/ceph/ceph-client.admin.33317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36064.log 2024-08-18T23:58:39.900 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32464.log.gz 2024-08-18T23:58:39.900 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33317.log.gz 2024-08-18T23:58:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40373.log 2024-08-18T23:58:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37282.log: /var/log/ceph/ceph-client.admin.36064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32981.log 2024-08-18T23:58:39.900 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37282.log.gz 2024-08-18T23:58:39.900 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40373.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36064.log.gz 2024-08-18T23:58:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37068.log 2024-08-18T23:58:39.901 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40373.log.gz 2024-08-18T23:58:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32243.log 2024-08-18T23:58:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32981.log: /var/log/ceph/ceph-client.admin.37068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36250.log 2024-08-18T23:58:39.901 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32981.log.gz 2024-08-18T23:58:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32243.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37068.log.gz 2024-08-18T23:58:39.901 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30922.log 2024-08-18T23:58:39.901 INFO:teuthology.orchestra.run.smithi103.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32243.log.gz 2024-08-18T23:58:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33556.log 2024-08-18T23:58:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30922.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36250.log.gz 2024-08-18T23:58:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39421.log 2024-08-18T23:58:39.902 INFO:teuthology.orchestra.run.smithi103.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30922.log.gz 2024-08-18T23:58:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-18T23:58:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33556.log: /var/log/ceph/ceph-client.admin.39421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38328.log 2024-08-18T23:58:39.902 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33556.log.gz 2024-08-18T23:58:39.902 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39421.log.gz 2024-08-18T23:58:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32032.log 2024-08-18T23:58:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30964.log 2024-08-18T23:58:39.903 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38328.log.gz 2024-08-18T23:58:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39379.log 2024-08-18T23:58:39.903 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-18T23:58:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30964.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32032.log.gz 2024-08-18T23:58:39.903 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39682.log 2024-08-18T23:58:39.903 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30964.log.gz 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36022.log 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39682.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39379.log.gz 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30719.log 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi103.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39682.log.gz 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35603.log 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36022.log.gz 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37110.log 2024-08-18T23:58:39.904 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39224.log 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30719.log.gz 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35603.log: /var/log/ceph/ceph-client.admin.37110.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35603.log.gz 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30591.log 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37110.log.gz 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39224.log: /var/log/ceph/ceph-client.admin.30591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36975.log 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39224.log.gz 2024-08-18T23:58:39.905 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30591.log.gz 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38438.log 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36975.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36975.log.gz 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32646.log 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mds.a.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38438.log.gz -5 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32982.log 2024-08-18T23:58:39.906 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-08-18T23:58:39.907 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32646.log.gz 2024-08-18T23:58:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34330.log 2024-08-18T23:58:39.907 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32982.log.gz 2024-08-18T23:58:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.34452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32158.log 2024-08-18T23:58:39.907 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-08-18T23:58:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.34330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39463.log 2024-08-18T23:58:39.907 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36580.log 2024-08-18T23:58:39.907 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.0.34330.log.gz 2024-08-18T23:58:39.908 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7%/var/log/ceph/ceph-client.admin.39463.log: -- replaced with /var/log/ceph/ceph-client.admin.32158.log.gz 2024-08-18T23:58:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37408.log 2024-08-18T23:58:39.908 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39463.log.gz 2024-08-18T23:58:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31704.log 2024-08-18T23:58:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37408.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36580.log.gz 2024-08-18T23:58:39.908 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31897.log 2024-08-18T23:58:39.909 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32379.log 2024-08-18T23:58:39.909 INFO:teuthology.orchestra.run.smithi103.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37408.log.gz 2024-08-18T23:58:39.909 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31090.log 2024-08-18T23:58:39.909 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36802.log 2024-08-18T23:58:39.910 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31897.log.gz 2024-08-18T23:58:39.910 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32379.log: /var/log/ceph/ceph-client.admin.31090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38911.log 2024-08-18T23:58:39.910 INFO:teuthology.orchestra.run.smithi103.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31090.log.gz 2024-08-18T23:58:39.910 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36802.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32379.log.gz 2024-08-18T23:58:39.910 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36802.log.gz 2024-08-18T23:58:39.910 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- 92.5% -- replaced with /var/log/ceph/ceph-client.admin.31704.log.gz 2024-08-18T23:58:39.911 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.38953.log 2024-08-18T23:58:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33314.log 2024-08-18T23:58:39.911 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38911.log.gz 2024-08-18T23:58:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38119.log 2024-08-18T23:58:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33314.log: gzip -5 --verbose 89.3% -- -- replaced with /var/log/ceph/ceph-client.admin.38953.log.gz /var/log/ceph/ceph-client.2.34828.log 2024-08-18T23:58:39.911 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-08-18T23:58:39.911 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30814.log 2024-08-18T23:58:39.911 INFO:teuthology.orchestra.run.smithi103.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33314.log.gz 2024-08-18T23:58:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38119.log.gz 2024-08-18T23:58:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.2.34828.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36459.log 2024-08-18T23:58:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39056.log 2024-08-18T23:58:39.912 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% 88.3% -- replaced with /var/log/ceph/ceph-client.2.34828.log.gz 2024-08-18T23:58:39.912 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30814.log.gz/var/log/ceph/ceph-client.admin.36459.log: 2024-08-18T23:58:39.912 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33598.log 2024-08-18T23:58:39.912 INFO:teuthology.orchestra.run.smithi103.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36459.log.gz 2024-08-18T23:58:39.913 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37552.log 2024-08-18T23:58:39.913 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33598.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39056.log.gz 2024-08-18T23:58:39.913 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40231.log 2024-08-18T23:58:39.913 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33598.log.gz 2024-08-18T23:58:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.37552.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39979.log 2024-08-18T23:58:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40231.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37552.log.gz 2024-08-18T23:58:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32645.log 2024-08-18T23:58:39.914 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40231.log.gz 2024-08-18T23:58:39.914 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39548.log 2024-08-18T23:58:39.914 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0%/var/log/ceph/ceph-client.admin.32645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35162.log 2024-08-18T23:58:39.914 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39979.log.gz 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40331.log 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32645.log.gz 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32977.log 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39548.log.gz/var/log/ceph/ceph-client.admin.35162.log: 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:gzip/var/log/ceph/ceph-client.admin.40331.log: -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.40063.log 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35162.log.gz 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32977.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40331.log.gz 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39590.log 2024-08-18T23:58:39.915 INFO:teuthology.orchestra.run.smithi103.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32977.log.gz 2024-08-18T23:58:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37156.log 2024-08-18T23:58:39.916 INFO:teuthology.orchestra.run.smithi103.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40063.log.gz 2024-08-18T23:58:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35854.log 2024-08-18T23:58:39.916 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39590.log.gz 2024-08-18T23:58:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33318.log 2024-08-18T23:58:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35854.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37156.log.gz 2024-08-18T23:58:39.916 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35204.log 2024-08-18T23:58:39.917 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35854.log.gz 2024-08-18T23:58:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35719.log 2024-08-18T23:58:39.917 INFO:teuthology.orchestra.run.smithi103.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33318.log.gz 2024-08-18T23:58:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32116.log 2024-08-18T23:58:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35719.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35204.log.gz 2024-08-18T23:58:39.917 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31174.log 2024-08-18T23:58:39.917 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32116.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35719.log.gz 2024-08-18T23:58:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40021.log 2024-08-18T23:58:39.918 INFO:teuthology.orchestra.run.smithi103.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32116.log.gz 2024-08-18T23:58:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35980.log 2024-08-18T23:58:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40021.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31174.log.gz 2024-08-18T23:58:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-18T23:58:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35980.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40021.log.gz 2024-08-18T23:58:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35777.log 2024-08-18T23:58:39.918 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35980.log.gz 2024-08-18T23:58:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-18T23:58:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.35777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36106.log 2024-08-18T23:58:39.919 INFO:teuthology.orchestra.run.smithi103.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35777.log.gz/var/log/ceph/ceph-osd.0.log: 2024-08-18T23:58:39.919 INFO:teuthology.orchestra.run.smithi103.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-18T23:58:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-18T23:58:39.919 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38590.log 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mgr.y.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36106.log.gz 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33724.log 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36190.log 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38590.log: /var/log/ceph/ceph-client.admin.33724.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38590.log.gz 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33724.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32979.log 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36190.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36190.log.gz 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33682.log 2024-08-18T23:58:39.920 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32637.log 2024-08-18T23:58:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32979.log: /var/log/ceph/ceph-client.admin.33682.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32979.log.gz 2024-08-18T23:58:39.921 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38869.log 2024-08-18T23:58:39.921 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33682.log.gz 2024-08-18T23:58:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32637.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32637.log.gz 2024-08-18T23:58:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30413.log 2024-08-18T23:58:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31955.log 2024-08-18T23:58:39.921 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38869.log: /var/log/ceph/ceph-client.admin.30413.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38869.log.gz 2024-08-18T23:58:39.921 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30413.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2024-08-18T23:58:39.922 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-08-18T23:58:39.922 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31955.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31955.log.gz 2024-08-18T23:58:39.922 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36760.log 2024-08-18T23:58:39.922 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32285.log 2024-08-18T23:58:39.922 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33766.log: /var/log/ceph/ceph-client.admin.36760.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2024-08-18T23:58:39.922 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36845.log 2024-08-18T23:58:39.922 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36760.log.gz 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32285.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32285.log.gz 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39505.log 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36845.log: /var/log/ceph/ceph-osd.1.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36845.log.gz 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37450.log 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39505.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39505.log.gz 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37366.log 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37450.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37450.log.gz 2024-08-18T23:58:39.923 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36377.log 2024-08-18T23:58:39.924 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37366.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37366.log.gz 2024-08-18T23:58:39.924 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2024-08-18T23:58:39.924 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36377.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36377.log.gz 2024-08-18T23:58:39.924 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33308.log 2024-08-18T23:58:39.924 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33808.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2024-08-18T23:58:39.924 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-18T23:58:39.924 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33308.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33308.log.gz 2024-08-18T23:58:39.925 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32640.log 2024-08-18T23:58:39.925 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.log: 84.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-18T23:58:39.925 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33178.log 2024-08-18T23:58:39.925 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32640.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32640.log.gz 2024-08-18T23:58:39.925 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36148.log 2024-08-18T23:58:39.925 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33178.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33178.log.gz 2024-08-18T23:58:39.925 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39640.log 2024-08-18T23:58:39.925 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36148.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36148.log.gz 2024-08-18T23:58:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40147.log 2024-08-18T23:58:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39640.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39640.log.gz 2024-08-18T23:58:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30763.log 2024-08-18T23:58:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40147.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40147.log.gz 2024-08-18T23:58:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40189.log 2024-08-18T23:58:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.30763.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30763.log.gz 2024-08-18T23:58:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31216.log 2024-08-18T23:58:39.926 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40189.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40189.log.gz 2024-08-18T23:58:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38272.log 2024-08-18T23:58:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31216.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.31216.log.gz 2024-08-18T23:58:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36622.log 2024-08-18T23:58:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38272.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.38272.log.gz 2024-08-18T23:58:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39853.log 2024-08-18T23:58:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36622.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36622.log.gz 2024-08-18T23:58:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37198.log 2024-08-18T23:58:39.927 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39853.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39853.log.gz 2024-08-18T23:58:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38701.log 2024-08-18T23:58:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37198.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37198.log.gz 2024-08-18T23:58:39.928 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-08-18T23:58:39.929 INFO:teuthology.orchestra.run.smithi190.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-18T23:58:39.929 INFO:teuthology.orchestra.run.smithi190.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-18T23:58:39.945 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38701.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38701.log.gz 2024-08-18T23:58:39.945 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37702.log 2024-08-18T23:58:39.945 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38743.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-08-18T23:58:39.945 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37962.log 2024-08-18T23:58:39.945 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37702.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37702.log.gz 2024-08-18T23:58:39.946 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40105.log 2024-08-18T23:58:39.946 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.0.37962.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.37962.log.gz 2024-08-18T23:58:39.946 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31006.log 2024-08-18T23:58:39.946 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40105.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-18T23:58:39.946 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40105.log.gz 2024-08-18T23:58:39.946 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37026.log 2024-08-18T23:58:39.947 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.31006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32642.log 2024-08-18T23:58:39.947 INFO:teuthology.orchestra.run.smithi103.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31006.log.gz 2024-08-18T23:58:39.947 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32074.log 2024-08-18T23:58:39.947 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32642.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37026.log.gz 2024-08-18T23:58:39.947 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32642.log.gz 2024-08-18T23:58:39.947 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37324.log 2024-08-18T23:58:39.947 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32970.log 2024-08-18T23:58:39.948 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32074.log: /var/log/ceph/ceph-client.admin.37324.log: 91.7% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32074.log.gz 2024-08-18T23:58:39.948 INFO:teuthology.orchestra.run.smithi103.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-18T23:58:39.948 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37324.log.gz 2024-08-18T23:58:39.948 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38481.log 2024-08-18T23:58:39.948 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.32970.log: /var/log/ceph/ceph-client.admin.30675.log 2024-08-18T23:58:39.949 INFO:teuthology.orchestra.run.smithi103.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32970.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39811.log 2024-08-18T23:58:39.949 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-08-18T23:58:39.949 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38481.log: /var/log/ceph/ceph-client.admin.30675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36335.log 2024-08-18T23:58:39.949 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39811.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30675.log.gz 2024-08-18T23:58:39.949 INFO:teuthology.orchestra.run.smithi103.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.38481.log.gz 2024-08-18T23:58:39.949 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39811.log.gz 2024-08-18T23:58:39.949 INFO:teuthology.orchestra.run.smithi103.stderr: /var/log/ceph/ceph-client.admin.37510.log 2024-08-18T23:58:39.949 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.36335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38785.log 2024-08-18T23:58:39.950 INFO:teuthology.orchestra.run.smithi103.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36335.log.gz 2024-08-18T23:58:39.950 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2024-08-18T23:58:39.950 INFO:teuthology.orchestra.run.smithi103.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37510.log.gz 2024-08-18T23:58:39.950 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32200.log 2024-08-18T23:58:39.950 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38785.log: /var/log/ceph/ceph-client.admin.33938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2024-08-18T23:58:39.951 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38785.log.gz 2024-08-18T23:58:39.951 INFO:teuthology.orchestra.run.smithi103.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2024-08-18T23:58:39.951 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.32200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33514.log 2024-08-18T23:58:39.951 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32200.log.gz 2024-08-18T23:58:39.951 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.40291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38827.log 2024-08-18T23:58:39.951 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9%/var/log/ceph/ceph-client.admin.33514.log: -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2024-08-18T23:58:39.951 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30633.log 2024-08-18T23:58:39.952 INFO:teuthology.orchestra.run.smithi103.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33514.log.gz 2024-08-18T23:58:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37240.log 2024-08-18T23:58:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.38827.log: /var/log/ceph/ceph-client.admin.30633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32337.log 2024-08-18T23:58:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.37240.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38827.log.gz 2024-08-18T23:58:39.952 INFO:teuthology.orchestra.run.smithi103.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30633.log.gz 2024-08-18T23:58:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33316.log 2024-08-18T23:58:39.953 INFO:teuthology.orchestra.run.smithi103.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37240.log.gz 2024-08-18T23:58:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.32337.log: -- /var/log/ceph/ceph-client.admin.39768.log 2024-08-18T23:58:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.33316.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32337.log.gz 2024-08-18T23:58:39.953 INFO:teuthology.orchestra.run.smithi103.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33316.log.gz 2024-08-18T23:58:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.39768.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39768.log.gz 2024-08-18T23:58:40.005 INFO:teuthology.orchestra.run.smithi103.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-18T23:58:40.421 INFO:teuthology.orchestra.run.smithi103.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-18T23:58:40.436 INFO:teuthology.orchestra.run.smithi190.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-18T23:58:40.481 INFO:teuthology.orchestra.run.smithi103.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-18T23:58:40.496 INFO:teuthology.orchestra.run.smithi190.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-18T23:58:40.509 INFO:teuthology.orchestra.run.smithi190.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-18T23:58:40.522 INFO:teuthology.orchestra.run.smithi190.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-18T23:58:40.523 INFO:teuthology.orchestra.run.smithi190.stderr: 2024-08-18T23:58:40.524 INFO:teuthology.orchestra.run.smithi190.stderr:real 0m0.693s 2024-08-18T23:58:40.524 INFO:teuthology.orchestra.run.smithi190.stderr:user 0m2.658s 2024-08-18T23:58:40.524 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m0.127s 2024-08-18T23:58:40.525 INFO:teuthology.orchestra.run.smithi103.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-18T23:58:40.530 INFO:teuthology.orchestra.run.smithi103.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-18T23:58:40.532 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-08-18T23:58:40.533 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m0.731s 2024-08-18T23:58:40.533 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m2.861s 2024-08-18T23:58:40.533 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m0.219s 2024-08-18T23:58:40.534 INFO:tasks.ceph:Archiving logs... 2024-08-18T23:58:40.534 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/remote/smithi103/log 2024-08-18T23:58:40.535 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T23:58:41.197 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/remote/smithi190/log 2024-08-18T23:58:41.198 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-18T23:58:41.622 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-18T23:58:41.634 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-18T23:58:41.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T23:58:41.637 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-18T23:58:41.716 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-18T23:58:41.725 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-18T23:58:41.725 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T23:58:41.728 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-18T23:58:41.741 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-08-18T23:58:41.743 INFO:teuthology.orchestra.run.smithi190.stderr:bash: line 1: ntpq: command not found 2024-08-18T23:58:41.745 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T23:58:41.745 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-08-18T23:58:41.745 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 177 59 +276us[ +264us] +/- 40ms 2024-08-18T23:58:41.745 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 60 -661us[ -674us] +/- 61ms 2024-08-18T23:58:41.746 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 59 +228us[ +216us] +/- 62ms 2024-08-18T23:58:41.746 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:58:41.747 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-18T23:58:41.747 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2024-08-18T23:58:41.747 INFO:teuthology.orchestra.run.smithi190.stdout:^* hv01.front.sepia.ceph.com 3 6 177 60 +281us[ +274us] +/- 40ms 2024-08-18T23:58:41.747 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv02.front.sepia.ceph.com 3 6 177 61 -655us[ -663us] +/- 61ms 2024-08-18T23:58:41.748 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 60 +222us[ +215us] +/- 62ms 2024-08-18T23:58:41.748 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-18T23:58:41.749 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-18T23:58:41.758 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-18T23:58:41.759 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-18T23:58:41.773 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-18T23:58:41.841 DEBUG:teuthology.orchestra.run.smithi190:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-18T23:58:41.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:58:41.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:41.918 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-18T23:58:41.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:41.944 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-18T23:58:41.954 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-18T23:58:41.976 INFO:teuthology.task.internal:Duration was 365.132936 seconds 2024-08-18T23:58:41.977 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-18T23:58:41.996 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-18T23:58:41.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T23:58:41.999 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-18T23:58:42.035 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:58:42.037 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-18T23:58:42.336 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-18T23:58:42.337 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-08-18T23:58:42.337 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T23:58:42.398 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-08-18T23:58:42.398 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-18T23:58:42.449 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-18T23:58:42.449 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T23:58:42.451 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-18T23:58:42.478 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-18T23:58:42.478 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T23:58:42.518 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-18T23:58:42.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-18T23:58:42.597 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-18T23:58:42.598 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T23:58:42.623 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-18T23:58:42.648 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-18T23:58:42.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T23:58:42.665 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-18T23:58:42.686 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-08-18T23:58:42.711 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-08-18T23:58:42.724 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T23:58:42.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:42.755 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-18T23:58:42.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-18T23:58:42.780 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-18T23:58:42.792 INFO:teuthology.task.internal:Transferring archived files... 2024-08-18T23:58:42.793 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/remote/smithi103 2024-08-18T23:58:42.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T23:58:42.831 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860032/remote/smithi190 2024-08-18T23:58:42.832 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-18T23:58:42.862 INFO:teuthology.task.internal:Removing archive directory... 2024-08-18T23:58:42.862 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T23:58:42.868 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-18T23:58:42.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-18T23:58:42.926 INFO:teuthology.task.internal:Not uploading archives. 2024-08-18T23:58:42.926 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-18T23:58:42.940 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-18T23:58:42.940 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T23:58:42.943 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-18T23:58:42.955 INFO:teuthology.orchestra.run.smithi103.stdout: 262218 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 23:58 /home/ubuntu/cephtest 2024-08-18T23:58:42.970 INFO:teuthology.orchestra.run.smithi190.stdout: 262218 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 18 23:58 /home/ubuntu/cephtest 2024-08-18T23:58:42.971 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-18T23:58:42.981 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-18T23:58:43.014 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/backtrace} duration: 365.132936000824 failure_reason: 'Test failure: test_backtrace (tasks.cephfs.test_backtrace.TestBacktrace)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cdb6ce880d9d45fe91e5b8ec4a3528ea status: fail success: false 2024-08-18T23:58:43.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-18T23:58:43.100 INFO:teuthology.run:FAIL